Turing Community

Accelerating frontier AI models + systems.
Powered by ALAN and a 4M+ global talent cloud.
AGI at scale.

[Turing @turingcom]

MMLU is saturated. HLE is getting there.

We built Multimodal STEM HLE++: for what comes next, and the top frontier labs publishing SOTA models are already using it.

1,100 PhD-level multimodal STEM problems that break Opus 4.6. Around 20% pass@1 on SOTA. Hard enough to expose reasoning failures. Solvable enough to generate real RL signal.

Every problem requires joint reasoning over images and text, has a deterministic ground-truth answer, and was authored by a PhD-level domain specialist.

50-task public sample on @HuggingFace.
Full pack available now. Links below.

[Turing @turingcom]

Hugging Face: https://t.co/A1Uvpcg2Do

[Turing @turingcom]

To view this and additional datasets: https://t.co/3lRHD7SunH

[Jonathan Siddharth @jonsidd]

The models are already extraordinary.
That's not the hard part anymore.
The hard part is letting them touch reality.

Real workflows. Real data. Real stakes.

The next decade belongs to whoever solves deployment, not whoever builds the best benchmark score.

I've been making that bet for seven years.
I'm more convinced than ever. Link below.

[Jonathan Siddharth @jonsidd]

https://t.co/qUWOrt454F

[This Week in AI @ThisWeeknAI]

Who's actually building AI?

3 months and 14 episodes into This Week in AI, @Jason has sat down with founders and operators across infra, models, dev tools, consumer, creative, robotics, healthcare, and more.

INFRA & COMPUTE
Chase Lochmiller (Crusoe) @ChaseLochmiller
Lin Qiao (Fireworks AI) @lqiao
Chris Lattner (Modular) @clattner_llvm
Nick Harris (Lightmatter) @theanalognick
Mitesh Agrawal (Positron AI) @mitesh711
Alex Cheema (EXO Labs) @alexocheema
Philip Johnston (Starcloud) @PhilipJohnston
Naveen Rao (Unconventional AI) @NaveenGRao
Russ d'Sa (LiveKit) @dsa

FOUNDATION MODELS & RESEARCH
Kanjun Qiu (Imbue) @kanjun
Carina Hong (Axiom Math) @CarinaLHong
Jeremy Fraenkel (Fundamental) @fraenkelj

EVALS & BENCHMARKS
Anastasios Angelopoulos (Arena) @ml_angelopoulos

DEV TOOLS, CODING & AUTOMATION
Karri Saarinen (Linear) @karrisaarinen
Matan Grinberg (Factory) @matanSF
Spiros Xanthos (Resolve AI) @spirosx
Wade Foster (Zapier) @wadefoster

CONSUMER & SEARCH
Aravind Srinivas (Perplexity) @AravSrinivas
Richard Socher (youdotcom & Recursive) @RichardSocher
Tanay Kothari (Wispr Flow) @tankots
Steven Berlin Johnson (NotebookLM) @stevenbjohnson

CREATIVE & MEDIA
Demi Guo (Pika) @demi_guo_
Victor Riparbelli (Synthesia) @vriparbelli
Mikey Shulman (Suno) @MikeyShulman
Grant Lee (Gamma) @thisisgrantlee

ROBOTICS
Jake Loosararian (Gecko Robotics) @jakeloosy
Boris Sofman (Bedrock Robotics) @bsofman

HEALTHCARE
Shiv Rao (Abridge) @ShivdevRao
Trey Holterman (Tennr) @TreyHolterman

ENTERPRISE, VERTICAL & DATA
George Sivulka (Hebbia) @gsivulka
Kashif Ali (TaxGPT) @ChKashifAli
Alex Elias (Qloo) @ape

TALENT & WORKFORCE
Ali Ansari (micro1) @aliansarinik
Jonathan Siddharth (Turing) @jonsidd

Thank you all for joining!

Episode 14 out now: https://t.co/oaDPn5WfT8

[Turing @turingcom]

Excited to share that @Turingcom Co-founder @krishnanvijay will be joining an industry panel with: @ravisujith (GVP, @OracleAI), @Kenneth_Marino (@UUtah), and @MingHsuanYang (@ucmerced @GoogleDeepMind) at #CVPR2026

The morning will be dedicated to solving the hardest parts of Agentic Systems and bridging the gap between Computer Vision, NLP and Informational Retrieval.

[Turing @turingcom]

Last week we released the Open MM-RL Dataset.

A PhD-level multimodal STEM benchmark built for verifiable reasoning across physics, chemistry, biology, and math. Four STEM domains, one dataset

-Physics: Quantum and Particle Physics, Condensed Matter and Materials, Electromagnetism, Photonics, and Plasma Systems, Astrophysics and Space Physics
-Mathematics: Algebra and Structure, Discrete Mathematics, Analysis and Continuous Mathematics, Probability and Geometry
-Biology: Evolutionary Systems, Molecular Mechanisms, Cellular Processes and Neural Biology
-Chemistry: Chemical Structure, Reaction Mechanisms, Synthesis, Spectroscopy and Properties

The bar is raised. Download below.

[Turing @turingcom]

https://t.co/kjLOjaN4nM

[Turing @turingcom]

Now trending at #1 on @huggingface

[Jonathan Siddharth @jonsidd]

Open MM-RL Dataset is trending on @huggingface.

We built something I've wanted for a long time.

- PhD-level STEM reasoning across physics, math, biology & chemistry
- 100% verifiable, auto-gradable answers
- Single-image, multi-panel & multi-image formats
- Two-round expert review on every problem
- RL-ready reward structure out of the box

Most multimodal dataset test perception. This one tests reasoning. The kind that doesn't break under scrutiny.

Built by PhD SMEs.
Validated for frontier models.
Open to the community.

Website & Dataset below.

[Jonathan Siddharth @jonsidd]

Website: https://t.co/5u6duCCm18

[Turing @turingcom]

Most browser agent benchmarks are already solved.
We built ones that aren't.

500+ tasks. 100+ templates. 50%+ model-breaking difficulty at delivery. Full case study → Below.

[Turing @turingcom]

https://t.co/wZYMau60GS

[Turing @turingcom]

Open-MM-RL is trending at #3 on @huggingface!

This is a strong signal that the community wants harder, cleaner datasets for frontier model evaluation, training and a sign that the community is actively looking for datasets that make multimodal evaluation more rigorous.

Take a look, tell us what you think, below.

[Turing Community @turingcomdev]

@turingcom https://t.co/ybjdGaBqpV

[Turing @turingcom]

Introducing the Open MM-RL Dataset.

A PhD-level multimodal STEM benchmark built for verifiable reasoning across physics, chemistry, biology, and math.

Four STEM domains, one dataset

-Physics: Quantum and Particle Physics, Condensed Matter and Materials, Electromagnetism, Photonics, and Plasma Systems, Astrophysics and Space Physics
-Mathematics: Algebra and Structure, Discrete Mathematics, Analysis and Continuous Mathematics, Probability and Geometry
-Biology: Evolutionary Systems, Molecular Mechanisms, Cellular Processes and Neural Biology
-Chemistry: Chemical Structure, Reaction Mechanisms, Synthesis, Spectroscopy and Properties

We're raising the bar.

[Turing @turingcom]

On @huggingface https://t.co/kjLOjaN4nM

[Turing @turingcom]

Most AI systems break when documents stop being clean and predictable.

We built a dataset to fix that:
• 15,000+ OCR, summarization, and translation tasks
• 10+ document types (handwriting, scans, financial reports, more)
• 10+ languages
• 95%+ summarization accuracy

The hard part wasn't scale. It was realism.

Multi-page docs. Rotated text. Tables, math, and messy layouts. Strict no-hallucination summaries.

Plus a multi-layer QA system combining automated review and human validation to catch even subtle errors.

This is what it takes to train AI for real-world document understanding. Full case study below.

[Turing @turingcom]

Learn More: https://t.co/ciNQlDSZWV