Will LLMs eat robotics?
Many say frontier labs will win by distilling models to run at real-time. The story is more complex, and one critical piece is simulation.
Closing the sim-to-real gap creates a recursive loop for robotics models.
I wrote for @substratemag:
https://t.co/nnm1OcLWY8
the conventional view is that datacenters require reliability
but if your workload tolerated 95% uptime? 90%? you could move workloads between sites if the dc drops and take advantage of underutilized (cheaper) capacity
I interviewed @neilmovva for @substratemag on latency-insensitive inference, alternative chips, and why massive datacenters face diseconomies of scale.
"We've always predicted that async inference is going to eat the world. That could easily be 95% or more of inference demand."
Neil's been at the frontier of inference for years, from NVIDIA to co-founding @sailresearchco. I learned a lot from our conversation - you can listen below.
AI is rapidly expanding the supply of therapeutic ideas, but turning them into effective medicines is still hard.
In our new essay, our co-founder Melissa J. Moore explores how better mRNAs can unlock novel medicines, and why mRNA’s most important chapter is still ahead.
https://t.co/PTzTkONrRU
I sat down with @dylan522p and spoke with over a dozen people about his information machine.
"I don't think anyone who has a traditional equity research background would even try to figure out where $3T in [the AI labs' combined] ARR comes from."
Slack private messaging limits, finding CoWoS volume, and the industry they're looking at next - I wrote about SemiAnalysis here: https://t.co/0FVDIJNaGe
🏮Announcing the Lantern Summit in Shanghai🏮
In 2025, more new medicines launched first in China than anywhere else on Earth.
That has never happened before.
Drug development has two simultaneous accelerators:
• AI is collapsing design (weeks instead of years).
• China is collapsing development (physical iteration speed).
Here is why that matters, and what Western biotech is missing: 🧵
@skalskip92@OpenAI Read the blog & watched parts of the stream, really loved them ❤️
If you set "detail" "low", images get resized to 512 x 512 and only result in 85 tokens if that's enough for your use case (it might not be).
Would love to chat about the other perf issues, feel free to DM me!
@mengdi_en@OpenAI I think it should still help because even for small images, we will turn them into 255 tokens at minimum. We'll be extra clear about this in our docs. See if for a dataset of 20 images (should be free) if you see a difference, and please DM me if you don't!
@skalskip92@OpenAI I don't recommend this for use cases where you need higher resolution images, but for the poker card use case, I think you can still get good perf at a lower price point.
@skalskip92 Hey @skalskip92! I lead vision fine-tuning at @OpenAI, thank you so much for the feature! I hear you on the cost and moderation front. Did you try "detail" "low" to reduce the token count for image inputs to make it cheaper?