Meet TPU 8i Max and TPU 8tx, the third and fourth systems in our eighth-generation TPUs.
Together, these four systems give customers a purpose-built accelerator for every stage of the agentic lifecycle:
– TPU 8t for scale-up training
– TPU 8i for low-latency reasoning
– TPU 8tx for confidential computing
– TPU 8i Max for massive context windows and the highest compute density per rack
Read more in our announcement post: https://t.co/CqcqUtvSsW
Thrilled to share a big milestone from our AI & Infrastructure team at @Google.
Today we’re expanding our 8th generation TPU portfolio with:
• TPU 8i Max: Built for massive context windows and the highest compute density per rack
• TPU 8tx: Purpose-built for secure, confidential inference
This marks the first time we’ve introduced four distinct TPU systems in a single generation, in one year.
For developers, hardware is only as good as the software stack. And we want you to be able to build with TPUs as easily and efficiently as we do at Google. You can now:
↳ Run native PyTorch & Hugging Face models via TorchTPU (zero code rewrites)
↳ Cut KV transfer latency >90% with open-source TPU Sync
↳ Eliminate idle compute waste with Agent Compute Engine
Read more about our newest TPUs on our blog: https://t.co/8eaFhq3jhi
I look forward to connecting with builders, researchers, engineers and organizations pushing the boundaries of AI and computing!
The Iron(wood) Throne:
Google's TPU Stakes Its Claim on Inference
Viable Alternative of CUDA Moat,
NVIDIA Working Nights & Weekends,
Jensen’s Counter Submission, Kimi K3,
Meta Muse Spark Open, GLM5.3,
TorchTPU, SGLang, vLLM, llm-d, Ray
https://t.co/mh16HIWmpJ
Train in Python, serve in C++. ⚡
Meet XLA Serving Engine (XSE), our open source C++ runtime for serving JAX and StableHLO models across TPUs, GPUs, and CPUs with 2–5x the throughput of a Python server.
👇 Link in first reply
String theory is what happens when an intelligent system is starved of sensory input and starts hallucinating. Intelligence needs grounding.
For this reason, intelligence is practically never the bottleneck to solving impactful problems. The bottleneck is iterated contact with reality.
We heard the hype around LLMs and robotics, so we put Astra and Fable to the test.
16 tasks testing 13 capabilities.
Our finding: both did surprisingly well on reasoning and planning and struggled with dexterity. But Astra did better overall.
Here’s what happened:
New newsletter: I KNOW WHY THE MATHEMATICIANS WEEP
I wrote about "technological grief"—the uncanny and ego-eviscerating feeling of watching a machine do an intellectual job on which you based your sense of self and worth. Also:
- what makes humans special
- what makes math special
- why science is both a craft (discovery) and a conversation (the relationships you build with fellow discoverers)
- how AI disrupting the former (intelligence) might increase the significance of the latter (relationships)
- why other fields should be prepared for emotional and occupational disorientation that mathematicians are going through
With many thanks to deeply wise words of @stevenstrogatz
https://t.co/P25n34a2lK