Introducing Kimi K3: Open Frontier Intelligence
๐น 2.8 Trillion Parameters, 1 Million Context, Native Multimodal
๐น Kimi Delta Attention enables up to 6.3x faster decoding in million-token contexts
๐น Attention Residuals deliver ~25% higher training efficiency at <2% additional cost
๐น Built for long-horizon agentic coding and self-evolving workflows
Kimi K3 is now live on on https://t.co/zrk6zZxZUo, Kimi Work, Kimi Code, and the Kimi API.
Open Weights by July 27, 2026.
๐ API: https://t.co/XCrgjXAqMw
๐ Tech blog: https://t.co/YTfiMSNM1f
Google DeepMind ๐ค @A24
Weโre launching a research partnership with A24 to ensure the tools of the future are shaped by the creators who use them. Find out more โ https://t.co/KN3HdGVjGS
I think narratives like the "permanent underclass" mindset can be very harmful. Not because they cause emotional depression, but they change the game-theoretic dynamics.
People cooperate in prisoner's dilemma/commons scenarios when they believe the game has many turns.
But if you believe the game only has a few turns, and that you should win otherwise you become the "permanent underclass", then the rational self-interested move is to defect: do whatever you can to win in the short term.
I think the whole AI research community is in that scenario now. No one stays in academia to educate new talent. Frontier lab competition becomes more and more aggressive and toxic.
I can't imagine how much public benefit those doomer narratives alone will cost us. Especially if they're wrong, which I think they are
Do I understand it correctly that the OLMo from-scratch series is coming to an end?
If so, looks like NVIDIA stepped up just in time with Nemotron models as the only remaining fully-open (ie not just weight drop) from-scratch LLM team.
I just spent months handwriting a 200 page guide on the entirety of ML foundations and math from scratch.
The guide features:
- Neural Nets (Backprop, Adam, SGD, Batch Norm)
- ML Algorithms (SVM, Grad Boosting, K-means, PCA)
- Hardware (Tensor Cores, Systolic Arrays, CUDA)
- Transformers (Multi-Head Attn, KV Cache, LoRA)
- Vision (ViT, Convolutions, MAE, IoU, NMS, VLM)
- Agents (OpenClaw, ReAct, Memory, Orchestration)
Everything I wish I had years ago, for free.
The next wave of AI will not be won by better prompts. It will be won by systems that learn from experience.
Today, Prime Intellect Lab is out of beta, open for you to start training your own models.
The era of self-improving agents is here.