We've figured out how to *pretrain transformers* with zeroth-order optimization and no backprop.
Many of the core assumptions in optimization research are completely wrong.
(paper out soon)
🧮 Math v0.1.0 is out now! 🧮
We asked and Opus one shot... just kidding. Our resident expert @isaac_mason_ hand crafted the playful web's most optimized math engine.
→ allocation-free, monomorphic and benchmarked for speed
→ tiny and tree-shakable, only pay for what you use
→ works with webgl, webgpu, wasm or your favourite renderer
→ data-oriented design for the fastest possible code
Includes a skill for juicing up your agent. Just /math and it will produce optimized algorithms for you. This should be an easy addition to any creative dev project.
And the best part?
'npm i math'
https://t.co/abKKY9YZJZ
basketball AI (95% local AI + 5% GPT-6 Astra)
- detect ball and players
- track players
- re-identify players across plays
- OCR player numbers
- recognize player in possession
- detect court keypoints
- map player positions and trajectories
Astra is powerful, but expensive tool. use it when it actually makes a difference.
↓ deep dive
I can’t stress enough how little an idea matters compared to the agency of the people executing the idea.
I have had the privilege of knowing and sometimes even working with some of the most successful people (by various metrics).
The difference between mediocre and excellent work and outcomes is predominantly one of agency.
In practice this means: they dont wait for things to happen to them they go out and make things happen for them.
They don’t wait for someone else to do something, for someone to teach them, for someone to give them the path, etc. They just go out and find a way to do it.
I think the single biggest superpower these people have is the realization/belief that the world around them is completely mutable. Most everything that happens is because a person made it happen.
I used to tell people to look around the room you’re sitting in. Look at everything. Every noun. It almost all exists because a person willed it into existence. Nothing is stopping you from doing the same.
I see people online all the time dismissing someone else’s success because “I had that idea first” or whatever. I mean… yeah? If so then the difference is… you. So a bit of a self own whenever I hear that.
Number one tip: act with agency.
This paragraph by Haruki Murakami hits hard:
“Once the storm is over, you won’t remember how you made it through, how you managed to survive. You won’t even be sure, whether the storm is really over. But one thing is certain. When you come out of the storm, you won’t be the same person who walked in. That’s what this storm’s all about.”
since you guys loved the exploding tesla..
I used GPT-6 Astra to create a 3D website that pulls apart the male anatomy into 2,234 modeled pieces!
we are in a renaissance of learning
Found a genuinely useful repo for anyone writing ML papers.@ChenLiu_1996
A Yale CS PhD shared the Python scripts behind figures from Nature Machine Intelligence, ICML, NeurIPS, and ECCV.
Maybe I can finally stop spending half my research life moving matplotlib legends by 3 pixels.
https://t.co/2Cx2f9mJYz
Introducing Flow Reasoning Models.
We developed a recurrent flow-based architecture to efficiently solve structured reasoning problems (e.g., Sudoku).
FRMs apply continuous flows to discrete data and recurrently refine their past mistakes through self-conditioning.
I don't know if you really understand what these people just did...
They built an AI that looks at a few casual real-world videos or photos and instantly turns them into a full 3D playground.
You can MOVE THE CAMERA HOWEVER YOU WANT, change the lighting, move objects around, and even let physics play out like in the real world.
View events from impossible angles because Atlas knows what was there.
This is massive!
Let's take robotics. Until now training robots meant collecting tons of expensive real-world data. Now a handful of recordings can become thousands of different simulated situations.
Robots can practice the same task in new rooms, with different objects and lighting without anyone having to film it all again.
For the industry it means we can train robots way faster and cheaper. Home robots, warehouse robots, whatever... they can learn new environments at scale instead of staying stuck in the lab.
This is one of the first real bridges between “cool AI video models” and actual physical machines that have to work in the real world.
Blog: https://t.co/rC1uFTzfEZ
The team behind @theworldlabs: @drfeifei, @jcjohnss, @BenMildenhall and @YunzhuLiYZ. The video is from @davidpantera_.
Follow for more insights into robotics and AI.
——
Weekly robotics and AI insights.
Subscribe free: https://t.co/9Nm01QUcw3
We’re launching tldraw flash, a new way to animate hand‑drawn ideas on the infinite canvas.
Draw a shape, press record, then drag to perform the motion. Trim clips on the timeline, export, and remix.