My dear friends, I’d like to show you my latest toy project
Introducing Handwired: turn your regular JavaScript code into a neural net!
- no training
- exact outputs vs the JS program
- fully differentiable
All runnable in a browser, without GPU
Introducing Contrastive Language Model (CLM): an ultra-fast System One Model trained with a contrastive learning objective that connects states and actions.
CLM-8B is pre-trained on internet-scale data and delivers up to 9× faster inference than Jev ⚡ while achieving comparable performance across computer-use, gaming, and tool-calling tasks.
With lightweight fine-tuning, CLM-8B sets a new SOTA on challenging agentic coding benchmarks, such as DeepSWE (81.6%) and Terminal-Bench 2.1 (87.6%). In contrast, Jev fails to serve as an effective verifier for these long-horizon tasks.
We also build an efficient training and serving infra for CLMs by disaggregating states and actions, allowing their embeddings to be cached and reused independently. This substantially reduces inference latency in settings where the state evolves continuously while the action set remains fixed.
Finally, we establish scaling laws for CLMs and show that the test contrastive loss decreases predictably as a power law in training compute, model size, and dataset size.
📄 Blog: https://t.co/zwi9JOHKGx
💻 Code: https://t.co/rsHRYCGR8I
🗣️ Discord: https://t.co/Uqtdefvo3J
🤗 Data & Models: https://t.co/wdSWGGO3hu
More details on CLM’s architecture, data recipe, and scaling laws in the thread below 🧵
In an alternative reality, I too would love to live a life of training cormorants to fish for me. Amazing mini-documentary - I don't think AI can even dream of this idea...
https://t.co/3A6gFeuClZ
Introducing Atlas:
The world's first multimodal world model that generates image and video frames with pixel-perfect camera control and reconstructs them in 3D.
Model the world, move the camera, and simulate space & time.
just had a quick look at microduck_rl
the codebase is very elegant, i’d recommend reading the agent.md since it contains quite a few fun quirks for reward modeling like
head tracking too tight impairs walking cause the head is 38% of the duck’s weight, so it naturally oscillates -> to solve this, smooth the head tracking error using ema, essentially penalizing only the dc bias
also a few other quirks as you dig deeper into the codebase like how they model the backlash of the motor by adding an unactuated hinge (with very small range) in series with the motor
gg @antoinepirrone
https://t.co/p7tvex9RSp
elder care robotics is the most underrated market in physical AI right now. japan is 5 years ahead on this and the results are real. robots helping seniors stay independent longer isn't dystopian, it's genuinely beautiful.
@sidsudhakaran @yurigagrinn@ReddySuryatej@abstract_alge 4/VOICE WAR ROOM: This wall is how App got built. And after launch, we erased it. We're a company that believes in clean surfaces
@JasonrShuman They are among the few Chinese cos that are deliberately building up a ground team here in the U.S., lots of presence from conference to local meetups - big confidence boost for after-sale support (e.g., not having to wait 6 weeks for replacement parts)
Excited to announce that Dimensional is now THE compliant gateway for robots to access the US
Big thanks to dimOS contributors cited in the National Security Determination and our supporters in government
Working closely with our partners home & abroad to secure network attacks, eliminate data exfiltration, and protect American infrastructure from foreign backdoors
For my first post, I’m sharing a letter @NVIDIA signed on why open models matter.
AI will transform every industry, power every company, and be built by every country.
Open models strengthen safety and cybersecurity, accelerate innovation and diffusion, and enable sovereignty.
The world needs both frontier closed models and frontier open models.
https://t.co/AUKzoQ5Ikb
industrial robotics deployments grew 31% YoY in Q1 2024 and everyone's celebrating. meanwhile 68% of manufacturers still say integration complexity is the main reason they can't actually deploy. hardware and software both work fine individually, the bottleneck is nobody has enough people who know how to wire them together on a factory floor running 15-year-old PLCs with zero documentation.