Stop predicting words one by one.
A new paper just broke the next-token rule every LLM follows.
It cuts generation steps by 4ร and training compute by 44%.
๐ก๐ฒ๐ ๐-๐๐ผ๐ธ๐ฒ๐ป ๐ฝ๐ฟ๐ฒ๐ฑ๐ถ๐ฐ๐๐ถ๐ผ๐ป ๐ถ๐ ๐๐ต๐ฒ ๐ฏ๐ผ๐๐๐น๐ฒ๐ป๐ฒ๐ฐ๐ธ
CALM replaces word-by-word guessing with vector-by-vector prediction.
Each step predicts a continuous vector representing multiple tokens.
The model operates on ideas per step, not symbols.
โข One vector encodes about four tokens
โข Sequence length drops by four
โข Attention and sampling shrink with it
๐ง๐ต๐ฒ ๐ฎ๐ฟ๐ฐ๐ต๐ถ๐๐ฒ๐ฐ๐๐๐ฟ๐ฒ ๐ฟ๐ฒ๐บ๐ผ๐๐ฒ๐ ๐ฑ๐ถ๐๐ฐ๐ฟ๐ฒ๐๐ฒ ๐น๐ถ๐บ๐ถ๐๐
It uses an autoencoder to compress and reconstruct text with 99.9% accuracy.
An energy-based Transformer predicts the next vector in one step.
There is no softmax, no vocabulary ceiling, no token sampling.
๐ง๐ต๐ถ๐ ๐ฐ๐ต๐ฎ๐ป๐ด๐ฒ๐ ๐๐ต๐ฎ๐ ๐น๐ฎ๐ป๐ด๐๐ฎ๐ด๐ฒ ๐บ๐ผ๐ฑ๐ฒ๐น๐ ๐ฐ๐ฎ๐ป ๐ฑ๐ผ
โข Faster training and inference
โข Better performance per FLOP
โข New evaluation metric replacing perplexity
If it scales, token-based LLMs become the inefficient baseline.
I cleaned up a lot of Dexterโs code today.
Our core agent loop is now ~300 lines.
What Dexter does:
โข finds undervalued stocks
โข analyzes them deeply
โข builds valuation models
All of it is open source.
A proptech startup just raised $2M to automate real estate workflows.
I built the core of it in a weekend:
- Real-time MLS & DB updates
- Instant neighborhood + property insights
- Coordinates open houses & contract tasks
- Integrates directly into your existing backend/back office workflows
- Built to help close, not just chat
Built with @OpenAIโs Agents SDK and @AgentOpsAI for full traceability.
DMs open for access.
@solana It's a bit iffy, a lot of people tend not to want to dox themselves. I've seen Blockchain/Crypto communities(small minorities) since late 2017, albeit there has been substantial growth since then.
I really am thinking that given @metaplex is more focused on protocol and example offerings, perhaps the heftier Metaplex UI ought to be retired given how well @holaplex is doing with it. Let them steward that now, you all focus on the #BUIDL.
@TSolserer@solsoul8@0xAlice_ Update authority can be faked but then the imposter gives up control of their NFT. Metaboss provides this as an option because it's a useful way to filter but shouldn't be relied on solely for verification of mints.
@armaniferrante It's precisely the inverse apparently, it proves one thing we all appreciate, but degrades the latter, how much fun can liquidity be in the longterm?