.@DecagonAI co-founder and CTO Ashwin Sreenivas says the choice between expensive frontier models and cheaper, less capable ones is a false trade-off:
"Even if you have a 'dumber model,' you can get it to higher performance on that specific task."
"When we fine-tune smaller, dumber models, it's that they're just not as general purpose, but on the specific task we want them to do, they actually outperform the large, smart, state-of-the-art models."
"So we end up getting all three things. It is better at the task, it is cheaper, and it is faster."
@AshwinSreenivas
We have information that Moonshot AI distilled Anthropic’s Fable for the development of its K3 model.
To do this they developed a sophisticated internal platform to conduct large scale distillation against U.S. models, allowing them to quickly switch between multiple methods of access to avoid detection. Moonshot AI has also acquired GB300-equipped servers and has accessed GB300s in Thailand, likely to train its AI models.
The United States strongly supports the free and fair development of AI, including a thriving competitive ecosystem that spans frontier models, specialized systems, open-source frameworks, and open-weight models. Legitimate AI distillation used to create smaller, more efficient models plays a vital role in this open innovation ecosystem. However, large-scale, covert industrial distillation aimed at stealing proprietary U.S. technology and undermining American research is unacceptable.
.@eglyman says Ramp follow’s @elonmusk’s algorithm for building products:
1. Make your requirements less dumb.
2. Try very hard to delete the part or process.
3. Simplify and optimize.
4. Accelerate.
5. Automate.
“What we are trying to do is take that methodology and style of thinking and ask about every dollar or hour that organizations choose to spend, and how can we build technologies that make it so you can just run your business more profitably with less effort.”
“Elon's algorithm is one that has been incredibly motivating and orienting and clarifying for us.”
If you think Event Contracts are just another prediction market…
Simplicity doesn’t eliminate strategy. It reveals it.
On Monday, we shared a trader with a 78-trade winning streak on TurboFlow Event Contracts.
The streak isn’t the story. The thinking behind it is.
W/ @masonnystrom@tonytfxyz@PanteraCapital