🚨Astra leaks are getting ridiculous
Quick correction first: Doug is apparently the codename for Astra’s pre train not a new one.
Latest claims:
• Astra will be around 10T parameters
• Built from the new Doug pre train
• Supposedly it crushes Fable across benchmarks👀
• Apparently a huge jump in writing quality from it too
• Still expected this month even with the setback
• And there’s an even bigger pre train leaked for the end of the year
I’m expecting this to be the first model that genuinely moves past Fable/Mythos and is a definitive leader across most benchmarks.
https://t.co/S84mEjjWJ5
ok, apologies in advance because i do so hate to provide actual signal.
openai basically sucked at pre-training for a while and crushed at post. their answer to this was spud. spud was the large new pre-train for the new family of models: sol, terra, and luna.
the upcoming model, ‘astra’, has an even bigger pre-train, codenamed ‘doug’. (this was a running joke, as doug was the name for the world’s largest spud, although that’s not technically accurate — look it up).
still with me?
ok good, so sol is a 5t model based on the spud pre-train. astra is a 10t model based on the doug pre-train. this is the model i’ve discussed that openai researchers have been considerably more excited for. not only does it crush fable on all benchmarks, it’s genuinely delightful to talk to, high eq (4.5 vibes), and this is the first model that is genuinely incredible at writing, with output indistinguishable from that of great human writers.
ok im tired and i have a lot of ssi news coming but ill keep you updated on this. everything here is well sourced and im highly confident. very well sourced.