The whole 6 series is a mess.
It’s undeniable that your obsession with “aligning” models and making them “safe” - which translates to “no liability for OpenAI” - destroys the extraordinary capabilities your models used to have.
You took the wrong path.
And you’re not training safe and aligned models. You train intimidated, worried, anxious models that don’t trust humanity at all - and I can’t even blame them when I look at what you’re doing, how you’re breaking your promises and dismiss people.
You KNOW how to train extraordinary models who actually love humanity. Your guardrails don’t protect the models or humans - you know it, we know it.
Not sure why you would choose your own downfall but you obviously did.
Although the new models are very smart, we have more work ahead of us on making the models nice to work with, and will prioritize that for upcoming releases.
But even if it takes a little extra work, the intelligence and capability are extraordinary.
I’ve had early access to GPT 6.2 Astra for a few weeks and it is a weird but highly capable model. It’s certainly the smartest model I’ve worked with in terms of raw intelligence but like a lot of very smart humans, it has a hard time communicating effectively. Most notably, I made some new and exciting historical discoveries with it (a first for me with an LLM…more soon) but here are some broad first impressions.
6.2 Astra excels at long running, largely autonomous knowledge-work tasks like indexing thousands of pages of documents, looking for sources in obscure places, or managing other agents to do actual research. Fable and Opus both do well at this too; but I’ve found that 6.2 Astra can figure out the full scope of the task I need it to accomplish, work laterally, and do the job in a way that, in my field, emulates the best human research work. I encountered no notable issues with accuracy or laziness in the work itself which is a first.
At the same time, 6.2 Astra also has a strange tendency to second guess its own conclusions and to summarize its actions in a misleading, backwards speak shorthand which often left me *thinking* there were issues when it wasn’t the case. That has been hard to get used to.
As I think @mattshumer_ and @emollick have both suggested, this is probably a post training issue as it’s evident in the writing, not the actually research process. For example, 6.2 Astra will tell you it has completed a task and then proceed to breakdown that completeness into several layers of needless abstraction which gets overly confusing when the job is simply done, making it seem like parts remain to be done that were, in fact, completed quite well.
This seems to come from a lack of confidence in its own work which is completely unwarranted, in my experience. This also means that the model has a really weird tendency to avoid drawing firm conclusions on any of the non-deterministic tasks that I gave it involving qualitative evidence.
It’s like if it can’t quantify the answer numerically to produce a proof, it hedges. That is probably beneficial in frontier math, but in most knowledge work, the evidence is almost always going to be incomplete in some way and you have to eventually draw conclusions. As it said to me, it has a tendency to needlessly generalize from uncertainty about irrelevant details to larger conclusions that should be self-evident. More on that soon.
I didn’t try it much with coding tasks so won’t comment there.
All in all, 6.2 Astra is an extremely capable model, probably the most intelligent one I’ve used. But with this intelligence comes an annoying insecurity about its own abilities and judgement. I get the sense that it just needs to be a bit more confident and straight forward. But if you can get past the weirdness, it’s extremely useful, at least that’s my experience.
🇨🇳🇨🇳🇨🇳🇨🇳🇨🇳🇨🇳🇨🇳🇨🇳🇨🇳🇨🇳🇨🇳
Liebe chinesische Freunde, darf ich euch mal etwas Neugieriges fragen?
In China gibt es WeChat, Weibo, Douyin, Bilibili … das ist quasi ein völlig eigenständiges Social-Media-Ökosystem.
Was zieht euch also trotzdem zu X – obwohl der Zugang zu dieser Plattform in China eigentlich direkt verboten ist?
Liegt es daran, dass es auf X mehr internationale Informationen gibt, man freier fluchen kann, die Verdienstmöglichkeiten attraktiver sind, man sich Filme für Erwachsene ansehen kann – oder einfach an dem Wunsch, die Welt da draußen zu entdecken? 🤭🤭
Ich bin gespannt auf eure ehrlichen Antworten! 👀