We will use Grok 3.5 (maybe we should call it 4), which has advanced reasoning, to rewrite the entire corpus of human knowledge, adding missing information and deleting errors.
Then retrain on that.
Far too much garbage in any foundation model trained on uncorrected data.
We’ve spent the last few days doing a deep dive on what went wrong with last week’s GPT-4o update in ChatGPT.
Expanding on what we missed with sycophancy and the changes we’re going to make in the future:
https://t.co/LX0fSIe72s