@edzitron i think you need to read that again .. gpt-6 luna/sol are 50 % cheaper compared to 5.6 promotional pricing so even cheaper compared to 5.6 regular pricing no?
@Fritz_Espenlaub i don't think they did arrive at the same solution. this is from openai's blog and even the levent guy from anthropic said so in his post an hour ago.
nah i think you understand it correctly.
i think the point is they might have trained on their chat data like they do on one billion peoples chat data but they (humans/agents) were not looking at their chats specifically.
their research chief phrased it here: https://t.co/U6eTfxfTsm
Two things to distinguish:
Did any human or agent look at user data as part of the Navier Stokes effort? No.
Do we use user feedback and de-identified data to improve ChatGPT and Codex in a holistic way? Yes. And so does every LLM company.
this isn't them admitting anything. it's them refusing to claim something nobody can claim. you can't prove a training set doesn't contain a thing.
the funny part is that the de-identification is what makes it unprovable. they strip the account link on the way in, so there's nothing left to check against later.
consumer chatgpt trains on your chats unless you turn it off. team, enterprise and the api don't.
see here: https://t.co/jQPVyhRRPY
(they linked to this doc in the navier stokes blog post)
yeah i think thats true. they could have trained on their chats if they were using personal chatgpt/codex accounts and did not deactivate the training setting.
so maybe it's in the agents training data but basend on their statements i dont think their agents were able to see specific chats of theirs.
training default-on for personal accounts is standard industry practice and they (and the anthropic guy) both said that their approaches were different so maybe it doesn't even matter much in this case?
@mattparlmer well this only applies in a consumer chatgpt/codex subscription and if they left the "train on my data" settin on. idk, thats standard industry practice IMO.
also v transparent what happens in case you leave it on: https://t.co/uxcEx6Glhe
I would like to clarify a few things:
1) The screenshot is my reaching out to Levent to coordinate our releases. I hope it’s clear from the message that we came in with the best possible intentions.
2) I never ever asked for Levent to be removed from authorship of his own work (as indicated by my text). I was surprised to learn during the call with Tristan that they had only solved Euler and not Navier-Stokes; after learning this we brainstormed possible paths forward. One option we discussed was that Tristan could be the lead author on a rewrite of OpenAI’s Navier-Stokes proof. It is in that context that I said “it would be simpler if Levent was not an Anthropic employee” because I felt it would be inappropriate for an Anthropic employee to author OpenAI’s work. Importantly it was admitted that internal Anthropic models had been used in their proof of Euler blowup; I therefore felt I could not consider Levent to be an independent academic. Another option I wanted to propose (but got cut short) is to offer access to our internal model so that they could try to finish their proof and bridge the gap between Euler and NS. Again I did not know how to navigate giving access to internal OpenAI IP to an Anthropic employee.
3) To reiterate it plainly: as my text clearly indicates, and as I said during our call, OpenAI's intention was to do everything possible to celebrate their mathematical achievements and the heroic efforts that they made on Euler. In the call I was immediately met with a litany of slander, including direct threats that if we were to announce Navier-Stokes he would immediately go to the press with a barrage of unfounded accusations. I refuted all these accusations but he replied “there is nothing you can do, I simply do not trust you”. I was confused why one would turn an incredible source for celebration (of their achievements!) into such bickering, which is when I said that I did not understand why one would risk their career [over unfounded accusations]. Genuinely, at that moment, I was trying to care for him and do a last ditch attempt to get a chance to give them all the credits that they deserve. I deeply apologize for this extremely poor choice of words, it is the opposite of what I was trying to convey. (I should say that I retracted them on the spot by the way.)
4) Overall, on a personal level, it was incredibly difficult to have these conversations. Levent refused to attend any of the meetings despite my repeated asking. As Sholto Douglas said, there will need to be coordination between Anthropic and OpenAI in the future; I felt I was doing a proxy negotiation with Anthropic while the Anthropic employee refused to directly participate.