GPT-5 rollout updates:
*We are going to double GPT-5 rate limits for ChatGPT Plus users as we finish rollout.
*We will let Plus users choose to continue to use 4o. We will watch usage as we think about how long to offer legacy models for.
*GPT-5 will seem smarter starting today. Yesterday, the autoswitcher broke and was out of commission for a chunk of the day, and the result was GPT-5 seemed way dumber. Also, we are making some interventions to how the decision boundary works that should help you get the right model more often.
*We will make it more transparent about which model is answering a given query.
*We will change the UI to make it easier to manually trigger thinking.
*Rolling out to everyone is taking a bit longer. It’s a massive change at big scale. For example, our API traffic has about doubled over the past 24 hours…
We will continue to work to get things stable and will keep listening to feedback. As we mentioned, we expected some bumpiness as we roll out so many things at once. But it was a little more bumpy than we hoped for!
@jasonlk@amasad@OGJoshHsu A key technique is to start a new agent chat regularly eg for new features. LLMs suffer from context window sizes so the longer the chat, the worse they perform. Wish I had seen your post earlier to save the headache.
@amasad@jasonlk@MatthewBerman@OGJoshHsu@mattyp@Replit The key will be using different models for different tasks. I use API keys and switch models in the environment. Eg I would start a new chat with 4o and brainstorm features, do QA etc. then switch models back to Claude for the coding tasks @jasonlk
@amasad@jasonlk@OGJoshHsu Have the team use microVMs and implement a snapshot feature with it. It’s more than dev/prod, you need rolling dbs. Users will pay more for that.
@amasad@jasonlk@OGJoshHsu It will be trickier than that to implement. In the short term there will be some improvements with RAG but the main issue will be context window size. Have the team summarize the user instruction then add to system prompt
💡 Optimized AI Conference brings you speaker, Learie Hercules, from Heft IQ joining us this April.
Learie is a seasoned tech leader & entrepreneur with over 20+ years of experience in platform architecture, mobile applications, and LLMs. Learie has also founded Heft IQ, an AI-Driven Advanced Analytics Program positioned as an Operating System (OS) to aid the Supply Chain & Logistics industry with real-time data analytics & AI led insights.
We’re excited for hear and learn from Learie regarding: AI For Executives - What You Need To Know
To Learn More about OAI 2025: https://t.co/VPj3yIKDEx
#AI #OAI #OAI25 #supplychain