Some news: I’m joining OpenAI to lead product management for Core Products!
I have a lot of respect for OpenAI for showing the world that scaling works, for bringing AI to over a billion people, and for believing great products are core to the mission.
I’m excited to work with @thsottiaux, an incredible PM team, and everyone across OpenAI. Together, we’ll build agents that have your back and your team’s, and keep you in control, so you get more time for the people and work you love.
Lots to learn, and lots to build. Please keep your feedback coming!
We’re working to build the largest collection of private and public practitioner evals.
Today, 31 new partners join the Specialized Intelligence Index, building on the expertise of our founding partners.
Compare leading models on real work and see where training could pay off.
https://t.co/Ofq6wHNe8w
One of the best models for knowledge work...available on serverless, no dedicated capacity needed.
A first of its kind in many ways, try it out for yourself:
https://t.co/hIqMQiZy4N
Today, our training partner, @FireworksAI_HQ , is serving Ultramarine 1 Flash on serverless. Serverless is on a shared pool and is a good choice if you want to pay-by-token and optimize for speed.
For higher precision options and more control, dedicated deployments will be available on Fireworks shortly, in addition to the ability to fine-tune Ultramarine on Fireworks’ Training API.
https://t.co/F51jSCltSg
@paperinstr’s Ultramarine 1 Flash is now on Fireworks.
It outscored Fable 5 on Paper Instruments’ internal knowledge-work benchmark (59.3 vs 57.8) at ~98% lower inference cost per task.
Start building through our API, no dedicated GPUs needed: https://t.co/tf7CxB7Lto
Couldn't agree more. That's why Fireworks is putting together the largest collection of private benchmarks (60+ and counting) provided by leading partners in every domain
https://t.co/OGTCuKPtjx
Benchmaxxing might be dead
for years ai labs could train their models on the test questions and top the leaderboard. huge score, kinda mid when you actually use it
now the biggest ai scoreboard keeps 60% of its questions secret. you can't cram for a test you've never seen
so the rankings should finally match how good these models are for you in real life
this is the time when we find out who actually built the smartest AI