🚨🌕 Gnabry on Ballon d’Or: “I hope it’s Harry Kane”.
“It would be lovely if he were to win it. You always wish that for a teammate. He had an incredible year. So for me of course he has done enough to win it”.
🚀 Introducing DeepInfer, our in-house inference framework, now fully open source!
Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more affordable.
🔗 https://t.co/JGAik1kgk0
1/4
Day 11/
We've landed a series of changes and more compute to very significantly decrease the occurrence of the disruptive "Selected model is at capacity. Please try a different model". When it does happen, it should also eventually just continue by itself and not just block on it.
Let us know if you still see it out there in the wild and we'll take a look.