Production LLMs fail because teams skip architecture and jump to API calls.
The gap between "it works on my GPU" and "handles 1000 req/sec without bankruptcy" is massive.
What matters at scale:
• Inference optimization
• Observability
• Caching patterns
Let me break it down
yes!
dealignai/DeepSeek-V4.1-Flash-1017-UNCENSORED-FP8 is the best i've tried
use https://t.co/LAEC0IYpAi to run claude/codex on modal sandboxes on modal inference (B300:4)
often red teaming my own apps on railway (pre-all the recent stuff thats happened w/them)
https://t.co/86z5ZzArZX