LiteLLM CVE-2026-35029 landed last week. Read-only viewer -> config-modifier. Patched fast.
But it's a good moment to ask: does your team actually have the hours to keep an LLM gateway patched?
Wrote up the 5 real alternatives, honest about when to stay: https://t.co/Sqz6WaFTZ6
#FinOps for LLMs
AI FinOps
When your LLM spend changes each month, one of 3 things may have caused it,
1. usage changed
2. pricing changed
3. Architecture changed
Usually the dashboard may show "the spend is down by x%", without actually telling you what has caused it.
@smakosh Interesting! At leanroute, I already have kill switch and rate limits in place. Fraudulent transactions are hard to detect on the app side without seeing a pattern.
@launch_llama Leanroute - One Gateway for models and tools. Market is flooded with LLM Gateways, I wanted to build an AI Gateway which serves LLM and tools traffic, saves you on infra and cuts your LLM bill.
Producthunt launched today: https://t.co/o05DkSRqVM
Product: https://t.co/Akn4002PTv
@systemdesignone For those who always vibe coded, probably it's dead for them π
What I meant is, the traditional database with normalized schemas ain't preferred if you are doing vibe coding. Database concept isn't dead but it's being liberated from human syntax.
@thdxr I believe most of the AI providers will soon follow peak usage pricing model.
if you are using our LLM gateway - https://t.co/GqOJZZT0uE, just turn the arbitrage on and do more with less $
@mehulmpt Expected! Peak usage pricing, I am afraid most of the AI providers will adopt this strategy.
If you are using https://t.co/GqOJZZT0uE, you can just turn the arbitrage on and do more with less spend -
@cheatyyyy Its going to be interesting!
If you are using https://t.co/Akn4002PTv, just turn the switch on, choose the providers to route to and let the gateway save you some money -
@hqmank I believe they will introduce a separate peak hour pricing. I built https://t.co/Akn4002PTv, I am watching this closely as it affects our customers! It's going to be interesting for sure
Why should AI apps need:
β’ An LLM Gateway
β’ An MCP Proxy
We think they shouldn't.
The next generation of AI Gateways will unify both models and tools behind a single endpoint.
That's the idea behind https://t.co/Akn4002PTv,
https://t.co/hn3zFAvvtG