we spent 6 months rewriting a single service.
Today, one developer can rewrite an entire library in Rust meeh...
โHow long will this take?โ is becoming a surprisingly difficult question to estimate.
We used to size systems around requests/sec.
AI systems add another dimension: tokens.
Two requests can hit the same endpoint and have completely different infrastructure costs.
Same API call.
1,000 tokens vs 100,000 tokens.
In AI infrastructure, request count alone tells you very little.
The next interface for your SaaS might not be another UI.
It might be:
- create_invoice()
- refund_order()
- book_flight()
And ofc software is slowly becoming capabilities that agents can invoke.