I have a theory...
PSA for everyone who got hit with a full week's claude usage from one prompt this past week
Claude Code has an agentic loop structure where token consumption is O(N²), not O(N). If call #1 sends 10K tokens, call #60 sends 500K. This is especially relevant if claude is having outages. https://t.co/bkX4R2Xu4D
When Opus (or equivalent) has an outage, and your prompt hits just at the right time, during that degraded service API calls will fail but still consume your input tokens. Claude will retry re-sending the context the entire time. That's why O(N²) is very relevant here, we're talking about killing your week's usage with one prompt.
We see a lot of different responses because the outage wouldn't necessarily affect everyone equally. If you hit the bug at the wrong time, you are screwed.
@claudeai please create a circuit breaker and alert users when API is failing. Silent failures are killing progress.
PSA for everyone who got hit with a full week's claude usage from one prompt this past week
Claude Code has an agentic loop structure where token consumption is O(N²), not O(N). If call #1 sends 10K tokens, call #60 sends 500K. This is especially relevant if claude is having outages. https://t.co/HfE4ssbbzA
When Opus (or equivalent) has an outage, and your prompt hits just at the right time, during that degraded service API calls will fail but still consume your input tokens. Claude will retry re-sending the context the entire time. That's why O(N²) is very relevant here, we're talking about killing your week's usage with one prompt.
We see a lot of different responses because the outage wouldn't necessarily affect everyone equally. If you hit the bug at the wrong time, you are screwed.
@claudeai please create a circuit breaker and alert users when API is failing. Silent failures are killing progress.
@nervoir@stuxfdev@verialabs@BSidesSF I have the worst answer for you, because it really depends. MoE applies reasoning way beyond my model, but the model that I have has deep extensive security knowledge. If you wrap claude around it, it's pretty incredible.