One LLM request became 6.4× cheaper without changing the model.
The real issue was prompt structure.
Dynamic context was mixed into the reusable prefix, silently destroying cache efficiency.
After restructuring:
22% cache hits → 90%+
Stable instructions first.
Dynamic context last.
Prompt architecture directly affects inference cost.