@adamdotdev Think about debugging distributed systems, and how it requires the spidey sense because logs and "context" is usually not adequate, and how the latency of an AI agent is prohibitively high.
There is your happy place from AI.
@hobdaydesign@joulee You mean 10 years ago?
No, "lots of websites" were absolutely not already like this before AI came along. Actually, most of them are still not like that.
@ser_king59707@burkov Reinjecting would invalidate the cache.
If A is the system prompt + agent MD,
the cache has: A B C
you reinject and send: A B A C A D
No more caching.
@gvanrossum You got it 100% correctly @gvanrossum
Appalled to see others *still* attempting to make them sound more than what you described.
I understand that they need to push slop marketing elsewhere but even when you’re responding to BDFL?somewhat shameful.
@NathanpmYoung Self-interest.
Local folks recognize me when we do business again, and I get favors/discounts.
Local folks have a limited audience - incentivized to make you happy. Global folks don't have this.
Locals folks being happy and healthy helps it make a safe neighborhood.