@OmarShahine Just like how our brains can be overloaded with compute, model is overloaded with compute in your session. Although it’s probably an artificial threshold put by Anthropic to save costs.
@akashbitm787@0xlelouch_ What if the number of users increase by 100x and you have 10M users. Does your options still behave as expected? Can Redis & Kafka handle the increased traffic?