Gave my AI product to 5 users for testing.
Got some great feedback:
->Reduce latency.
->Make the workflow easier across platforms
->Make results feel useful, not generic.
-> Create user engagement by showing results, so they feel the value and want to come back.
#AI#Product
@pranay5255 Can summarisation of the context be done and then store the kv cache for these summaries. That will reduce the kv cache and hence the memory for kv cache also be used efficiently and more conversations can happen within the kv cache limit.
@pranay5255 I don't know yet how this much cache can be handled and how it is handled currently by the closed models. Probably they have the biggest machines or clusters but yet how is it possible to handle for this much users. There will be some tradeoffs ofcourse eg bw memory and accuracy
Asking questions to self as a chain of thought reasoning makes us think deeper and if you think knowledge gap exists, study parallely and write what you read and understood. Your brain uses lot of senory systems when you write. Long term you remember things better.
#AI#thinking
Thinking...
Read as much as you implement. Don't implement all the time. Don't read all the time. Balance is mandatory in the era of vibe coding. What's the point of doing either. Theory makes the base strong and implementation makes the building stronger.
Being a fool helps you in numerous ways.
It helps you to know what you never expected to know and what you thought you knew but didn't.
So, be a proud fool.
Also, have the confidence to portray your wit and build on the top of it.
Don’t let AI-generated code overwhelm you.
Gain engineering experience by understanding the core concepts being used, the workflows, and how different services interact.
Use AI to boost your engineering experience. That should be the goal.
#Code#VibeCoding#AI#ProblemSolving
@SushrutKM Why not optimize every day for a balance of learning and having fun. You can't do both on the same day but you can have a mix of both on a differing extent. Having fun can have different meaning for each person like practicing hobby, spending time with friends, work from cafe.
I am learning to focus on one thing at a time. I decide a task and dedicate 1 hour to it. If distracted in between, I take break but then I come back to the task. All this time I have the task in mind. This has helped me focus, reduce stress, feel content and sleep better.
Queuing is great esp for Agentic systems as requests take good time and system resources. If multiple users ping, then queueing:
1. Process requests on FIFO basis
2. Keeps user informed about their request
3. Prevents cpu overload by controlling number of concurrent workers
I learnt to use Queueing today. To make my AI system stable and predictable for large user base. It helped to manage large number of requests. Instead I put the user request in queue and stream users back the progress and return response when ready.
#AI#AgenticAI#Redis#GenAI