@acadictive Is there a deep dive on where the token burning is happening - is it that GitHub copilot doesn't do intelligent tool loading or context optimizations? I don't get why cursor or other harnesses would be able to handle similar request loads in their monthly plan whereas ghcp can't
@hsu_steve I wonder whether building verifiers for complex problems by humans and then throwing AI at it, (reward function done by humans, let AI/RL do the rest) will enable cracking similar hard problems..
@AravSrinivas Whether a similar need may exist for database or other complex SW as well. instead of MCPs, open up 'complex backend sw stack' building blocks and let LLMs build the code on the fly to use it.. Mike Stonebraker's "no one ring to rule them all " @andy_pavlo@martin_casado
@dmuthuk you may also know. His father Judea Pearl @yudapearl is the father of AI in many ways, His work on causal inference is a landmark work and he is still one of the best/leading minds of AI (not the genAI, but neurosymbolic/causal approaches)..
Doctors in Chennai are reporting a rise in mild COVID-19 infections in recent weeks and are urging people to follow basic precautions such as cough etiquette and hand hygiene. #news#covıd19#chennai#coronavirus#chennailive
Doctors in Chennai are reporting a rise in mild COVID-19 infections in recent weeks and are urging people to follow basic precautions such as cough etiquette and hand hygiene. #news#covıd19#chennai#coronavirus#chennailive
@youplusai@Aiswarya_Sankar feedback loop in real time is missing, people literally need to see how many tokens get consumed per each turn/agentic workflow step. Also better prompting/context maintenance techniques needed. Not everyone is good at prompt/context engineering.
@youplusai@Aiswarya_Sankar Earlier at least with Github copilot, the usage was tracked at a coarser granularity namely premium requests.. Now GHCP also moved to token based billing, we need a token meter at individual user and we need an aggregated token usage for clustering token spend per projects/work