I keep telling @ShekharGupta to narrate the story of Punjab because him and @tavleen_singh saw all of it first hand. Gen Z does not know the horror show that was Punjab. Read articles and books from that time. It is scary as hell.
Two Hong Kong students just made Karpathy's loop 5x better - dropped 18-page PDF
The twist: the loop got 5x better the moment you put another loop on top of it
here's the whole method, step by step:
step 1 → Karpathy's loop gets stuck - the LLM keeps reproposing the same changes, falling back to its priors
step 2 → so they add an outer loop that reads the inner loop's code and finds where it's stuck
step 3 → the outer loop writes new search logic as Python and injects it live - 5x better, same model
how to steal this for your agents:
step 4 → write a second agent whose only job is to read the first one's logs and find where it's stuck
step 5 → let it rewrite the rules - workflow, skill, prompt - not just retry the task
step 6 → auto-revert every rewrite on failure, so a bad change never breaks your pipeline
the result: 5x better than Karpathy's loop alone - same LLM, no smarter model, it's the architecture
this 18-page PDF is what comes after the Karpathy loop
read it now - the full build workflow is in the article below ↓
Indian consumption per person beyond subsistence is an order of magnitude lower than America, even adjusted for cost of living. Roughly a tenth. Even a doubling will take it to Chinese levels today relative to America, which US already considers a mistake.
Christopher Landau’s statement is a few months old but was publicly said on Indian soil. It was justified in the name of serving one’s own people. Corollary is India’s rise will be resisted by US too, not just China. Not in the future. But right now.
The trade and tariff tensions, the policy towards Pakistan and Bangladesh, the G2 rhetoric towards China, the very recent dropping of Indo from Indo Pacific, the hard line on any US Big Tech restrictions, delaying of jet engine sales etc etc.
Remember in the US policy here - unlike in the Biden admin rhetoric, although the substance was similar - there is no real difference if India is a democracy or not, uses aggressive industrial policy or not. These things are certainly not irrelevant but their salience is overrated for geopolitics.
Given that both China and India have more than four times America’s population - and India will be at that relative level for decades - the point is clear: America doesn’t want Indians to be prosperous.
When people say who they are, believe them.
#WATCH | Delhi: On letter of over 100 prominent citizens from India & Pakistan to both PMs for 'restoring peace, normalcy, dialogue', Congress MP Manish Tewari says, "It's extremely unfortunate that some people have forgotten the Baisaran massacre. It has been only 1 year 2 months and 8 days since innocent tourists where mercilessly butchered in front of their families in the name of their faith. Pakistan's perfidy, its export of terror against India, its desire for retribution to bleed India with a thousand cuts now goes back almost 5 decades when we dismembered Pakistan and created a new country called Bangladesh. So, over these 5 decades every effort that India made to reach out to Pakistan had been followed by a terror attack sponsored by Pakistan. I am really surprised as to how these very eminent people can forget this history. What do you want to talk to Pakistan about? What is it that India wants from Pakistan? The only thing India wants from Pakistan is that there should be no export of terror. So, under those circumstances this misty-eyed romanticism about wanting to normalise relaationships with a country which has been hell-bent upon creating a mayhem and terror in India is completely inexplicable, completely beyond comprehension. God alone knows where this pressure is coming from, which is that invisible hand which seems to be pressurising people in India to try and normalise..."
@JhaSanjay Perfectly sums up how you had leaders like Rajiv Gandhi and DR. MMS and everyone else in their government.
Smart educated leaders with subpar politicians...
Perfectly sums up how you had leaders like Rajiv Gandhi and DR. MMS and everyone else in their government.
Smart educated leaders with subpar politicians....
Tried and tested model that failed...
Everyone is outraging after The Economist article on India’s pathetic government websites.
The elephant in the room: We need a smart, educated, English speaking, well read, tech savvy politician who has his heart in the right place. A visionary, a dreamer, a doer. A secular democrat. A sense of humour too.
What we have is substandard, subpar frauds. India has moved beyond these old fogey wheeler dealer criminal variety of crooks masquerading as our hope.
Stop learning LLM internals from random one-off tutorials.
LLM Internals is a step-by-step GitHub learning repo for understanding how large language models work under the hood.
It helps you build a cleaner mental model by organizing blogs and videos from tokenization to attention math, Transformer components, training concepts, and inference optimization.
Key features:
• Fundamentals first – starts with LLMs, RAG, MCP, agents, fine-tuning, quantization, tokenization, and BPE
• Attention math – walks through Q/K/V, √dₖ scaling, causal masking, RoPE, and grouped-query attention
• Transformer components – covers the architecture, feed-forward networks, normalization, MoE, and LoRA
• Training concepts – includes backpropagation, cross-entropy loss, RLHF, and reasoning models
• Inference optimization – covers KV cache, paged attention, Flash Attention, speculative decoding, continuous batching, and prompt caching
It’s open-source (Apache License 2.0).
Link in the reply 👇
You believe you will change something fundamental in the system and you enter politics.
Then you realise there is nothing much to be done and whatever big ideas you have were already tried in 1960s and 1980s.
You wanna make some new department, it exits too.
You want some legendary scheme, there are no funds without a new tax.
Then you just chill down and start reelbazi.
Sometimes when I'm on a call I wanna explain stuff using diagrams. Its too much of a pain to pull up excalidraw and share screen.
So, I'm making this browser plugin for myself.
Draw, Edit, Move, Scale objects on screen while you talk.
Screwdrivergiri
A lot of folks defend this trend. But they find it difficult to describe it. At it’s core, when a foreign OEM signs up with an Indian co to provide it with all the core (strictly proprietary) elements & allows it to assemble in India with minor or no value add, we’re in the zone. In effect, if the OEM were to turn off the tap on component supply, it’s “The End”. Now, if this denial were to only impact an Indian co, we could justify it - risks of doing business, caveat emptor etc. But it will hurt the nation finally and then who takes the blame ? Now, if all works well & there’s no likelihood of denial, we’ve got a product, created some (very little at times) employment and a bunch of manufacturers who will never be allowed to violate terms and build their own product. Of course, if Indians are Chinese, we’d have violated and already done so since the same screwdrivergiri has been going on for decades. Bottom line, we are best served by sanctions and embargoes. It’s in our DNA.
Several years ago, a foreign weapon OEM had extended us an offer - we’ll give u pressure parts, trigger group & receiver. U guys can easily do the assembly, sling swivels, grips, sling and carry case. Pay us for the components & an upfront data package fee for only 1
Weapon (an outdated one). If U’re smart in invoicing, Indian content can be 50%. Forget the core tech. U just need the margins. Saying NO was the best decision of our journey. Today, we compete globally with the same co but respect them for being upfront with us.
POKER-X, an innovation by Prakash Urs. With Poker-X, you can easily pour milk or oil into a container.
It eliminates the need to cut the corners of milk/oil packets, keeping the sachet more intact and making recycling easier.
Better recycling means less plastic ends up in the environment, where it can eventually break down into microplastics.
Zen Technologies's @ashokatluri
reiterates these points in almost every concall. While I'm not sure to what extent some of their latest products like guns are IDDM, imo Zen is one of the few firms which tries to have as much IP as possible through R&D / acquisition. @vectortechnics is probably the best example.