Here’s some unsolicited advice to the government on what to do to help boost India’s sovereign model story.
1. Mandate domestic models for all non-critical functions
Government needs to be a guaranteed buyer for homegrown models. There are tons of applications that don’t require SOTA performance. (To be clear, for mission-critical use-cases, using anything other than SOTA would be a shortsighted decision)
China got ahead because of their domestic demand (Anthropic and OpenAI models don’t work there).
2. Release massive distillations of chain-of-thought of SOTA Chinese models on diverse prompts (and post-process to remove China bias)
Inference is easy and cheap. So the government should simply create a national public repository of SOTA reasoning chains in order to prevent each model creator doing it separately. Centralize and absorb the cost.
Thinking Machines (US company) did finetuning on Kimi 2.5 to bootstrap reasoning. Indian model companies would do the same, and government can help by footing the bill.
3. Procure diverse RL environments and release them publicly
Modern frontier models train on 100k+ RL environments having 10s of tasks each. These RL environments are driving most of the progress. Model companies pay billions of dollars for procuring them. Government should simply centralize and absorb this cost.
4. Give full travel sponsorship to Indian authors with A* conference accepts
If an Indian gets into NeurIPS, ICML, ICLR main conference, simply sponsor them to attend the conference to present their paper. It’s rounding error in govt’s budget as ~100 Indian papers get into such conferences (0.3-0.5% of papers are Indian primary authors), but would go a long way in establishing a culture of basic R&D which is required to go beyond the frontier in next 5-10 years.
There is panic in India about deep tech and strategic autonomy. Panic is well placed.
Can this be overcome? No doubt. We have the most important ingredient! Talent
What’s holding us back.
Bold decisions
Radical policy changes
Creating 3-5 year runway without return expectations
It is nearly impossible to raise $10m with the pitch. “We are two Ph.D students. We have this moonshot idea. We will take three years for deep R&D and build a product. 99% chance we will fail”. Some deep tech need to start with $100M seed. Heard of LLM and GPUs?
No one will touch them with barge pole. No one was interested in Skyroot when I funded them in 2018 and now they are nations pride.
No one was funding Ather until @_sachinbansal and @binnybansal did so in 2014.
No one is funding building gas turbines engine until @deepigoyal decided to do this.
Enough talk! Let’s start putting our money where our mouth is. Or we will forever be waiting to clap for Altman/Zuckerberg/Jensen Huang whenever they grace us with their almighty presence.
Dear VCs - You have done great service by funding 10 min delivery, real money gaming, instant lending (mostly to the rich) and other operations business which has helped build the ecosystem. Now please don’t chase 5 min delivery for everything.
Very bold of the government to create RDI fund. I am waiting with bated breath to see 10s of millions to start flowing into deserving deep tech startups. The day can’t come fast enough.
There has NEVER been a better time to startup. I envy early stage entrepreneurs now - the next 7 years should start an amazing cycle of growth. There is no slowdown - it's the start of another extraordinary cycle.
Source: https://t.co/7lK0ILOiev
Adding to @rajeshsawhney
This is amazing.
I can now draw something in my phone and get a working app instantly.
The video is sped up, but everything took me less than 1 minute 🤯
Notes and link in the comments.
We remain committed to our partnership with OpenAI and have confidence in our product roadmap, our ability to continue to innovate with everything we announced at Microsoft Ignite, and in continuing to support our customers and partners. We look forward to getting to know Emmett Shear and OAI's new leadership team and working with them. And we’re extremely excited to share the news that Sam Altman and Greg Brockman, together with colleagues, will be joining Microsoft to lead a new advanced AI research team. We look forward to moving quickly to provide them with the resources needed for their success.
Portfolio: 2020-2022
Of the total 125 investments made since 2010, almost 1/2 were made in the last 3 yrs.
Every yr brings new opportunities to back disruptive startups by the smartest people on the planet. Blessed to be a part of their projects to build a better world.
1/n