Mohi

Dimwitted..

Tweets are stolen, retweets are original..!!

[Mohi @mohiuddin_]

That's me!! I want to be happy not successful.
If success comes in the way, will no doubt embrace that. But, happiness is the priority.
#thought

[Mohi @mohiuddin_]

Government of India: Please Talk to Mr. Sonam Wangchuk - Sign the Petition! https://t.co/WKLQh9fs1O via @ChangeOrg_India

[Mohi @mohiuddin_]

Uttarakhand’s Vanishing Mountain Foods: How Climate Change and Cash Crops Threaten a Resilient Local Food System https://t.co/cjSvjyV1re

[Joy Bhattacharjya @joybhattacharj]

Respected Sir,
I have no part to play in this debate, but the name Uttar Pradesh did not exist before 1950. I have a transcript of the original Bengal Sati regulation act of 1829, and it reads nothing like this.
Greats like Raja Ram Mohun Roy & Sahajanand Swami of Gujarat campaigned against an evil which claimed an estimated 800 plus lives in and around Calcutta alone in the 1800s including Ram Mohun Roy's sister-in-law.

[GDP @bookwormengr]

Writing this as an Indian who works on AI in leadership role for one the largest companies in the world (though strictly my personal opinion, but based on verifiable data).

You heard it first here:
—————————-
First some more shocks:
You heard DeepSeek.
Wait till you hear about Qwen (Alibaba), MiniMax, Kimi, DuoBao (ByteDance) all from China.
Within China, DeepSeek is not unique and their competition is close behind (not far behind).
IMHO, China has 10 labs comparable to OpenAI/Anthropic and another 50 tier 2 labs.
The world will discover them in coming weeks in awe and shock.

AI is not hard (I am not high)
————————————
Ignore Sam Altman.
Many teams that built foundation models are below 50 persons (e.g. Mixtral).
In AI, LLM science part is actually quite easy.
All these models are “Transformer Decoder only models”, an architecture that was invented in late 2017.
There are improvements since then (flash attention, ROPE, MOE, PPO/DPO/GRPO), but they are relatively minor, open source and easy to implement.

Since building foundation models is easy and Nvidia is there to help you (if not directly, then by sharing their software like “Megatron” that is assembly line to build AI models) there are so many foundation models built by Chinese labs as well as global labs.

It is machines that learn by themselves…if you give them data & compute. This is unlike writing operating system or database software. Also, everyone trains on same data: internet archives, books, github code for the first stage called “pre-training”.

What is part is hard then?
———————————-
It is the parallel & distributed computing to run AI training jobs across thousands of GPUs that is hard. DeepSeek did lot of innovation here to save on “flops” and network calls. They used an innovative architecture called Mixture of Experts and a new approach called GRPO. with verifiable rewards both of which are in open domain through 2024.

Also, there is lot of data curation needed particularly for “post training”
to teach model on proper style of answering (SFT/DPO) or to teach them learn to reason (GRPO with verifiable reward). STF/DPO is where “stealing” from existing models to save cost of manual labor may happen.

LLM building is nothing that Indian engineers living in India cannot pull off. Don’t worry about Indians who have left. There are plenty in the country as of today.

Then why India does not have foundation models?
———————
It is for the same reason India does not have Google or Facebook of its own.

You need to able to walk before you can run.

There is no protected market to practice your craft in early days. You will get replaced by American service providers as they are cheaper and better every single time. That is not the case with Chinese player. They have a protected market and leadership who treats this skillset as existential due to geopolitics.

So, even if Chinese models are not good in early days they will continue to get funding from their conglomerates as well as provincial governments. Darwinian competition ensures best rise to the top.

Recall DeepSeek took 2 years to get here without much revenue. They were funded by their parent. Also, most of their engineers are not PHDs.

There is nothing that engineers who built Ola/Swiggy/Flipkart cannot build. Remember these services are second to none when you compare them to their Bay Area counterparts. Also , don’t trivialize those services; there is brilliant engineering to make them work at the price points at which they work.

Indian DARPA with 3B USD in funding over 3 years
———————-
What we need is a mentality that treats this skillset as existential. We need a national fund that will fund such teams and the only expected output will be benchmark performance with benchmarks becoming harder every 6 months . No revenue needed to survive for first 3 years.

That money will be loose change for GOI and world’s richest men living in India.

@protosphinx @balajis @vikramchandra @naval

[Mohi @mohiuddin_]

@NiloparUddin I just completed your book "The Halfways". I am a Sylheti from Assam. I could relate to your book in many ways.

Kudos for an amazing book. Loved to see many Sylheti words in a novel for the first time. More of our folk need to write about our culture, our history.

[Mohi @mohiuddin_]

Iraq could force 9-year-old girls to be married and brave women are fighting back to stop this. The vote could happen soon, and they need the biggest outcry possible. #EndChildMarriage #GirlsNotBrides https://t.co/2dnRIeLRIJ

[Dr. Sabreena Ghaffar-Siddiqui @sabreenaGS]

You know what the colonisers didn’t count on?

Those of us born and raised in the West - in the mothership of the colony, turning on them.

They thought we’d be forever indebted to them for their benevolence in how they imprison us.

They thought they could colonise our minds like they colonised our lands.

They didn’t know we’d take their gab and garb and use them as tools to free the rest.

They didn’t know their empire would eventually end by implosion.

[Mohi @mohiuddin_]

@flysrilankan Awesome ad. It took a Srilankan Airlines brand to reincarnate the Ramayana.

Kudos.

[Mohi @mohiuddin_]

@simply_am_ Happy Birthday!! 🎉🎉🎉

[Mohi @mohiuddin_]

@GoogleIndia please check.. Kenya playing against Gambia and has a win probability percentage of 0.1% . Why?

[Mohi @mohiuddin_]

@simply_am_ Congratulations Doc!! 🎉🎉🎉

[Saurabh @sauravyadav1133]

अच्छा सिनेमा देखने की चाहत रखने वालों के लिए...बताइए इनमें से कौन सी फिल्म देखी है और कौन सी देखनी है?

[Muhammad Smiry 🇵🇸 @MuhammadSmiry]

They won’t defeat the people of Gaza ❤️

[Adam @AdameMedia]

They say we Arabs are "savages".

Did we kill 6 Million Jews?
Did we drop the Atomic Bombs?
Did we melt the skin off Vietnamese children?
Did we kill 2.4 Million Iraqis?
Did we create Al Qaeda?
Did we imprison a million children without food, water, and medicine?

And you call us the savages?

[Dylan Jardon 🌈 @DylanJardon]

"Perfection is impossible.

In the 1,526 singles matches I played in my career, I won almost 80% of those matches.

But what percentage of points did I win?

54%

In other words, even top ranked tennis players win barely more than half the points they play.

When you lose ever second point on average, you learn not to dwell on every shot.

You teach yourself to think:
'Okay, I double faulted...it's only a point.'
'Okay, I came to the net and I got passed again...it's only a point.'

Even a great shot, an overhead backhand smash that ends up on ESPN's top 10 playlist – that too is just a point.

Here's why I'm telling you this.

When you're playing a point, it has to be the most important thing in the world. And it is.

But when it's behind you, it's behind you.

This mindset is crucial – because it frees you to fully commit to the next point with intensity, clarity, and focus."

–@rogerfederer

[Mohi @mohiuddin_]

Citizens are calling on the Olympic committee to ban Israel while the assault on Gaza continues. I’ve just signed the petition to support the ban - will you add your name too? https://t.co/DoJlwSxcIM

[Aman Wadud @AmanWadud]

Rahul Gandhi led a movement which has saved the Constitution, - he speaks for the poor and the marginalized. No one exposed crony capitalists like RG.

He is working hard to uphold constitutional values , and will never compromise with those values.

This is exactly why these dimwits don't want RG in politics!

[RAHUL @RahulSeeker]

Do you watch movies? Even if not, it is my humble request to watch this clip from a 90s movie.
About a fictional Island- Manjira.
While watching the clip replace the name with the Great Nicobar Island, in the movie the island was saved.

What about Nicobar's future?
Stay. 🧵1/21

[Sara Rey @SaraReyi]

Greta Thunberg

"To stand with Palestine is to be human”

[Mohamad Safa @mhdksafa]

Thank you Denmark.

Don't stop talking about Gaza.