Srini Rajagopal

VP engineering Mercor

[Srini Rajagopal @srini]

I would be surprised if othe hyperscalers AWS, Microsoft don’t do an equity raise similar to Google before the OpenAI and Anthropic fund raises to have enough dry powder

[Srini Rajagopal @srini]

@HannaHajishirzi Congratulations

[Dwarkesh Patel @dwarkesh_sp]

Recently met @srush_nlp and he started giving me an impromptu lecture on how targeted on-policy self-distillation works.

I asked him if I could record it on my iPhone.

The basic idea is this: if the model made a mistake at some point in the rollout (for example, calling a tool that doesn't exist), we want to discourage this specific error, but we don't want to just learn from the final reward, because it's a very noisy signal spread out over the whole trajectory.

So we have another model read this trajectory and figure where the error was made. It simply inserts some hint tokens to the part of the trajectory right above where the mistake was made.

Now with these injected hint tokens, have the model run a forward pass. You're not having to regenerate a new rollout - aka no new decode required.

The hint causes the model to assign lower probabilities to the error tokens. You then trains the original model to match these new probabilities, teaching it to downweight that specific mistake.

[Srini Rajagopal @srini]

@TheRohanVarma Congrats

[Srini Rajagopal @srini]

@nikunj There is also TPU, Google cloud

[Srini Rajagopal @srini]

@darshil Where is it happening

[Srini Rajagopal @srini]

@jukan05 @jukan05 how often do you change it? When will update it next?

[Srini Rajagopal @srini]

@inventur_es @joinshiftX Haha

[Srini Rajagopal @srini]

@mukund Interesting, time for you to move to to Bay Area :)

[Srini Rajagopal @srini]

@dsp_ Good stuff, stateless finally

[Srini Rajagopal @srini]

@bubbleboi @bubbleboi thoughts on TPU versus Trainium? Is there any writeup on this? thanks!

[Srini Rajagopal @srini]

@BrendanFoody Don’t fight the tide

[Srini Rajagopal @srini]

@KobeissiLetter @WisemanCap does this change your plan

[Srini Rajagopal @srini]

Excited for what the team is building!

[Jagannath Putrevu @jputrevu]

🚀 After a year of quiet building, I’m excited to officially announce @champ_hq out of stealth. We're also announcing our $8.5M Seed round led by @Redpoint with participation from @defyvc , @Max , @svangel, and a great group of angels. Watch the quick launch video below

[Srini Rajagopal @srini]

Crazy given all the progress that @sama is so bullish on the next 12 months

[Srini Rajagopal @srini]

Next year is going to be highest model improvement ever @sama

[Srini Rajagopal @srini]

Single agent for consumer and multiple agents for enterprise as per @gdb, Wdyt?

[Srini Rajagopal @srini]

@mukund @Cursor Same as anthropic

[Srini Rajagopal @srini]

Excited for what @cyril_mathew and team are building!
Happy to have a played a small part in it as an advisor

[Cyril Mathew @cyril_mathew]

Over a decade ago at Uber, we were paying drivers across 40 countries. Their top ask: "Pay me faster." That stuck with me through Coinbase and Stripe, where I kept running into the same wall from different angles.

Today, Latitude (@rtp) is launching out of stealth. We raised an $8M seed round in Jan 2025 and have been building quietly since then.