Excited to present our work on Sarvam Vision at @aiDotEngineer World's Fair in SF. Over the last year, we have built India's first SOTA sovereign VLM for document intelligence. In my talk, I discuss what we did and how we did it.
See you at Room 2006, Moscone Center. Happy to chat more about all the other work we are doing after the talk!
@SarvamAI@SarvamForDevs@pratykumar
Sarvam joined the AI discussions at the 52nd G7 Summit in Évian-les-Bains, France.
@vivekrag participated alongside G7 leaders and chief executives from some of the world’s leading AI companies. The discussion centered on frontier AI risks, infrastructure, and sovereignty in the age of AI.
A significant moment for Sarvam and for India’s AI ecosystem.
We're thrilled to announce that we have raised $234M in the first close of our $300M Series B at a $1.5B valuation.
@HCLTech and @BessemerVP have joined us in this round, alongside continued support from @khoslaventures and @peakxvpartners
For countries and companies, sovereign control on the AI stack is no longer an optionality. Sarvam will be the partner of choice for this aspiration. The capital allows us to accelerate our momentum towards this full stack of models, compute, and deployments.
A huge thank you to our customers, partners, investors, and the Sarvam team for your trust and belief in what we are building. We’re just getting started.
Read more: https://t.co/VmLtpnj8gx
Sarvam Vision, our SOTA document intelligence model, is now 66% cheaper!
since launch, thousands of developers have digitized millions of complex documents with it. we've optimized our serving stack to scale with that demand - and we're passing on all of the gains to users.
excited to see all that you build with the model. @SarvamAI@SarvamForDevs
Earlier this February, we launched Sarvam Vision, a vision-language model for document intelligence.
Today, more than 35 million pages are being digitised through the Sarvam Vision API by developers and partners.
Since launch, we've made it significantly more efficient to serve at scale. We’re now passing these gains on by reducing the Sarvam Vision API price from ₹1.5 to ₹0.5 per page.
We've raised $65 billion in Series H funding at a $965 billion post-money valuation, led by @AltimeterCap, Dragoneer, @Greenoaks, and @sequoia.
This investment will help us advance our research and expand our capacity to meet growing demand for Claude.
the world of computer use agents (CUA) is gaining popularity. most frontier labs now have CUAs in some shape or form.
SOTA on CUA is established using leaderboards - like OSWorld, AndroidWorld, etc. these include a battery of tests around click, tap, type, scrolll.
things seemed good until i read this paper from Meta SI Labs. the team ran an experiment on the leaderboard - almost a prank!
they took a CUA and let it solve a task; just once. they recorded every action into a 1mb file and showed a simple automation outperforms frontier CUAs.
how so? performance in this domain essentially comes down to the test env. if every test begins from the same intial condition, then there is no perception needed. you dont need to see anything, or reason.
mathematically this makes sense too: in a deterministic world, a simple automation or a complex agent system both yield the same result.
the paper proposes a solution: randomize everything that can be randomized. each test should be executed in a fresh environment - a new sandboxed phone, new data, theme, UI state, so there is no gamification happening.
read more: https://t.co/B8a3D6r0s8
Had a lot of fun attending @pratykumar's talk this week at Stanford.
This is difficult engineering, done right at @SarvamAI!
Also, got to know they will expand presence in the Bay Area-- All the best! :) @MohapatraHemant
agree broadly with the thesis, but it's incomplete. data scarcity is only part of the problem.
llms didn't learn to reason because the internet wrote reasoning down. chain-of-thought on the web before 2023 was minimal. they learned when post-training started using verifiable rewards (a math grader, a code runner, a unit test) to score intermediate steps.
vlms have a similar gap, imo. there is no visual analog of the code runner. no verifiable check that asks "did the model actually see X in an image, or did it just say X based on the image context."
if agentic vision were to take off, we should be build methods for verifiability. once a vision rl loop has a check for grounding, the diff vision skills become a normal post-training problem with rewards.
Building ASR for India is less about benchmark numbers and more about what breaks in production.
This Thursday, I'm sitting down with @sehaj__virk , @adityam0309 , and Dhruv to unpack Sarvam's Saaras-V3 and how it handles real-world Indian speech.
We’ll cover:
⚡ Realtime vs. Streaming vs. Batch (Voice agents to call analytics)
🗣️ 22+ languages, dialects, and code-mixing
👥 Multi-speaker audio and overlapping speech
If you're building voice products for India, bring your hard questions.
📅 Thursday, 21st May | 5:00 PM IST
📍https://t.co/rD0KGjt8bv
some open questions though:
- is terminal output sufficient in general to achieve complete understanding of the env? what happens to silent processes?
- how does this scale with long-horizon tasks? won't you hit memory issues, slowing down training?
- does prediciting terminal text enough to learn cause and effect required for world modeling?
quite an interesting read. shows how current agent RL can be wasteful. it updates policies based on sparse action rewards but masks out the env response (terminal outputs) in the loss updates. essentially this discards ground truth signal about how the underlying state actually changed.
the proposal is to build a join objective: RL on actions + cross-entropy on env observations. by predicting the terminal output for each action, there is implicit learning toward a world model. it is sample efficient too.
10/ what LIBERO-Long doesn't tell us:
- does plan-once hold past 10 steps in unstructured scenes?
- does interleaving still help when predicted keyframes don't match what the robot sees?
- is text+image the right split, or just one good split?
worth a read: https://t.co/m6qx6J1FBt
1/ been trying to understand the VLA lanscape lately, and came across this recent, neat paper discussing how thinking works across vision and text.
vision-language-action policies have improved one design choice at a time: latent state, text chain-of-thought, world-model keyframes. each individually optimized, and compared in isolation. when a new VLA wins on a bench, it's hard to tell which choice did the work.
https://t.co/m6qx6J1FBt
9/ a bigger implication if this scales: VLA policies probably don't need clean human-written plans during training. IVLR's plans are pseudo-labels from segmenting demo videos and captioning each stage with a VLM. the policy learns from those noisy labels and still hits 92.4.