Aryan Jain

I like things that run at wire speed | IIT Roorkee 2023

[Aryan Jain @rethinkNow348]

next two:
• Part 2: training recipe and the data curation behind it.
• Part 3: releasing GRACE, a benchmark judged by a video-aware judge.

this all started as a side quest while shipping Marlin with @HappyyPablo

🤗 Model: https://t.co/wEK417BWzn
🎮 Hosted Demo: https://t.co/w8zf2ayM8y

[Aryan Jain @rethinkNow348]

Shipping a 3-post series on how we built Marlin-2B 🐟.

Part 1: The Map Was Wrong 🗺️, just dropped.

we evaluated Marlin on CaReBench + DREAM-1K, the numbers felt off, so we built a video-aware judge and ran it on the benchmarks themselves.

Blog link: https://t.co/HnkoGOXZiF

[Aryan Jain @rethinkNow348]

oh and Marlin lands at #5 in open-source on TimeLens-Bench. beats GPT-5 by +3.9 mIoU on the combined average at 3.5× smaller :)

[Aryan Jain @rethinkNow348]

Thanks to the @ModelScope2022 team for the support

[Shubham Sharma @HappyyPablo]

Marlin 🐟 is now supported by @ModelScope2022

Super happy to see so much love from the Chinese developer community for marlin. They liked it so much they pinned it for more visibility 🥰

[Victor M @victormustar]

cool new release: a tiny open video VLM that understands what happens in videos and when 👀

Marlin-2B (Apache 2.0!) can caption clips into timestamped events, or find a natural-language moment inside the video (can see a ton of cool use cases with it)

Made a Hugging Face demo for it ⬇️

[Aryan Jain @rethinkNow348]

@SnehalSri27 @HappyyPablo Can you try it again.

[Aryan Jain @rethinkNow348]

@hckinz @HappyyPablo changed the license, it is open source

[Aryan Jain @rethinkNow348]

Update for everyone tracking this: Marlin-2B has been relicensed to Apache 2.0.
The BSL 1.1 LICENSE is replaced with standard Apache 2.0 text. NOTICE preserves attribution to Qwen3.5-2B-Base. HF metadata now reports license:apache-2.0.
https://t.co/2Smf5Mg5ul
The license was a mistake — fair critique, now fixed. Truly open source 🙏

[Aryan Jain @rethinkNow348]

@dicksonneoh7 @HappyyPablo @huggingface it currently doesn't support audio, when captioning will try to include it in the future release

[Aryan Jain @rethinkNow348]

@jeanlouisug @HappyyPablo changed the license to apache-2.0, thanks for pointing out the mistake.

[NVIDIA AI @NVIDIAAI]

@HappyyPablo @rethinkNow348 🙌

[Aryan Jain @rethinkNow348]

Didn’t expect this to blow up. Glad people are finding it useful!!

[Shubham Sharma @HappyyPablo]

open sourcing Marlin-2B 🐟
a tiny VLM to extract structured information from videos

Marlin is finetuned for two questions devs want to ask in their videos: what is happening, and when?

Best open model in its weight class, competitive with Gemini-2.5-flash at only 2B params 🧵

[Shubham Sharma @HappyyPablo]

open sourcing Marlin-2B 🐟
a tiny VLM to extract structured information from videos

Marlin is finetuned for two questions devs want to ask in their videos: what is happening, and when?

Best open model in its weight class, competitive with Gemini-2.5-flash at only 2B params 🧵

[Aryan Jain @rethinkNow348]

AI agents can negotiate $4,200 off a car purchase.
But they can't buy a $4 domain.
The bottleneck isn't intelligence. It's trust with money.
MPP(Machine Payment Protocol) has 88 services. The internet has millions.

Who's solving this?

[Nilabja @mandalnilabja_]

We launched quietly yesterday with a short post - no big announcements, no ads. Just testing the waters.

Honestly, we expected zero downloads. Instead, 74 people took the time to try Nemo. It might not sound huge, but for us, it’s a powerful signal.

[Nilabja @mandalnilabja_]

Maybe they can. Probably we will