Lin Chen

PhD in USTC ｜ Large multimodal models ｜Research intern in Shanghai AI Lab

[Lin Chen @Lin_Chen_98]

@imhaotian impressive！

[Lin Chen @Lin_Chen_98]

@Hellostone2024 @aasdt65lo3673 @detresfa_ Two nuclear bomb may not be enough. Cuz it tasted that from its American daddy.

[Lin Chen @Lin_Chen_98]

@olusegini @jcokechukwu fucking genius! hope u can keep ‘intelligent’ forever.

[Lin Chen @Lin_Chen_98]

@Guangxuan_Xiao excellent！

[Lin Chen @Lin_Chen_98]

@MetaverseFoodie @FinanceYF5 全AI

[Lin Chen @Lin_Chen_98]

@zhegan4 Thanks for appreciating our efforts!

[Haodong Duan @KennyUTC]

Excited to share several of our recent works:

1. MMBench (ECCV'24 Oral@6C, Oct 3, 13:30): A comprehensive mutli-modal evaluation benchmark adopted by hundreds of teams working on LMMs.
https://t.co/nSkbH43t9d
2. Prism (NeurIPS'24): A framework that can disentangle and assess the perception and reasoning abilities of VLMs, and a potential cost-effective solution for vision-language tasks. https://t.co/9TVRFwE185
3. MMBench-Video (NeurIPS'24 Dataset): A Long-Form Multi-Shot Benchmark for Holistic Video Understanding. https://t.co/kBSa2PgoUU
4. VLMEvalKit (MM'24 OpenSource): An open-source evaluation toolkit of LMMs, supporting 100+ different LMMs and ~50 multi-modal benchmarks. https://t.co/I7dnLWdTmk

If you want to learn more about our work or talk about LMM or other topics, I'm always happy to have a chat. Besides, our team also has openings for intern/full-time researchers and engineers. Feel free to DM me if you are interested.

[Lin Chen @Lin_Chen_98]

@JustinLin610 Amazing work! I’m crazy fans of Qwen series. Looooooking forward to your team’s future works!

[Lin Chen @Lin_Chen_98]

@mvaloatto @huggingface @jonatasgrosman @Emily_Alsentzer Thanks for the nomination！

[Lin Chen @Lin_Chen_98]

Thrilled to see myself in the #3 spot on HuggingFace’s most influential users for July!
I look forward to doing more impactful works to give back to the community in the future.

[Matt Valoatto @mvaloatto]

🤗 Here are the top 100 of @HuggingFace’s most impactful users of July 2024 (models, datasets, spaces, followers):

🏆 Top Contributors To Follow: https://t.co/67BgVDr5V9

-

🏛️ Top 10 Model Downloads: 👏 @jonatasgrosman, #PatrickJohnChia, @Lin_Chen_98, @Emily_Alsentzer, #LiangWang, @limsanity23, @eugene_siow, @mrm8488, #avichr, @TheBlokeAI

📊 Top 10 Dataset Downloads: 👏 @haileysch__, @nathanhabib1011, @lukaemon, #HaonanLi, @algo_diver, #YebHavinga, @princeton_nlp, @jonbtow, @moonares, #DanHendrycks

🚀 Top 10 Space Likes: 👏 @fffiloni, @flngr, @multimodalart, @_akhaliq, @yvrjsharma, @angrypenguinpng, @hysts12321, #NishithJain, @xenovacom, @radamar

🤗 Top 10 Profile Followers: 👏 @TheBlokeAI, @mervenoyann, @fffiloni, @_akhaliq, #LvminZhang, @teknium, @xenovacom, #Undi, @erhartford, #WizardLM

[Vaibhav (VB) Srivastav @reach_vb]

New SoTA VLM: InternLM XComposer 2.5 🐐
> Beats GPT-4V, Gemini Pro across myriads of benchmarks.
> 7B params, 96K context window (w/ RoPE ext)
> Trained w/ 24K high quality image-text pairs
> InternLM 7B text backbone
> Supports high resolution (4K) image understanding tasks
> Video understanding and multi-turn, multi-image chat supported too

> Bonus: Capable of generating web pages (w/ prompt) and high quality text-image articles :O

GG InternLM team, first a SoTA 7B LLM followed by a SoTA 7B VLM! ⚡

Demo and model checkpoints below!

[AK @_akhaliq]

InternLM-XComposer-2.5

A Versatile Large Vision Language Model Supporting Long-Contextual Input and Output

We present InternLM-XComposer-2.5 (IXC-2.5), a versatile large-vision language model that supports long-contextual input and output. IXC-2.5 excels in various text-image comprehension and composition applications, achieving GPT-4V level capabilities with merely 7B LLM backend. Trained with 24K interleaved image-text contexts, it can seamlessly extend to 96K long contexts via RoPE extrapolation. This long-context capability allows IXC-2.5 to excel in tasks requiring extensive input and output contexts. Compared to its previous 2.0 version, InternLM-XComposer-2.5 features three major upgrades in vision-language comprehension: (1) Ultra-High Resolution Understanding, (2) Fine-Grained Video Understanding, and (3) Multi-Turn Multi-Image Dialogue. In addition to comprehension, IXC-2.5 extends to two compelling applications using extra LoRA parameters for text-image composition: (1) Crafting Webpages and (2) Composing High-Quality Text-Image Articles. IXC-2.5 has been evaluated on 28 benchmarks, outperforming existing open-source state-of-the-art models on 16 benchmarks. It also surpasses or competes closely with GPT-4V and Gemini Pro on 16 key tasks.

[Aran Komatsuzaki @arankomatsuzaki]

InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Output

- Excels in various text-image tasks w/ GPT-4V level capabilities with merely 7B LLM backend
- Opensourced

https://t.co/fto4phT4Cn

[Lin Chen @Lin_Chen_98]

@Gradio @Gradio Could you tweet about our ShareCaptioner-Video demo for generating detailed captions for videos?

Link: https://t.co/Xnm8b1ar99

[Lin Chen @Lin_Chen_98]

Built our @Gradio app and deployed ShareCaptioner-Video on @huggingface Spaces with ZeroGPU. Now, you can try to generate detailed caption for your own video. Have fun!

https://t.co/Xnm8b1ar99

[AK @_akhaliq]

ShareGPT4Video

Improving Video Understanding and Generation with Better Captions

We present the ShareGPT4Video series, aiming to facilitate the video understanding of large video-language models (LVLMs) and the video generation of text-to-video models (T2VMs)

[Lin Chen @Lin_Chen_98]

Thanks for @_akhaliq sharing our work!
We sincerely hope this series can help the video-language community！😆😆

[AK @_akhaliq]

ShareGPT4Video

Improving Video Understanding and Generation with Better Captions

We present the ShareGPT4Video series, aiming to facilitate the video understanding of large video-language models (LVLMs) and the video generation of text-to-video models (T2VMs)

[Lin Chen @Lin_Chen_98]

Looking forward to working on a longer version together!
You can preview our ShareGPT4Video project in the following link!

https://t.co/xGLOjiVnIQ

[Bin Lin @LinBin46984]

📣📣📣We are excited to announce the release of Open-Sora Plan v1.1.0.
🙌Thanks to ShareGPT4Video's capability to annotate long videos, we can generate higher quality and longer videos.
🔥🔥🔥We continue to open-source all data, code, and models!

https://t.co/C28gHbiPrU

[Lin Chen @Lin_Chen_98]

@LinBin46984 Thanks, bro! Looking forward to working on a longer version together!😍😍

[Lin Chen @Lin_Chen_98]

@altryne @stablequan same question