Tian Cao

Machine Learning Engineer @ Apple AIML

[Zhe Gan @zhegan4]

🤔 Knowledge stored in multimodal LLM weights can be inherently limited. How can we empower multimodal LLMs with multimodal web search?

💡 In DeepMMSearch-R1, we aim to train a multimodal search agent capable of performing on-demand, multi-turn web searches and dynamically crafting queries for both image and text search tools. It can also initiate web searches based on relevant crops of the input image via using Grounding DINO as a tool.

🔗 arXiv: https://t.co/NhOPiyX4Ql

1️⃣ In SFT, we teach the model when to search, what to search for, which search tool to use and how to reason over the retrieved information.

2️⃣ SFT enables tool use, while RL refines the tool-selection behavior by reducing unnecessary calls.

Led by our awesome intern @KartikNarayan10, @tiancao, @yinfeiy etc.

[Tian Cao @tiancao]

@OpenAI Amazing

[Tian Cao @tiancao]

@SantaClaraPower sheraton dr， 95050，power outage

[Tian Cao @tiancao]

@SantaClaraPower power outage at sheraton dr 95050

[Tian Cao @tiancao]

Performance of China's journals indexed in SCIE: An evaluation based on megajournal metrics https://t.co/O6Y2dBDyjv

[Tian Cao @tiancao]

@AskRavenBot

[Tian Cao @tiancao]

@AskRavenBot

[Tian Cao @tiancao]

@AskRavenBot

[Tian Cao @tiancao]

@AskRavenBot

[Tian Cao @tiancao]

@AskRavenBot

[Tian Cao @tiancao]

@AskRavenBot

[Tian Cao @tiancao]

@AskRavenBot

[Tian Cao @tiancao]

@AskRavenBot https://t.co/D57REvBbuo

[LH Stacey Author 💖 @LyndaStacey]

When two unexpected guests turn up at the hall, Jess wonders if life will never be the same?

Pre-order price, just 99p

@RNAtweets
#Tuesnews

https://t.co/XodP3s4ZnG … … …
@ChocLituk #suspense #yorkshireis #doncasterisgreat #romance #weddings #series #secrets

[Tian Cao @tiancao]

@titanshj 我们搞的一个hackathon twitter bot😀

[Tian Cao @tiancao]

test message

[Amazon @amazon]

Discover, have fun, and share Amazon Stickers! Find it in camera search in the Amazon app. #AmazonStickers https://t.co/7N12TyGkHa

[more followers @1jsam]

beuuuh frustasi die wkwkwk @AHMADDHANIPRAST: Utk tim ses med sos No 2...besok gw panasin lagi ye...biar lu pada bisa nyampah..drpd nganggur.

[ImSyafri @ImSyafri]

Orang yang tulus menyayangi tak akan pernah menyakiti. Karena orang yang menyakiti tidak mempunyai kasih sayang yang tulus.