Top Tweets for #MolLLM
Mol-LLM: Multimodal Generalist Molecular LLM with Improved Graph Utilization
1.Mol-LLM is the first generalist molecular language model that robustly integrates both 1D molecular sequences and 2D graph structures across a broad range of tasks, including property prediction, reaction prediction, and molecule generation.
2.At the core of its innovation is MolPO (Molecular structure Preference Optimization), a multimodal fine-tuning strategy that teaches the model to distinguish between correct and perturbed molecular graphs—enhancing structure utilization without additional supervision.
3.Unlike prior multimodal models that rely on naive next-token prediction, Mol-LLM uses MolPO to optimize structural preferences, significantly boosting performance and generalization, especially on out-of-distribution benchmarks.
4.To maximize graph expressivity, Mol-LLM combines two GNN backbones—GINE and TokenGT—into a hybrid encoder, with pre-training on both functional group prediction and SELFIES reconstruction for rich molecular representation.
5.A Q-Former module bridges the molecular graph and language input, projecting concatenated graph embeddings into a fixed-length token sequence compatible with a Mistral-7B backbone, which is extended with domain-specific tokens for regression, classification, and generation tasks.
6.Mol-LLM is trained on a 3.3M instance multimodal instruction-tuning dataset covering five task groups, constructed from sources such as SMolInstruct, Mol-Instructions, and ChEBI-20, enabling flexible handling of diverse molecular queries.
7.Across MoleculeNet and other molecular benchmarks, Mol-LLM outperforms state-of-the-art generalist models like LlaSMol, ChemDFM, and 3D-MoLM, notably in reaction prediction and property regression where structural information is key.
8.Ablation studies reveal that the addition of MolPO improves both performance and graph discrimination ability across all tasks. GNN pre-training alone also yields consistent gains, especially on tasks requiring recognition of global molecular features.
9.Even in text-only settings (e.g., molecule generation or captioning), Mol-LLM matches or exceeds baselines, and its ability to leverage graphs does not impair performance when structural input is absent—highlighting its multimodal flexibility.
10.Evaluation on out-of-distribution datasets (AqSol and ORDerly) confirms Mol-LLM’s strong generalization, a result attributed to the combination of graph-aware training and broad instruction coverage.
11.Mol-LLM establishes a new paradigm in molecular LLMs by unifying instruction tuning with graph-aware preference optimization, laying the foundation for future generalist systems in chemical and biomedical domains.
💻Code: github.com/LGAI-Research/Mol… 📜Paper: arxiv.org/abs/2502.02810
#MolLLM #GraphLearning #DrugDiscovery #LLM #MolecularAI #ChemistryAI #MultimodalAI

Most Popular Users

Elon Musk 
@elonmusk
240.2M followers

Barack Obama 
@barackobama
118.6M followers

Cristiano Ronaldo 
@cristiano
114.4M followers

Donald J. Trump 
@realdonaldtrump
111.8M followers

Narendra Modi 
@narendramodi
106.9M followers

Rihanna 
@rihanna
98.6M followers

NASA 
@nasa
92.2M followers

Justin Bieber 
@justinbieber
91.7M followers

KATY PERRY 
@katyperry
89.9M followers

Taylor Swift 
@taylorswift13
83.9M followers

Lady Gaga 
@ladygaga
75.4M followers

Virat Kohli 
@imvkohli
73.3M followers

Kim Kardashian 
@kimkardashian
70.8M followers

YouTube 
@youtube
68.6M followers

Neymar Jr 
@neymarjr
66.3M followers

Bill Gates 
@billgates
65.2M followers

Selena Gomez 
@selenagomez
63M followers

The Ellen Show
@theellenshow
62.1M followers

CNN 
@cnn
61.7M followers

X 
@x
60.6M followers
