Top Tweets for #MorganBERT
MorganBERT: Chemical substructure sequences meet language models for property prediction
1. MorganBERT is a novel approach that leverages chemical substructure sequences to improve the prediction of molecular properties using language models. This method stands out by utilizing the extended-connectivity fingerprints (ECFP) algorithm to generate unique identifiers for chemical substructures, which are then used as input for the RoBERTa architecture.
2. The core innovation of MorganBERT lies in its ability to capture the local chemical environment around heavy atoms in molecules. By treating these atom identifiers as “words” and sequences of identifiers as “sentences,” the model can effectively learn from over 52 million compounds, significantly enhancing its predictive capabilities.
3. MorganBERT outperforms existing methods, including traditional fingerprints, graph neural networks (GNNs), and other chemical language models (CLMs), across multiple tasks relevant to drug development and toxicology. This includes predicting ADME properties, CYP450 interactions, and acute toxicity endpoints.
4. A key advantage of MorganBERT is its ability to organize chemicals along a continuous gradient in relation to their activity values. This approximate isometry between chemical space and activity space allows for better interpretability of predictions, making it easier to understand how structural changes impact biological activities.
5. The study demonstrates MorganBERT’s effectiveness through benchmarking against diverse methods. For instance, in predicting aqueous solubility, MorganBERT achieved a Pearson correlation coefficient (PCC) of up to 0.929, surpassing previous models like ChemBERTa and MolFormer.
6. MorganBERT’s unique approach also enables the generation of explanations for individual molecule predictions through counterfactuals. By exploring the local chemical space surrounding a focal molecule, the model can identify structurally similar molecules with different predicted outcomes, providing insights into the factors influencing activity.
7. The authors highlight that MorganBERT’s pretraining on a large corpus of chemical structures allows it to transfer learned structural information to specific tasks, mitigating the limitations of narrow applicability domains (ADs) often seen in traditional QSAR models.
📜Paper: doi.org/10.26434/chemrxiv-20…
#MorganBERT #ChemicalLanguageModel #QSAR #DrugDiscovery #Toxicology #AIinChemistry

Most Popular Users

Elon Musk 
@elonmusk
240.2M followers

Barack Obama 
@barackobama
118.6M followers

Cristiano Ronaldo 
@cristiano
114.4M followers

Donald J. Trump 
@realdonaldtrump
111.8M followers

Narendra Modi 
@narendramodi
106.9M followers

Rihanna 
@rihanna
98.6M followers

NASA 
@nasa
92.2M followers

Justin Bieber 
@justinbieber
91.7M followers

KATY PERRY 
@katyperry
89.9M followers

Taylor Swift 
@taylorswift13
83.9M followers

Lady Gaga 
@ladygaga
75.4M followers

Virat Kohli 
@imvkohli
73.3M followers

Kim Kardashian 
@kimkardashian
70.8M followers

YouTube 
@youtube
68.6M followers

Neymar Jr 
@neymarjr
66.3M followers

Bill Gates 
@billgates
65.2M followers

Selena Gomez 
@selenagomez
63M followers

The Ellen Show
@theellenshow
62.1M followers

CNN 
@cnn
61.7M followers

X 
@x
60.6M followers
