SELF-BART: A Transformer-based Molecular Representation Model using SELFIES @IBMResearch
1. SELF-BART introduces an encoder-decoder architecture that leverages SELFIES (SELF-referencing Embedded Strings) to ensure the generation of syntactically valid molecules, outperforming SMILES-based approaches.
2. The model addresses a key limitation in existing molecular models by combining representation learning with auto-regressive generation, making it suitable for both molecular property prediction and molecule generation tasks.
3. SELF-BART’s use of a denoising objective during training improves its ability to learn robust molecular representations, leading to superior performance across nine MoleculeNet benchmark datasets.
4. Compared to graph-based and SMILES-based models like ChemBERTa and MolFormer, SELF-BART achieves state-of-the-art results in classification tasks (e.g., 96.9 ROC-AUC on ClinTox) and regression tasks (e.g., 1.397 RMSE on FreeSolv).
5. The model demonstrates excellent generative capabilities, achieving 99.8% validity, 100% novelty, and high internal diversity in molecule generation tasks, showcasing its potential for drug discovery applications.
6. SELF-BART’s encoder-decoder framework provides the flexibility to generate new molecules from learned representations, allowing researchers to explore novel chemical spaces effectively.
7. Preliminary results indicate SELF-BART’s potential to generate diverse, valid, and novel molecular structures, setting the stage for future studies on conditioned molecular generation.
8. This study underscores the advantages of SELFIES for molecular modeling and highlights SELF-BART’s applicability in both virtual screening and molecular optimization tasks.
@SeijiTkd@ipd_indra
📜Paper: https://t.co/ympy0vGlF1
NeurIPS 2023 Workshop AI4Mat に、弊グループから、MI用の基盤モデルに関する2本の論文が採択されました!
・Multi-modal Foundation Model for Material Design
・MHG-GNN: Combination of Molecular Hypergraph Grammar with Graph Neural Network
#NeurIPS2023