Nazreen Pallikkavaliyaveetil

Postdoctoral Associate Computational Biology @AI/ML @Yale

[Nazreen Pallikkavaliyaveetil @nazreenpm]

@sachalevy3 Congrats Sacha!! 👏

[David van Dijk @david_van_dijk]

🚀 We are at @icmlconf in Vienna presenting #cell2sentence (C2S), the first framework for LLM-based single-cell foundation models! 🧬✨

C2S can generate cells from language prompts, interpret cells, and even generate natural language insights directly from data! 🔍💬📊

Stay tuned for some major model releases this week! 🔥📢
https://t.co/3bh10G8zxG
https://t.co/cbjFB5TmJr
https://t.co/DIFQPA5OJQ

[David van Dijk @david_van_dijk]

Major Cell2Sentence update 🎉🔬! We’ve been thrilled to see the attention Cell2Sentence has received from the single-cell community.

Now, we’re excited to release our first update of Cell2Sentence (C2S) - a framework to leverage LLMs to train foundational single-cell models, directly in text.

What’s new & out:
Updated preprint with latest results https://t.co/cbjFB5TmJr
First full cell model available on the HuggingFace hub https://t.co/3kcQzUo7Tm
Updated codebase for data transformation & training https://t.co/E8VaXmgYWf

We now fine-tune language models to generate entire cells, predict combinatorial cell labels, and generate textual data insights directly from cell sentences.

We train GPT-2 and Pythia models on a large multi-tissue dataset containing 36M cells from @cellxgene as well as an immune tissue dataset containing 270k cells.

C2S LMs achieve SOTA performance in single-cell data generation.

C2S models trained for combinatorial label prediction settings excel in low-data regimes, outperforming single-cell foundation model baselines.

We also show that C2S models benefit from natural language pre-training and always outperform models trained from scratch on cell sentences.

C2S provides a straightforward approach to adapting LLMs for single-cell data analysis, leveraging their natural language capabilities to generate and derive insights from single cells.

We are convinced that C2S’ approach of integrating data modalities through text is the way forward for single-cell foundation models, from representing multi-omics data to generating clinical insights, all in a human readable format.

We’re excited to start building a community around Cell2Sentence! If you also think that C2S will be the framework for single-cell foundation models, and are interested in contributing, reach out to us! We welcome any collaborations and discussions.

Huge thanks to our collaborator @aminkarbasi and the C2S team (@danielflevine, @sachalevy3, @SyedARizvi5688, @nazreenpm, Xingyu Chen, @dzhang03, @GhadermarziSina, Ruiming Wu, Ivan Vrkic, Anna Zhong, Daphne Raskin, Insu Han, @aho_fonseca, @josueortc) for their hard work on C2S! Special thanks to @rahuldhodapkar, who co-supervises this project.

[David van Dijk @david_van_dijk]

Thrilled to announce that CINEMA-OT is now published at Nature Methods!
https://t.co/i7lx2Zz9bc

[David van Dijk @david_van_dijk]

Single Cells as text? We developed Cell2Sentence, a method that allows training of Large Language Models on single-cell data!
https://t.co/IGc9TFXcTM
With @danielflevine @SyedARizvi5688 @sachalevy3 @rahuldhodapkar
@YaleSEAS @YaleMed #AI #ML #NLP #genomics #CompBio #singlecell

[David van Dijk @david_van_dijk]

Introducing BrainLM 🧠🤖the first foundation model for #fMRI analysis trained on 6,700 hours of brain activity data! Fine-tune for specialized tasks or leverage zero-shot inference capabilities!
@WuTsaiYale @YaleCompsci @YaleCBB @YaleMed
https://t.co/MUobqXULfb

[David van Dijk @david_van_dijk]

Postdoc positions available @YaleMed @YaleCompsci: ML/AI methods for immune profiling. In collaboration with @VirusesImmunity
https://t.co/ovKoWRzMjl @YaleCBB @YalePostdocAsso @YaleCVRC Please share!