Is DNA all you need?
Introducing Evo, a long context 7B foundation model for biology
Evo has SOTA *zero-shot* prediction across DNA, RNA, and protein modalities
Evo can generate DNA, RNA+proteins & make CRISPR-Cas systems for first time
blog https://t.co/5xzGhJPfnK
Our MobileLLM proposes 125M/350M pre-trained models with SoTA performance, in particular in chat/API calling. One interesting technique in our work is weight-sharing across Transformer layers, which saves the parameters and reduce the latency during inference.
Glad to be involved in the effort! Thanks @zechunliu and @vikasc's team!
Our MobileLLM proposes 125M/350M pre-trained models with SoTA performance, in particular in chat/API calling. One interesting technique in our work is weight-sharing across Transformer layers, which saves the parameters and reduce the latency during inference.
Glad to be involved in the effort! Thanks @zechunliu and @vikasc's team!