Today we are happy to share one of our first open research releases: Latent Sparse Attention (LSA), a step towards subquadratic attention that matches accuracy of full attention at ultra-long context.
Sparse attention attends to only a few tokens per query, but it has to find the right ones. At 10M tokens, that search takes 98% of the attention layer's time. LSA makes sparse attention up to 22.7× faster and full attention 72.4x faster.
With @kubicek_ales@caciolai@PengLiangzu@SukritSumant@Ben_Hoov@FraserGreenlee@RMBattleday@radim_urban@thoefler@jcrwhittington
For billions of years, evolution has experimented with biological solutions at planetary scale. EDEN learns from that process — using evolutionary data to power programmable therapeutic design.
Read the @Basecamp_res paper: https://t.co/FcN18EB65s
Experience the UK’s next industrial revolution—where AI, powered by NVIDIA, is reshaping every industry.
From robotics and manufacturing to quantum breakthroughs and life sciences, watch how visionaries are building tomorrow’s factories of intelligence.
This is one of the craziest ideas I've ever seen. He converted a drawing of a bird into a spectrogram (PNG -> Soundwave) then played it to a Starling who sung it back reproducing the PNG.
Using the birds brain as a hard drive with 2mbps read write speed.
https://t.co/f5gEyyK1MH
1) there is no early stage funding gap in the UK
2) this is a bit rich from the TTO that has a track record of offering UK spinouts some of the worst terms out there
OUI has probably incinerated more potential value than any other technology transfer office in the UK
🔥@Basecamp_Res and @ferruz_noelia's ZymCTRL is now the #3 trending biology model on @huggingface - narrowly pipped by Meta and Microsoft 🏁 Download the model here https://t.co/KRxHv8Hm02 and read the paper here https://t.co/9ZPp2P0wba
Basecamp Research positions itself as the “bridge between biodiversity and biotech" and it's working on an AI model that designs new enzymes. https://t.co/aTZvI8ToNY
📢@Basecamp_Res is excited to share ZymCTRL, a world-first, open-source, text-based enzyme-generation model on @HuggingFace! ▶️ Watch @GeraldeneM49733 and @Ferruz_Noelia explain how it works here: https://t.co/iGTFuTjDBO And to download the model visit https://t.co/KGuc1oiaNO
In a new study, Basecamp and Institute of Molecular Biology of Barcelona detail a new AI model called ZymCTRL that designs new enzymes. https://t.co/pEnM1MwM1Z
We're proud to announce #BaseFold, an #AI model that improves 3D protein structure prediction by up to 6X and small mol docking by up to 3X when compared to #AlphaFold2 - DM us to see how we can accelerate your #drugdiscovery / #proteinengineering efforts: https://t.co/dodaF0gKJM
The Marvelous spatuletail hummingbird is only found in a small area in the Andes of northern Peru
📹 alvarowildlifephoto / Alvaro Cubero
https://t.co/T3NRBZUien
The Komodo dragon is the largest extant species of lizard & can eat up to 80% of its body weight in one meal
While it mostly eats carrion, the view of a goat that gets swallowed in one bite is truly impressive
[📹 Ngasu Media]
https://t.co/ExQfjIjNV3