The Number of Nature: Fibonacci Sequence
The spiral shapes of sunflowers follow a Fibonacci sequence.
Shell, Spiral Galaxy, Hurricane, Face, DNA Molecules, Flower Petals, all follow a Fibonacci Sequence.
Meta announces Better & Faster Large Language Models via Multi-token Prediction
Large language models such as GPT and Llama are trained with a next-token prediction loss. In this work, we suggest that training language models to predict multiple future tokens at
I told a grad-student co-author "try to imagine me as the guy from 'Memento' who can't remember anything & needs clues to pick-up the thread on projects" and they said "I believe you, because you already used that memento analogy"
We're sharing our learnings from a small-scale preview of Voice Engine, a model which uses text input and a single 15-second audio sample to generate natural-sounding speech that closely resembles the original speaker. https://t.co/yLsfGaVtrZ
If you think OpenAI is cool, you’re gonna love my latest side project OpenUI. Tired of writing HTML by hand and remembering tailwind classes? Let OpenUI do it for you: https://t.co/8TSXILJnLZ
New Day New LLM on Leaderboard.
Samba-CoE v0.2 outperforms #DBRX by Databricks Mosaic Research and Databricks Mixtral-8x7B from Mistral AI, and Grok-1 by Grok at a breakneck speed of 330 tokens/s
Access at: https://t.co/z1AuaVZACK
Blog: https://t.co/TDsUNAJRdE
🚀🌟🚀Excited to announce Samba-CoE v0.2, which outperforms DBRX by @DbrxMosaicAI and @databricks, Mixtral-8x7B from @MistralAI, and Grok-1 by @grok at a breakneck speed of 330 tokens/s.
These breakthrough speeds were achieved without sacrificing precision and only on 8 sockets, showcasing the true capabilities of dataflow! Why would you buy 576 sockets and go to 8 bits when you can run using 16 bits and just 8 sockets. Try out the model and check out the speed here - https://t.co/A3lB3RTEo2.
We are also providing a sneak peak of our next model, Samba-CoE v0.3, available soon with our partners at @LeptonAI. Read more about this announcement at https://t.co/DIiuJkPlKg
I wrote a tutorial on diffusion models for undergrad and grad students. I tried my best to give intuitive explanations for complicated equations.
Your feedback is much appreciated
Thanks to those who suggested various reading materials to me
https://t.co/fWv111nG5M
Python is Rusty 🤡.
Refactored code in Polars (https://t.co/i4Rgx8rbE4) is 48x faster than the previous code in Pandas in one of my projects dealing with 100 million rows.
20 mins ➡️ 25 secs.