My tribute to Elliott Randall’s awesome intro guitar solo to Steely Dan’s “Reelin’ in the Years”. Thanks to @chad_mcdaniel for the drums and Quinn McIntyre for the keys. #favoriteguitarsolos
It is with more sadness than mere words can convey that we have to report that our beloved Ozzy Osbourne has passed away this morning. He was with his family and surrounded by love.
We ask everyone to respect our family privacy at this time.
Sharon, Jack, Kelly, Aimee and Louis
It is with more sadness than mere words can convey that we have to report that our beloved Ozzy Osbourne has passed away this morning. He was with his family and surrounded by love.
We ask everyone to respect our family privacy at this time.
Sharon, Jack, Kelly, Aimee and Louis
Give First: The Power of Mentorship is officially out (today is the release date).
In honor of the release, I decided to write https://t.co/QAz4Q2JhTD to explain why I view Give First as a philosophy instead of a religion.
For all that have embraced this philosophy, contributed to it, and helped me hone and evolve it over the years, thank you.
Mechanistic interpretability is fascinating - but can it be useful? In particular, can it beat strong baselines like steering and prompting on downstream tasks that people care about?
The answer is, resoundingly, yes.
Our new blog post with @a_karvonen, Sieve, dives into the first counterfactual application of sparse autoencoders to a real downstream task, where we demonstrate Pareto dominance over existing methods.
A 🧵… ~1/8~
https://t.co/SF7cZ82haD
Introducing Oasis: the first playable AI-generated game.
We partnered with @DecartAI to build a real-time, interactive world model that runs >10x faster on Sohu. We're open-sourcing the model architecture, weights, and research.
Here's how it works (and a demo you can play!):
Ubiquitous and computationally intensive workloads eventually get ASICs. Cool company building cool tech: @Etched makes purpose-built silicon to massively accelerate inference in transformer-based models vs GPUs.
Meet Sohu, the fastest AI chip of all time.
With over 500,000 tokens per second running Llama 70B, Sohu lets you build products that are impossible on GPUs. One 8xSohu server replaces 160 H100s.
Sohu is the first specialized chip (ASIC) for transformer models. By specializing, we get way more performance: Sohu can’t run CNNs, LSTMs, SSMs, or any other AI models.
Today, every major AI product (ChatGPT, Claude, Gemini, Sora) is powered by transformers. Within a few years, every large AI model will run on custom chips.
Here’s why specialized chips are inevitable:
Super proud to announce our $30M Series B today🎉 wouldn't be possible without the incredible people working hard to make @parallel_domain not only the best synthetic data platform in the world, but also the best team in the world. Read more on our blog! https://t.co/C4FDUOi6wx
1) For the @TwitterBoulder / @Gnip folks impacted by the layoffs, @foundryvc is planning to host a "What's Next?" happy hour on 11/30 with our team & execs from local companies. I have a spreadsheet of folks impacted from @jqiu. Make sure your name is on it!