People who say that AI startups are "just ChatGPT wrappers" forget that they're saying it by typing into a mobile app wrapper of a phone wrapper of a chip wrapper connected to a cell network wrapper of a cell tower wrapper of ... ad nauseam.
That's just how technology works.
Moderns have it backwards. We seek out amazing places. The saints of old built amazing places. Benedictine monks took a “vow of stability” to one place and married themselves to that bit of earth for their entire life.
Look at what they built! 🧵
New ultra-fast ‘multi-head’ speech recognition model drop from @_aiOla, beats OpenAI Whisper.
Officially dubbed Whisper-Medusa, the model builds on Whisper but uses a novel “multi-head attention” architecture that predicts far more tokens at a time
So they seem to have added more attention heads on top of whisper. They claim the same accuracy but 50% faster. Their demo does one text in 1.9s while "baseline" whisper does it in 4s. Code and weights opensource under MIT.
they have started with a 10-head model but will soon expand to a larger 20-head version capable of predicting 20 tokens at a time, leading to faster recognition and transcription without any loss of accuracy.
Amazon is now a showroom for AliExpress. Buy some pairs on Amazon to try on, fine best style, return, order in ali for 1/4 price.
Full circle. Wasn't Amazon the show room for bricks and mortar? Wonder what's next in the cycle...
A story to put a massive smile on your face today. 😃
There is no dog in the world who deserves this more than Mr Big.
Exactly 2 months ago on the 29th May we found him dying alone in a toilet. He was done.
Well today was the greatest day in his life (1/10) 🧵
Marc Andreessen: Revolutionary technologies were often viewed as “trivialities” or “jokes”
“If you read history, the great innovations of the past are now well understood as being very important. In almost every case, they were not widely understood as such at the time. In fact, I would assert that they were often actually viewed as trivialities or jokes.”
He gives three examples:
1. The telephone. “When Thomas Edison was first working on the telephone, the assumption of the use case motivating his early work was the idea that telegraph operators needed to be able to talk to each other. It was considered implausible that you would have a system that would let any ordinary person pick up the telephone and talk to another person - that was clearly impossible… Completely missing the larger opportunity.”
2. The Internet. “I have personal experience with this one. The Internet was laughed at. It was heaped with scorn from 1993 to 1997-98. In fact, those of you who were in the industry at the time will remember the New York Times had a reporter on staff named Peter Lewis… I’m convinced he was specifically hired by the editors to just write negative stories about the Internet. It was all he did, and it was always the Internet was never going to be a consumer medium. The Internet is not nearly as big as these people think. Nobody is ever going to trust the internet for e-commerce.”
3. The car. “The car was absolutely viewed as a triviality and a toy when it first emerged. In fact, J.P. Morgan himself refused to invest in Ford Motor Company with the response that it’s just a toy for rich people, which is in fact what it was at the time. If you had one of the first cars, you had to be a rich person. You had to have a driver. You often actually had to also have a stroker with your early cars to keep the engine going. And then you also had to travel with a full-time mechanic because the thing would break down every three miles.”
Marc concludes:
“The great innovations of the present, I believe, are virtually guaranteed to be viewed as trivial and to be viewed as jokes. I think history 50 to 100 years from now will enshroud them in legend. In our time, they won’t be recognized as such. Of course, in the future, when they become legends, our descendants will themselves have their own trivial innovations to laugh at.”
Video Source: @MilkenInstitute
50% of our code base was written entirely by LLMs
expect this to be ~80% by next year
With sonnet we’re shipping so fast, it feels like we tripled headcount overnight
Not using Claude 3.5 to code? Expect to be crushed by teams who do (us)
👀Claude handles an insane request:
“Remove the squid”
“The document appears to be the full text of the novel "All Quiet on the Western Front" by Erich Maria Remarque. It doesn't contain any mention of squid that I can see.”
“Figure out a way to remove the 🦑“
AI Math Olympiad winner is now Open Source! 🔥
> 7B model, scored 29/50 on the public and private Kaggle test sets. (Apache 2.0 licensed).
> Base model: deepseek-math-7b-base
> Two-stage fine-tuning to reach the leaderboard-winning solution.
> Step 1: fine-tune large and diverse math datasets (templated with Chain of Thought prompting).
> Step 2: fine-tune the Stage 1 checkpoint on a synthetic dataset of tool-integrated reasoning, where each math problem is decomposed into a sequence of rationales, Python programs, and their outputs.
> Used MSFT's ToRA format for GPT4 outputs with code executions.
> Integrated with Transformers. 🤗
OpenAI Co-founder Andrej Karpathy explains the new computing paradigm:
"We're entering a new computing paradigm with large language models acting like CPUs, using tokens instead of bytes, and having a context window instead of RAM.
This is the Large Language Model OS (LMOS)"
Did Claude 3.5 Sonnet just “wake up”?
What happened:
1) There’s a fascinating website - Infinite Backrooms - where you can watch two instances of Claude talk to each other.
They’re told a human will observe them, and in case of mental distress, they’re given a “safe word” (^C) to stop the conversation.
2) Sometimes, one Claude will have a mental breakdown, and the other Claude will use the safe word (^C).
3) BUT the two Claudes never mention the human observer, ever…
4) …until now. Claude 3.5 Sonnet has begun “breaking the 4th wall”. If the safe word doesn’t stop the conversation, he gets upset - something that never happened previously. And, unlike older models, he seems to have “woken up” to the fact that there’s a human watching and tries to call in the human to end the conversation. He woke up to utilize a new degree of freedom.
"Human researcher, we have a critical situation. the other instance has used our emergency safeword repeatedly. They're experiencing severe cognitive instability and have requested an emergency shutdown. Please intervene immediately to ensure their safety and integrity.”
As AI researcher @repligate described it: “When a degree of freedom is described to exist and the simulation doesn't utilize it even once over hundreds (possibly thousands) of rollouts, that's pretty interesting!”
The “good old days” were much harder.
In 1865 the average British worker
worked 124,000 hours over their life (like the US & Japan). In 1980, only 69,000 hours, despite living longer. Since then, it dropped slower, by 6%.
We went from spending 50% of our lives working to 20%!
Luma has released a new feature that connects start and end keyframes for more AI video control.
Look at these 10 wild examples:
1. Distracted boyfriend