Very proud that CommandBar is now sponsoring the Dwarkesh podcast (together with Stripe and v7 labs)
@dwarkesh_sp delivers probably the highest signal to noise in AI and tech generally. AND is exactly the same person privately as you see in the pod -- thoughtful, kind, diligent, ambitious.
🫡
Here's our V3 update to @stateofai Compute Index in collaboration with the team at @ZetaVector.
You'll now find updated counts of AI research papers using chips from NVIDIA, TPUs, ASICs, FPGAs, and AI semi startups, as well as updates to H100 clusters.
My observations ⬇️
With many 🧩 dropping recently, a more complete picture is emerging of LLMs not as a chatbot, but the kernel process of a new Operating System. E.g. today it orchestrates:
- Input & Output across modalities (text, audio, vision)
- Code interpreter, ability to write & run programs
- Browser / internet access
- Embeddings database for files and internal memory storage & retrieval
A lot of computing concepts carry over. Currently we have single-threaded execution running at ~10Hz (tok/s) and enjoy looking at the assembly-level execution traces stream by. Concepts from computer security carry over, with attacks, defenses and emerging vulnerabilities.
I also like the nearest neighbor analogy of "Operating System" because the industry is starting to shape up similar:
Windows, OS X, and Linux <-> GPT, PaLM, Claude, and Llama/Mistral(?:)).
An OS comes with default apps but has an app store.
Most apps can be adapted to multiple platforms.
TLDR looking at LLMs as chatbots is the same as looking at early computers as calculators. We're seeing an emergence of a whole new computing paradigm, and it is very early.
New podcast: How to Open Source Finance
Numerai founder Richard Craib chats with Jim O'Shaughnessy on Infinite Loops about his path to starting Numerai, data and LLMs, and the master plan.
https://t.co/Z3ryY24rnm
ChatGPT is a statistical representation of things found on the web, which will increasingly include ITS OWN output (directly and second hand).
You post something picked up from it & it will use it to reinforce its own knowledge.
Progressively a self-licking lollipop.
Enjoy
#AI
The Input v24 is out:
🎤 #AI Drake goes viral
🤖 A glimpse of intelligence: #AutoGPT is blowing people's minds
🗿 @awscloud launches #Bedrock to make models more accessible
📺 @GoogleAI takes over @60Minutes
https://t.co/YElQrmVloi
The Input v22
💫 @OpenAI 's #GPT4 is out
🏞 @runwayml and @unity release next-gen visual #AI
👋 @midjourney can finally do high fives
🛡 @UChicago helps protect artworks in the age of AI
https://t.co/RpikqIeFLi
Welcome to the portfolio, @Mill! 🎉
Co-founded by @MattLRogers and @htannenbaum, Mill is tackling food waste with a new system that is better for kitchens and the planet — https://t.co/HboFqY83SJ
Thrilled to welcome Nobel laureates Jennifer Doudna, David MacMillan, Paul Nurse & Venki Ramakrishnan to the @IsomorphicLabs Scientific Advisory Board! Excited for the expertise these visionaries bring to our mission to reimagine drug discovery with AI: https://t.co/E74xAzjZqP
One of the #generativeAI experiments the team at @NiceOutside_co did last year 🖤 super excited about what's in the pipeline for 2023!
https://t.co/iPO4dq2GB4