⚡️ Excited to share that I am starting an AI+Education company called Eureka Labs.
The announcement:
---
We are Eureka Labs and we are building a new kind of school that is AI native.
How can we approach an ideal experience for learning something new? For example, in the case of physics one could imagine working through very high quality course materials together with Feynman, who is there to guide you every step of the way. Unfortunately, subject matter experts who are deeply passionate, great at teaching, infinitely patient and fluent in all of the world's languages are also very scarce and cannot personally tutor all 8 billion of us on demand.
However, with recent progress in generative AI, this learning experience feels tractable. The teacher still designs the course materials, but they are supported, leveraged and scaled with an AI Teaching Assistant who is optimized to help guide the students through them. This Teacher + AI symbiosis could run an entire curriculum of courses on a common platform. If we are successful, it will be easy for anyone to learn anything, expanding education in both reach (a large number of people learning something) and extent (any one person learning a large amount of subjects, beyond what may be possible today unassisted).
Our first product will be the world's obviously best AI course, LLM101n. This is an undergraduate-level class that guides the student through training their own AI, very similar to a smaller version of the AI Teaching Assistant itself. The course materials will be available online, but we also plan to run both digital and physical cohorts of people going through it together.
Today, we are heads down building LLM101n, but we look forward to a future where AI is a key technology for increasing human potential. What would you like to learn?
---
@EurekaLabsAI is the culmination of my passion in both AI and education over ~2 decades. My interest in education took me from YouTube tutorials on Rubik's cubes to starting CS231n at Stanford, to my more recent Zero-to-Hero AI series. While my work in AI took me from academic research at Stanford to real-world products at Tesla and AGI research at OpenAI. All of my work combining the two so far has only been part-time, as side quests to my "real job", so I am quite excited to dive in and build something great, professionally and full-time.
It's still early days but I wanted to announce the company so that I can build publicly instead of keeping a secret that isn't. Outbound links with a bit more info in the reply!
Did Open Science just beat @OpenAI? 🤯@kyutai_labs just released Moshi, a real-time native multimodal foundation model that can listen and speak, similar to what OpenAI demoed GPT-4o in May. 👀
Moshi:
> Expresses and understands emotions, e.g. speak with “french access”
> Listens and generates Audio/Speech
> Thinks as it speaks (textual thoughts)
> Supports 2 streams of audio to listen and speak at the same time
> Used Joint pre-training on mix of text and audio
> Used synthetic data text data from Helium a 7B LLM (Kyutai created)
> Is fine-tuned on 100k “oral-style” synthetic (conversations) converted with TTS
> Learned its voice from synthetic data generated by a separate TTS model
> Achieves a end-to-end latency of 200ms
> has a smaller variant that runs on a MacBook or consumer-size GPU. 🤯
> Uses watermarking to detect AI-generated audio (WIP)
> Will be released open source!!!
Demo: Coming later today (watch on @kyutai_labs )
Code: will be released
Models: will be released
Paper: will be released
IT'S FINALLY HERE!
🔥 Magnific Relight 🔥
In the beginning, there was darkness, and then it was said, "let there be Relight"... And there was light ✨ Transform the lighting of a any scene using a prompt, a reference img or a lightmap!
Info + tutorials + a HUGE surprise 🧵👇
The @EU_Commission finally ruled against Apple today. A lot of you have been asking for my take on what this means and what will – and won’t – change. I made a video with my thoughts including why this is a good first step, but also why there’s still more to be done.
🌟 Transforming Brand Narratives with the StoryBrand Framework & AI 🌟
I've created a GPT that merges one of my favourite books, Donald Miller's "Building a StoryBrand" with ChatGPT
https://t.co/ldzifbE98r
Introducing Dubbing Studio.
Our Dubbing Studio gives you precise control when translating your videos for global audiences.
We detect and label each of your speakers and create an editable script of your content. In the editor, you can update translations, change the timing, and regenerate the dialogue until the accent and tone are just right.
This builds on our existing dubbing feature which automates video localization across 29 languages.
Creative brainstorming just got a whole lot simpler 🔥
Here's how I use GPT as my personal creative assistant to generate highly styled, on-brand content!
If your CMO looks like the man on the left, the LTV model used to calculate ROAS is aggregated by more than 5 dimensions and re-trained weekly. If your CMO looks like the man on the right, you have an ad in the Super Bowl.
Nougat is now available in 🤗 transformers, so I improved the demo and released it 🍫
Check the demo out on Spaces 👉 https://t.co/3PeeAQGYjQ
Check out this 🧶 by @NielsRogge on how it works👉 https://t.co/sxdeKJekOc
What if we set GPT-4 free in Minecraft? ⛏️
I’m excited to announce Voyager, the first lifelong learning agent that plays Minecraft purely in-context. Voyager continuously improves itself by writing, refining, committing, and retrieving *code* from a skill library.
GPT-4 unlocks a new paradigm: “training” is code execution rather than gradient descent. “Trained model” is a codebase of skills that Voyager iteratively composes, rather than matrices of floats. We are pushing no-gradient architecture to its limit.
Voyager rapidly becomes a seasoned explorer. In Minecraft, it obtains 3.3× more unique items, travels 2.3× longer distances, and unlocks key tech tree milestones up to 15.3× faster than prior methods.
We open-source everything. Let generalist agents emerge in Minecraft! Welcome you all to try today: https://t.co/1d3YocozsI
Paper: https://t.co/JcWEasgtyI
Code: https://t.co/KsvVf7rcl0
Deep dive with me: 🧵
1/22 This is Svetlana Maniovich. She is your guide to the world of extreme Russian glamour. She radiates richness. Diamonds, furs, Rolls Royces - she has it all and more. In summer you can find her in St Tropez where she rents a villa for €150k/month, or on a yacht in Naples🧵
Buzzword salad warning but chatgpt + whisper + eleven labs + VR
Add some memory for past conversations and improve the lag and it’s over
I could see people just losing their lives to this
Just watch the video