@tunguz @somith007 This is actually what @karpathy usually says and what I noticed and fully agree. Just sit down, start building things and you will learn way more and way faster (of course some basics are actually needed).
New 3h31m video on YouTube:
"Deep Dive into LLMs like ChatGPT"
This is a general audience deep dive into the Large Language Model (LLM) AI technology that powers ChatGPT and related products. It is covers the full training stack of how the models are developed, along with mental models of how to think about their "psychology", and how to get the best use them in practical applications.
We cover all the major stages:
1. pretraining: data, tokenization, Transformer neural network I/O and internals, inference, GPT-2 training example, Llama 3.1 base inference examples
2. supervised finetuning: conversations data, "LLM Psychology": hallucinations, tool use, knowledge/working memory, knowledge of self, models need tokens to think, spelling, jagged intelligence
3. reinforcement learning: practice makes perfect, DeepSeek-R1, AlphaGo, RLHF.
I designed this video for the "general audience" track of my videos, which I believe are accessible to most people, even without technical background. It should give you an intuitive understanding of the full training pipeline of LLMs like ChatGPT, with many examples along the way, and maybe some ways of thinking around current capabilities, where we are, and what's coming.
(Also, I have one "Intro to LLMs" video already from ~year ago, but that is just a re-recording of a random talk, so I wanted to loop around and do a lot more comprehensive version of this topic. They can still be combined, as the talk goes a lot deeper into other topics, e.g. LLM OS and LLM Security)
Hope it's fun & useful!
https://t.co/75mXcUBI8L
@matteo_spada Actually, in the case of $9.99, you can still easily choose whether to buy or not. In this case, it feels more like targeting people who are not very tech-savvy or perceptive, leading them to default into a trap when they just want to skip.
Tons of questions!
- the Tesla app is built in React Native and uses Godot for 3D. There’s still native Swift & Kotlin layer on iOS and Android as appropriate.
- Godot primarily serves 3D functions, the rest of the logic is in the app layer.
- in addition to being Car & Renewable Energy nerds, we’re also 3D nerds too!
- we’re hiring! Our team is actively looking for app UX designers but https://t.co/jn2l2gmh8i has way more roles too. I’ll post out more software roles on my team in the future too.