🚨Leave Netflix tonight.
Watch this 2 h 34 min Stanford class.
It's the clearest, most complete, and brutally honest explanation out there on how ChatGPT and Claude are really built.
From Tokenization and BPE to the Transformer architecture, the training pipeline, and the next-token decoder. No fluff. No marketing. Just the truth.
Doesn't matter if you've never touched a line of AI code or if you spend your days launching Agents: by the end, you'll suddenly connect a ton of pieces you've been trying to fit together for years.
The real core boils down to this:
How text turns into numbers the model can "eat" (BPE tokenization)
The sole mission of a language model: predict the next token
How the Transformer uses Attention so tokens can pass messages to each other
In training, the NLL loss pushes the probability of the entire sequence
In generation, the decoder builds the response token by token
The big-picture view that takes most people years to form… this class delivers it to you complete in one sitting.
Free up your time.
This could be, no exaggeration, the most valuable class you watch this month.
Andrej Karpathy:
"Prompting is going away.
Delete everything, keep Graph."
In 1 hour he shows how to build Graphs, and why it's the only thing that will be left standing at the end.
Anyone can build an agent, almost no one builds the Graph that runs them.
Watch it, then read the full guide on Graphs below.
There is significant unmet demand for developers who understand AI. At the same time, because most universities have not yet adapted their curricula to the new reality of programming jobs being much more productive with AI tools, there is also an uptick in unemployment of recent CS graduates.
When I interview AI engineers — people skilled at building AI applications — I look for people who can:
- Use AI assistance to rapidly engineer software systems
- Use AI building blocks like prompting, RAG, evals, agentic workflows, and machine learning to build applications
- Prototype and iterate rapidly
Someone with these skills can get a massively greater amount done than someone who writes code the way we did in 2022, before the advent of Generative AI. I talk to large businesses every week that would love to hire hundreds or more people with these skills, as well as startups that have great ideas but not enough engineers to build them. As more businesses adopt AI, I expect this talent shortage only to grow! At the same time, recent CS graduates face an increased unemployment rate, though the underemployment rate — of graduates doing work that doesn’t require a degree — is still lower than for most other majors. This is why we hear simultaneously anecdotes of unemployed CS graduates and also of rising salaries for in-demand AI engineers.
When programming evolved from punchcards to keyboard and terminal, employers continued to hire punchcard programmers for a while. But eventually, all developers had to switch to the new way of coding. AI engineering is similarly creating a huge wave of change.
There is a stereotype of “AI Native” fresh college graduates who outperform experienced developers. There is some truth to this. Multiple times, I have hired, for full-stack software engineering, a new grad who really knows AI over an experienced developer who still works 2022-style. But the best developers I know aren’t recent graduates (no offense to the fresh grads!). They are experienced developers who have been on top of changes in AI. The most productive programmers today deeply understand computers, how to architect software, and how to make complex tradeoffs — and who additionally are familiar with cutting-edge AI tools.
Sure, some skills from 2022 are becoming obsolete. For example, a lot of coding syntax that we had to memorize back then is no longer important, since we no longer need to code by hand as much. But even if, say, 30% of CS knowledge is obsolete, the remaining 70% — complemented with modern AI knowledge — is what makes really productive developers. (Even after punch cards became obsolete, a fundamental understanding of programming was very helpful for typing code into a keyboard.)
Without understanding how computers work, you can’t just “vibe code” your way to greatness. Fundamentals are still important, and for those who additionally understand AI, job opportunities are numerous!
[Original text: https://t.co/nqzPC6eUpR ]
Web Development is powered by APIs.
But learning APIs can be challenging.
Explore the secrets of learning API with The Complete API Guide.
→ Fundamentals of Rest API
→ Complete Guide for APIs
To get it, just:
1. Like & Retweet
2. Reply “𝗔𝗣𝗜”
3. Follow me (so I can DM)
This "AI Engineering" Book is Goat
But here’s the secret:
Its GitHub repo has a goldmine
Learn LLM apps, prompt engineering, fine-tuning, RAG & more.
To Get it:
1. Follow me (so I can DM you)
2. Repost
3. Comment "AI"
🟢 ¡APÚNTATE AL GTC 2025!
El próximo 17-21 MARZO volverá el gran evento de NVIDIA. Un montón de ponencia de IA, robótica y mucho más!
Y como cada año, quien se registre conmigo podrá conseguir un gran premio!
Todos los detalles en este hilo 👇🧵
We are excited to announce that we are open sourcing Unity Catalog—the industry’s first open source catalog for data and AI governance across clouds, data formats, and data platforms. https://t.co/xSi2iP3llz
Available on GitHub today
La IA acaba de matar a Excel.
Se acabaron las fórmulas complejas y los tutoriales de 10 horas en Youtube.
Aquí está la versión AI de Excel : (es 100% GRATIS!)
HILO 🧵
Big news: we've agreed to acquire @MosaicML, a leading generative AI platform. I couldn’t be more excited to join forces once the deal closes. https://t.co/L4TyrruUEU
#Optimizing#DeltaLake query performance? Partition tables on columns of low-cardinality, i.e. columns with a small number of unique values. Z-order tables on columns of high-cardinality. You can think of both as clustering similar data to improve file skipping during a query!
Termina el partido. El Kun Aguero se pone la camiseta de la selección y entra a la cancha con un bombo a celebrar con sus compañeros. Uno más de la Scaloneta. Más que un equipo, una familia.
Muy emocionado, chicos, por vivir este momento que ustedes hicieron posible junto a millones de argentinos. Pase lo que pase, ojalá que todo lo mejor, ya están en la historia y el corazón de todos. Vamos Argentina carajo! 🇦🇷❤️