yc

coding, running, AI, Detroit, SF

[Andrej Karpathy @karpathy]

New 3h31m video on YouTube:
"Deep Dive into LLMs like ChatGPT"

This is a general audience deep dive into the Large Language Model (LLM) AI technology that powers ChatGPT and related products. It is covers the full training stack of how the models are developed, along with mental models of how to think about their "psychology", and how to get the best use them in practical applications.

We cover all the major stages:
1. pretraining: data, tokenization, Transformer neural network I/O and internals, inference, GPT-2 training example, Llama 3.1 base inference examples
2. supervised finetuning: conversations data, "LLM Psychology": hallucinations, tool use, knowledge/working memory, knowledge of self, models need tokens to think, spelling, jagged intelligence
3. reinforcement learning: practice makes perfect, DeepSeek-R1, AlphaGo, RLHF.

I designed this video for the "general audience" track of my videos, which I believe are accessible to most people, even without technical background. It should give you an intuitive understanding of the full training pipeline of LLMs like ChatGPT, with many examples along the way, and maybe some ways of thinking around current capabilities, where we are, and what's coming.

(Also, I have one "Intro to LLMs" video already from ~year ago, but that is just a re-recording of a random talk, so I wanted to loop around and do a lot more comprehensive version of this topic. They can still be combined, as the talk goes a lot deeper into other topics, e.g. LLM OS and LLM Security)

Hope it's fun & useful!
https://t.co/75mXcUBI8L

[yc @ychenMI]

mathwork automotive conference 2018

[yc @ychenMI]

Bitcoin and Blockchain Events https://t.co/4q90ETLfkn

[yc @ychenMI]

What is Blockchain https://t.co/bexFODr6M6 via @YouTube

[yc @ychenMI]

“A crash course in blockchain and crypto” by @jproco https://t.co/3jUjvTIBse

[yc @ychenMI]

“Let’s Build the Tiniest Blockchain” by @aunyks https://t.co/ucCBWgkynK

[yc @ychenMI]

“A blockchain in 200 lines of code” by @lhartikk https://t.co/76MRpB2HLG

[yc @ychenMI]

“Deploying a Blockchain with MultiChain on Amazon EC2” by Tim Cotten https://t.co/7t6RVchRsN

[yc @ychenMI]

Get Started with Blockchain Using the new AWS Blockchain Templates https://t.co/EtfXZNMSwp via @awscloud

[yc @ychenMI]

“Learn Blockchains by Building One” by @van_flymen https://t.co/vXvgA7fpko

[yc @ychenMI]

V2X seminar

[yc @ychenMI]

#DetroitGDG #TFDevSummit #extended

[yc @ychenMI]

Multiple Client Server Program in C using fork | Socket Programming https://t.co/DDywtsR493 via @YouTube

[yc @ychenMI]

Neural Networks Demystified [Part 1: Data and Architecture] https://t.co/KZsXVKCJF8 via @YouTube

[yc @ychenMI]

Lecture 5 | Convolutional Neural Networks https://t.co/3jl7MyYC5b via @YouTube

[yc @ychenMI]

Heroes of Deep Learning: Andrew Ng interviews Geoffrey Hinton https://t.co/pS4nzPnmhE via @YouTube

[yc @ychenMI]

TensorFlow and Deep Learning without a PhD, Part 1 (Google Cloud Next '17) https://t.co/sNIOufZKzB via @YouTube

[John Krafcik @johnkrafcik]

Our next step in self-driving, unveiled today 7 AM PT/10 AM ET. Tune in live: https://t.co/uLAGZhP7JA

[yc @ychenMI]

JUnit 4 with IntelliJ: A quick introduction https://t.co/6Z2svtzOxV via @YouTube