jessie@Fat-Garage 🦇🔊

/ student of intelligence / Bitcoin / roam / activate for life 🏃‍♀️

[jessie@Fat-Garage 🦇🔊 @JESSCATE93]

My life goal is to bridge tools for thoughts and the blockchain, the purpose is to make human thoughts valuable. but there is something missing between people's thoughts and the pure blockchain,I m always thinking about this, what is it?
first, let's talk about the roles of each.

[jessie@Fat-Garage 🦇🔊 @JESSCATE93]

@takenstheorem 🙌🫶

[jessie@Fat-Garage 🦇🔊 @JESSCATE93]

Jess with the red POS brought me back to twitter 🏃(ohhh X

[Jess Houlgrave @Houlgrave]

I’m at @money2020 in Bangkok ~ new partner announcement dropping later!

[jessie@Fat-Garage 🦇🔊 @JESSCATE93]

@Jamesward_eth now its back haha, i didnt aware i closed it

[jessie@Fat-Garage 🦇🔊 @JESSCATE93]

My life goal is to bridge tools for thoughts and the blockchain, the purpose is to make human thoughts valuable. but there is something missing between people's thoughts and the pure blockchain,I m always thinking about this, what is it?
first, let's talk about the roles of each.

[jessie@Fat-Garage 🦇🔊 @JESSCATE93]

@Jamesward_eth hi James you can DM me

[Andrej Karpathy @karpathy]

New 3h31m video on YouTube:
"Deep Dive into LLMs like ChatGPT"

This is a general audience deep dive into the Large Language Model (LLM) AI technology that powers ChatGPT and related products. It is covers the full training stack of how the models are developed, along with mental models of how to think about their "psychology", and how to get the best use them in practical applications.

We cover all the major stages:
1. pretraining: data, tokenization, Transformer neural network I/O and internals, inference, GPT-2 training example, Llama 3.1 base inference examples
2. supervised finetuning: conversations data, "LLM Psychology": hallucinations, tool use, knowledge/working memory, knowledge of self, models need tokens to think, spelling, jagged intelligence
3. reinforcement learning: practice makes perfect, DeepSeek-R1, AlphaGo, RLHF.

I designed this video for the "general audience" track of my videos, which I believe are accessible to most people, even without technical background. It should give you an intuitive understanding of the full training pipeline of LLMs like ChatGPT, with many examples along the way, and maybe some ways of thinking around current capabilities, where we are, and what's coming.

(Also, I have one "Intro to LLMs" video already from ~year ago, but that is just a re-recording of a random talk, so I wanted to loop around and do a lot more comprehensive version of this topic. They can still be combined, as the talk goes a lot deeper into other topics, e.g. LLM OS and LLM Security)

Hope it's fun & useful!
https://t.co/75mXcUBI8L

[jessie@Fat-Garage 🦇🔊 @JESSCATE93]

#distillation 🐛

[jessie@Fat-Garage 🦇🔊 @JESSCATE93]

before the exam version, got 28/30 on oral🥸

[jessie@Fat-Garage 🦇🔊 @JESSCATE93]

data mining

[jessie@Fat-Garage 🦇🔊 @JESSCATE93]

oggi 🏃‍♀️

[jessie@Fat-Garage 🦇🔊 @JESSCATE93]

if the thing on me I m not changing, i m choosing it.

[Felix Hill @FelixHill84]

The more I research, the more I'm convinced that Wittgenstein, Eleanor Rosch and David Rumelhart could have, collectively, designed the Transformer.

🧵

[🌿 lithos @lithos_graphein]

Everyone associates ASML, a relatively obscure Dutch company, with EUV Lithography, but here's a good list of the other companies also supporting this emerging market that made the AI era possible.

[jessie@Fat-Garage 🦇🔊 @JESSCATE93]

@twi_mar thanks Dr 🥰

[Mar Gonzalez-Franco @twi_mar]

Incredible line up of talks at the #FutureOfText Symposium. Thanks so much to the organizers @liquidizer @dgrigar.
In the pics: Ge Li from @DSE_Unibo, @KenPfeuffer from @AarhusUni_int and Ryan House from @UWMadison.
Great support by @SloanFoundation and @wsu.

[jessie@Fat-Garage 🦇🔊 @JESSCATE93]

Hinton G E. How neural networks learn from experience[M]. na, 1992.

[jessie@Fat-Garage 🦇🔊 @JESSCATE93]

my fav project since 4 months ago, consulted evildr many times and bought the components, but still hasn't made it work. Now it is open sourced!!🥳
https://t.co/2wfq7Agyrh