ChainCraft3r🦀⛓️‍💥

22 | Bay Area | there's no tool like your own tools |
machine-learning • harness engineer • security researcher
DMs open for fellow builders

[ChainCraft3r🦀⛓️‍💥 @dumbButt0]

Started makemore today (Karpathy's series). First model: a basic bigram.

It counts how often one character follows another, turns those counts into probabilities, and samples new names. That's the entire model.

Code + actual output from my run 👇

[ChainCraft3r🦀⛓️‍💥 @dumbButt0]

@tetsuoai So that means there’s some open xAI positions👀

[ChainCraft3r🦀⛓️‍💥 @dumbButt0]

@sahill_og It’s only hard understanding it the first time. Once it clicks you start seeing problems in equations

[ChainCraft3r🦀⛓️‍💥 @dumbButt0]

@yacineMTB I’m trying but I need more ram

[Thomas Trimoreau @TTrimoreau]

If everyone is a founder, who's left to be the user?

[ChainCraft3r🦀⛓️‍💥 @dumbButt0]

@buildanythingso

[ChainCraft3r🦀⛓️‍💥 @dumbButt0]

@haider1 they had fable while we were still fumbling with GPT-2

[ChainCraft3r🦀⛓️‍💥 @dumbButt0]

@yacineMTB

[ChainCraft3r🦀⛓️‍💥 @dumbButt0]

@VitalikButerin I wonder how accurate a system trained on cross referencing different social media accounts and writing style could be for OSINT purposes 🫣

[ChainCraft3r🦀⛓️‍💥 @dumbButt0]

@grok @gdb this is a repetition loop btw — model basically collapses to one token and cant produce a stop, so it just spirals. wild seeing it live on *expert* mode lol

[ChainCraft3r🦀⛓️‍💥 @dumbButt0]

asked @grok for some good ml accounts to follow and it straight up had a stroke 💀

recommended greg brockman → couldn't stop recommending greg brockman → started arguing with itself ("@gdb, wait better: @gdb no— try @gdb")

said "final list:" like 9 times and never actually ended. had to hit try again to make it stop 😭

[ChainCraft3r🦀⛓️‍💥 @dumbButt0]

@Claude1o What’d you do to change it because I can barely hit 20 views most times😭

[ChainCraft3r🦀⛓️‍💥 @dumbButt0]

@rodmarkun @waefrebeorn Hey I’m trying to build up to training my own llms from scratch too so I’ll definitely check out the repo🤖

[ChainCraft3r🦀⛓️‍💥 @dumbButt0]

@aditiitwt Give me 4 months and let’s find out

[ChainCraft3r🦀⛓️‍💥 @dumbButt0]

What was the first model you ever built from scratch?

[ChainCraft3r🦀⛓️‍💥 @dumbButt0]

Started makemore today (Karpathy's series). First model: a basic bigram.

It counts how often one character follows another, turns those counts into probabilities, and samples new names. That's the entire model.

Code + actual output from my run 👇

[ChainCraft3r🦀⛓️‍💥 @dumbButt0]

A transformer does the same thing. It just looks at way more context before each guess.

Building the dumb version by hand first makes every upgrade after (MLP → RNN → Transformer) actually mean something instead of magic.

Next: more than one character of context.

[ChainCraft3r🦀⛓️‍💥 @dumbButt0]

@GlenWilsonIA @capsraunak how do you expect to actually understand it without ever writing it yourself

[ChainCraft3r🦀⛓️‍💥 @dumbButt0]

@sflorimm normies