ishan_

Ask me about .go, .ts, .sol, .rs

[ishan_ @_ishankumar_]

Front End Developer Roadmap ( 9 months )
🧵
Bookmark this for the future, comment your views.

Have fun ✅🌐

[ishan_ @_ishankumar_]

@vanyaSile Use ethernet

[ishan_ @_ishankumar_]

Neuron activation

[ryan 🤿 @scubaryan_]

I’m crying lil bro instantly sat up and locked in after seeing Megan Fox in Transformers 😭

[ishan_ @_ishankumar_]

@abhisheknaironx Bookmarking this now. Get back with results after 30 days of applying to each

[ishan_ @_ishankumar_]

Wtf this is so good and detailed.

Ggs 👏

[Ahmad @TheAhmadOsman]

> be you
> want to actually learn how LLMs work
> sick of “just start with linear algebra and come back in 5 years”
> decide to build my own roadmap
> no fluff. no detours. no 200-hour generic ML playlists
> just the stuff that actually gets you from “what’s a token?” to “I trained a mini-GPT with LoRA adapters and FlashAttention”

> goal: build, fine-tune, and ship LLMs
> not vibe with them. not "learn the theory" forever
> build them

> you will:

> > build an autograd engine from scratch
> > write a mini-GPT from scratch
> > implement LoRA and fine-tune a model on real data
> > hate CUDA at least once
> > cry
> > keep going

> 5 phases
> if you already know something? skip
> if you're lost? rewatch
> if you’re stuck? use DeepResearch
> this is a roadmap, not a leash
> by the end: you either built the thing or you didn’t

> phase 0: foundations

> > if matrix multiplication is scary, you’re not ready yet
> > watch 3Blue1Brown’s linear algebra series
> > MIT 18.06 with Strang, yes, he’s still the GOAT
> > code Micrograd from scratch (Karpathy)
> > train a mini-MLP on MNIST
> > no frameworks, no shortcuts, no mercy

> phase 1: transformers

> > the name is scary
> > it’s just stacked matrix multiplies and attention blocks
> > Jay Alammar + 3Blue1Brown for the “aha”
> > Stanford CS224N for the theory
> > read "Attention Is All You Need" only AFTER building mental models
> > Karpathy's "Let's Build GPT" will break your brain in a good way
> > project: build a decoder-only GPT from scratch
> > bonus: swap tokenizers, try BPE/SentencePiece

> phase 2: scaling

> > LLMs got good by scaling, not magic
> > Kaplan paper -> Chinchilla paper
> > learn Data, Tensor, Pipeline parallelism
> > spin up multi-GPU jobs using HuggingFace Accelerate
> > run into VRAM issues
> > fix them
> > welcome to real training hell

> phase 3: alignment & fine-tuning

> > RLHF: OpenAI blog -> Ouyang paper
> > SFT -> reward model -> PPO (don’t get lost here)
> > Anthropic's Constitutional AI = smart constraints
> > LoRA/QLoRA: read, implement, inject into HuggingFace models
> > fine-tune on real data
> > project: fine-tune gpt2 or distilbert with your own adapters
> > not toy examples. real use cases or bust

> phase 4: production

> this is the part people skip to, but you earned it
> inference optimization: FlashAttention, quantization, sub-second latency
> read the paper, test with quantized models

> resources:

> math/coding:
> > 3Blue1Brown, MIT 18.06, Goodfellow’s book

> PyTorch:
> > Karpathy, Zero to Mastery
> > transformers:
> > Alammar, Karpathy, CS224N, Vaswani et al
> > scaling:
> > Kaplan, Chinchilla, HuggingFace Accelerate
> > alignment:
> > OpenAI, Anthropic, LoRA, QLoRA
> > inference:
> > FlashAttention

> the endgame:

> > understand how these models actually work
> > see through hype
> > ignore LinkedIn noise
> > build tooling
> > train real stuff
> > ship your own stack
> > look at a paper and think “yeah I get it”
> > build your own AI assistant, infra, whatever

> make it all the way through?
> ship something real?
> DM me.
> I wanna see what you built.

> happy hacking.

[ishan_ @_ishankumar_]

@thenanyu Love the Backend Engineer Role, but unfortunately there's no option for "I live in Asia but I could work in PST" 🫠

[ishan_ @_ishankumar_]

So about the career update: I got rejected

But learnt a lot lol :p

[ishan_ @_ishankumar_]

@jacques_web3 Someone's gonna write a script to scrape a post, get a suitable reply via Grok and reply to that post as well lol

[ishan_ @_ishankumar_]

@TonyCatoff Happy birthday tony!!

can confirm nothing's better.

[ishan_ @_ishankumar_]

Day 14/100

trying to just finish off the syntax mug-up in rust wrt vectors, .collect(), .map(), .filter() today.

gonna be interview ready soon haha

[ishan_ @_ishankumar_]

Day 13/100

Still grinding rust
Async rust, to be precise

[ishan_ @_ishankumar_]

@vanyaSile That's why i asked if it was for free 🤣

[ishan_ @_ishankumar_]

@I_am_prathik @TonyCatoff @Starknet @ActualOnexyz @0xOutpost @apoorav_vyas Fs looks like so much fun
Wish i could be there lol 😆

[ishan_ @_ishankumar_]

@Nnvve9 "AI, Make me $100M ARR startup. Fast, no bugs" vibe fr

[ishan_ @_ishankumar_]

@vanyaSile For free?

[ishan_ @_ishankumar_]

Day 13/100

Got accepted into the next round(tech.)

Learnt Arc, RefCell, Rc, Box in Rust. Took some time to read all of em from The Book itself. Insightful...

[ishan_ @_ishankumar_]

Day 12/100

Found a new way to get GPT to explain stuff to me
deref coercion btw:

[ishan_ @_ishankumar_]

Day 11/100

A BIG UPDATE coming soon 👀👀
In the meantime, I'm grinding The Rust Book. Ownerships, Lifetimes and Atomic ops.
#buildinpublic

[ishan_ @_ishankumar_]

@vanyaSile @Hiteshdotcom @piyushgarg_dev Keep up the consistency!
See you at the other end.

[ishan_ @_ishankumar_]

@forloopcodes @OpenAI damn, congrats!