I built a GPT from scratch in PyTorch, trained on Kabir ke dohe. ๐ง
Tokeniser, self-attention, multi-head attention, transformer blocks, inference, all hand-written, no transformer libraries.
Wrote up the full journey in blog below along with Github :
I built a GPT from scratch in PyTorch, trained on Kabir ke dohe. ๐ง
Tokeniser, self-attention, multi-head attention, transformer blocks, inference, all hand-written, no transformer libraries.
Wrote up the full journey in blog below along with Github :
What if ISRO used AI to redesign their frontend?
I rebuilt it in one prompt using Cursor + fal ai MCP.
The workflow:
โ describe the vibe
โ fal ai generates assets on the fly
โ Cursor codes the whole thing.
@isro@cursor_ai@fal
-> you can find out the plots of movies and series by using NLP and some basic maths.
-> i used Word2Vec to create embedding of the content in "Game of Thrones" books.
-> found out the main plot of the series. (IFYKYK)