Building AI tools for real-world workflows. Exploring ML systems, LLM inference & Go backends. Focused on systems under load ... timeouts, batching, scheduling.
Trying to build my own LLM on a puny 8 GB RAM laptop. Already froze it during tokenization.
Wrote about the setup, mistakes, and progress so far ๐
https://t.co/iuWzijk2GZ
@Nishanttt05 Neo Vim with lazyvim plugins is a goto minimalist IDE for me. (Cant say for others ;-;)
Only things that Kept me in VS code were AI plugins, but everyone has a terminal based AI harness. So bye to vs code.
Started learning shell scripting after seeing all these AI-generated scripts for my local LLM tests, benchmarks, and runs.
Am I too late to step in now?