we didn't know how to design a chip a couple months ago
so we reinvented Groq's LPU to run inference on @karpathy 's MicroGPT!
here's a breakdown of what we learned:
@richa_lq at some point it’s seems a trade off machine to me. give it a problem and it throws a list of trade offs at you, keeps you busy arguing with the list so you never actually reach a conclusion, and keeps burning tokens the whole time