if it turns out that all math is ugly it’s kind of based how relentlessly humans seek beauty to the point of blindness. let it be that our machine descendants inherit this
If you had enough resources, you could run an LLM on a wooden system of gears and diesel power. It would be massive, but watching the gears and levers move, it would be evident that the outputs are not the result of a mind. Part of the illusion of LLMs is the tiny scale of GPUs.