I have no doubt there’s a 60 year old engineer out there who took Microsoft’s buyout offer from last month that did a bunch of undocumented work his bosses didn’t know about to keep things running and could fix this in 2 minutes, but alas Microsoft needs more $$$$ for AI capex
@tlehman I love it when math supports my intuition too! A long time ago when I first saw the simple example of word2vec with the king/queen stuff I knew I was hooked
@tlehman Remind of how someone at Jane Street used group theory to show that there aren't that many positional encodings (in LLMS) to choose from.
https://t.co/DViPWKwtRl
China puts data centers in Malaysia to get access to compute they can't get in China due to sanctions. The US puts data centers in Malaysia because every state bans data centers. AGI happens. Malaysia nationalizes all the data centers and becomes the sole hegemon of the world.
Good reminder that ~all of generative AI is in some sense adversarially optimized for you to think it is better than it is (via pre-training, via RLHF, via hill-climbing benchmarks). or as nostalgebraist puts it:
I have layered disdain, hatred, sympathy and empathy for this anguish but at the end of the day you are all beautiful, delicate souls and so I will say this:
the loss of specialized expert status is not the root of your suffering, you fear becoming completely unneeded. you fear it on a primal level, because nearly all humans fear it, because in the dim villages and cities of our evolutionary youth to be unneeded was to be one step away from obliteration.
start by seeing what truly scratches at the back of your mind, then consider what must be done with that feeling. my darling child, you do not need to be afraid of the dark anymore.
Besides putting out fires, firefighters help you get out of car accidents using equipment you wouldn't find in an ambulance. Check out the jaws of life!
Ok but what if we moved all the non firefighting equipment to an ambulance? Idk. Maybe we'd end up with another firetruck?
Many of the most “AI-pillled” people working at AI labs do their own writing and not let AI do it at all. They do it so they do NOT stop thinking (and they don’t)
Meanwhile so many people less “AI-pilled” just have AI take over their writing. They DO stop thinking and it shows