@staysaasy There might be very rare but significant little things humans could beat ais at but we’ll never know because the ais take over the human’s prerequisites
Still don’t understand calling them key query value, too clean, it seems weirder to me “pick four matrices, doesn’t matter what numbers just toss em in, multiply one by two of the others, multiply those by each other, then multiply that output by the last matrix. Oh and make sure the first one represents tokens. Also make sure numbers don’t get huge. Now PUNISH THE MATRICES!” And it works??
Elon: I do everything, if you’re a supplier I want to replace you with my own company
Jensen: I want to do as little as possible, as much as necessary, if something can be done by someone else we’ll stop doing it and use them…
And both strategies work??
We could have a program/database indexed for codex such that I can tell it to “use my compute to do valuable novel research” and it actually does, in a way that isn’t redundant; many sessions from different people could be stitched together, arxiv et al should be working on this