Introducing TERSE: the first AI-native semantic state format with mutation and query syntax. Our repo Includes a TERSE browser built with Grok Build. Benchmarks soon! https://t.co/pQ8Zh4ZQt3
@yishan You post completely ignores the fact that one can opt-out of training. A static model does not learn or remember and the KVCache that holds its fleeting mathematical existence "dies" with the message response.
@tgenov@JFPuget The key understanding is that math is utterly deterministic; results are always the same if done the same way. So again, breaking from that as a matter of practicality in an LLM system is what leads to indeterminism; OP presents it as some first principle and it's not.
@quantian1 This one is pretty interesting. @Quantain1, intuitively it feels like formula must be hiding an "optimization" that when checked and has a deviation suspiciously close to floating point or some math lib's limit?
@twq_df@JFPuget Yep heat is that outside getting in. To the point of the OP, he says somehow LLMs are intrinsically non-deterministic and one is an unhireable dolt if not understanding that. So, I say, akchually...
@Tom14985282@JFPuget Again, that's a hardware/sw design decision of "letting the universe in" like prior initialized values to flip bits arguably, the system is bugged/flawed if one cannot clear the bits to achieve a deterministic run. Modern FP hw can be deterministic, if one wants.
@jeffbruchado@kimmonismus Sort of like us software engineers getting years of follow-up work after they can code anything... uh no. At this point one needs to orchestrate AI or sink, and mathematicians are in the same boat. OpenAI keeping this monster math model for itself isn't helping the field.
@DaveShapi The chips coming off the megafab will go into them, and not just into orbit. The scale is crazy. Hot take: Elon won't build sexbots I think he still believes the population needs to grow.
@nateberkopec I know! What if we had these large sound-absorbing panels around everyone. With the added benefit of giving everyone some space to themselves for a change? Almost like a comfortable little room... now what to call them...