@mjwelt@nicdunz That would be great, but I think it could actually use more compute because you’d lose the KV cache when switching models. They should look into cross-model KV-cache reuse
@RuleOfSaints I agree. They still have time, though. Just look at Grok: a week ago, almost no one could have guessed it would get this good. Meta is cooking too, and companies like PlayStation or Xbox already have the distribution, IP, user base etc
@13_narcissus Probably, but if agents write everything, we’ll end up with thousands upon thousands of loc. At that scale, is it even realistic for a human to review and understand it all?