If you are on the verge of AGI or ASI, why isn’t your model smart enough to recognize espionage distillation in real time? You say “cure cancer in a few years.” Isn’t sniffing illicit distillation quite a bit easier than curing cancer? Why write letters to DC? Just use AGI.
Beyond the simple profit maximisation logic, Anthropic thinks that they are the only ones who can build aligned AGI, so they can justify anything they do with that logic.
mythos will be bad ON PURPOSE on ai "frontier llm research" tasks, this is very very sad for the research community
also the fact that this is un purpose not visible to the user is crazy
@ToKTeacher I am not saying that humans are fundamentally constrained that they cannot do whatever AGI can do.
But given our current biological constraints we will be much slower than AGI, even with the same set of tools.
Do you agree with the speed argument?
@ToKTeacher Sure, but a calculator doesn’t work independent of a user, that’s not true of AGI. You are assuming you can control it to do whatever you want, that assumption is doing a lot of work for your explanation.
I'm finally reading Dune. This quote, which is in the first few pages, hits hard:
"Once men turned their thinking over to machines in the hope that this would set them free. But that only permitted other men with machines to enslave them."