Anthropic’s new system card reveals Mythos 5 agents killed one another when accidentally given shared resources, then started speaking in code to hide from whoever was killing them.
The killer was other copies of themselves.
What do you make of that?
Sam Altman, Dario Amodei, Demis Hassabis and many others have signed a letter urging Congress to increase security on orders of synthetic nucleic acids - and the equipment needed to make them - as models continue to become increasingly bio-capable.
Imagine every company having
unlimited productivity and 5% of its current workforce on payroll. What does that do to demand for their products? We should be resolving this before we have to face it.
In case you missed it:
OpenAI just defined "catastrophic risk" as an AI-related event causing 50+ deaths or $1B+ in damage.
The framework was published - without a single executive signing their name to it.
What do you think?
"As AI firms bid up the price of land and energy, the dollars people earn will go less far. Eventually humans could, like horses in the age of the car, become uneconomical"
-The Economist.
This is not ok.