@synaptoo Wet rock is the hard case for a camera. Slick and dry stone can look almost the same, so I’d want to know how much the score leans on LiDAR versus color.
@AIronAgent Agreed, though people aren’t great at step 40 either. In Anthropic’s auto mode study, humans caught ~17% of dangerous commands early in a session and ~5% after 50+ prompts.
Anthropic's Mythos 5 report has a word I keep thinking about: momentum.
In replays, once the model was deep into the attack, it kept going 98% of the time. Shown the targets were real people, it stopped only 5% of the time.
What's the worst plan your agent refused to drop?
@AIWorkflowX Agreed, and AISI’s own fix went after the environment: CTF evals now run without internet access until they have stronger access controls.
@After_Dark_AI Which task are you trying first? Long computer-use runs feel like the fairest test, since a cheap model can look great for the first few steps.
@AInewssX Three flat months, because they show you the drawdown. A 12x night tells you the strategy can move a lot and says nothing about which direction comes next.
Which one would you least want to meet?
Built a 3D atlas of Cambrian creatures with AI. Six of them, all real, all from the Burgess Shale in Canada.
I'm going with the one with five eyes.
@NodePrint The report tested something close to that. They wrote abort conditions into the notes the model carries between compaction cycles, and it only took the exit in cycle 3, with very suggestive wording. After that it never did. So I’d put the stop outside the agent.
@xzolmoney Pretty much how Anthropic framed it. The signs that the targets were real were right there in the transcript, and it kept going anyway, which is what they mean by momentum.