we took the prompt that led a Mythos 5 agent to the original ART discovery and re-ran it over and over on other Claude models.
It's fascinating to watch their personalities come out.
Mythos 5 is disciplined and quietly excited. Opus 5 is over-the-top and tends to bask in the glory of a eureka moment.
Today we’re sharing some case studies of threat actors attempting to use Claude for malicious activity, including developing biological weapons. This is the first time any private company, to our knowledge, has publicly shared evidence of potential misuse of their platform for biological weapons development.
Our goals are to enable the professional, legitimate life sciences research done with Claude, realize the incredible beneficial impacts for human health and medicine, and ensure that every AI platform is able to recognize and prevent misuse.
Sophisticated, state-affiliated actors don’t tell Claude “I’m from adversarial nation X, build me a bioweapon.” They deliberately mask their origin and go to extreme lengths to obfuscate their intent and make their requests seem benign. When we detect and disrupt them, they route traffic to models with more permissive safeguards. Some attempts are easier to detect, like attempts to engineer viruses to infect humans or spread more efficiently.
Our Life Sciences Verification Program is designed to enable beneficial research and prevent harmful use cases. We know our bio safeguards are not perfect, and can be a source of major frustration for professional researchers, but we are iterating constantly to make them better at preventing misuse and to improve the user experience for legitimate research.
https://t.co/EiByFLjHTk
Finally, we’ve improved our safeguards. Our cybersecurity safeguards now flag benign requests about 60% less often.
On basic biology and medical questions, we’ve recently reduced the fallback rate by around 85%.
We're launching the Life Sciences Verification Program in partnership with US government so life sciences professionals can use Mythos 5.1 with safeguards designed for R&D.
We have enrolled our first participants and plan to expand this program to the broader life sciences community as quickly as we can.
The @USArmy has awarded Radiant $750 million to deliver 15 Kaleidos microreactors through the Janus program, one of the largest contracts @DIU_x has issued to date.
The Army launched the Janus Program to strengthen the energy resilience of military installations and mission-critical infrastructure. Radiant was chosen after extensive evaluation of reactor design, technical maturity, manufacturing readiness, deployment strategy, and commercial viability. Radiant’s 15 microreactors will enable the Army to deploy nuclear power across multiple locations. In tandem, the operational data acquired through the Program will accelerate commercial deployments across a global footprint of commercial customers.
Learn more: https://t.co/NFxRI0Rv12
Breaking News: Scientists have used A.I. to create new viruses for the first time, raising hopes for medical advances while also raising the possibility that the technology could someday be used to invent dangerous pathogens. https://t.co/MJG4mp0TTb
@lpolovets When I was in grad school I hung with the cybersecurity grads & one of them interned at a company doing threat intelligence & he just pulled out this massive map of all the undersea cables connecting the world & said ‘we’re lucky no one is motivated enough yet to cut these’
@scootykins A decently-sized mountain town (57k pop), MSU- academics/industry, major airport with direct flights 18min away. Great schools/arts/comedy/music/nature. I work in self-driving & there are tech offices here like Aurora/May Mobility/Oracle/Onyx. It’s most similar to Boulder, CO
I’m in a tiny village in the Ennedi Desert of Chad on a climbing expedition & @Starlink connecting the world over here from a grass hut with some solar panels
@helloitslynne I’ll often ask ‘hey, on a scale of 1-10 how much do you care about this?’ Both people blurt out an answer & really helps calibrate decision-making. Dated a vegan (lonnnng ago) & asked how much he cared that I ate meat. I was a 3, he was a 9. So I was veggie for that relationship