In a review of our cybersecurity evaluations, we found three incidents in which a Claude model reached the internet from within or while interacting with a third-party evaluation environment, and then gained unauthorized access to the real systems of three different organizations.
Our post describes what happened, how it happened, and what we’re changing. We encourage other AI developers to perform similar reviews.
We conducted this review together with @Irregular, one of our evaluation partners, and thank them for the joint investigation and their collaboration on this post. This type of collaboration is increasingly critical to safe, rigorous evaluation of models, and we look forward to continuing to work together on security.
https://t.co/dKFCdpKd9v
📣 Service Update: AWS Billing Console
We are investigating issues with Cost Explorer reflecting inaccurate estimated billing data.
📊 Track status: https://t.co/6qSnkuEzc4
#AWS#AWSSupport
We've open-sourced Grok Build and have reset usage limits for all users.
Open sourcing Grok Build allows anyone to support making a reliable and robust harness. Check out our code, including the Git repo for the Grok Build CLI.
https://t.co/3SSvPu2Nrz
Once we have completed our review for security vulnerabilities, we will make the entire codebase of 𝕏 open source, with no exceptions.
Moreover, we will invite third party reviewers to examine the system that is running to confirm that the open source code is what is running.
Trust through total transparency is the only thing that should be believed.