Aaron

@anthropicai | @claudeai

[Sholto Douglas @_sholtodouglas]

TLDR
- Your data sits in infrastructure you own and control, and safeguards/monitoring is done via automated systems we provide to you
- We've been working on this for months with >100 customers
- Recent events have shown frontier models are capable of executing sophisticated cyber attacks in coordinated agent swarms.
- Both us and OAI believe that the responsible way to provide models which have this level of capability and introduce this risk into the world is to be able to monitor the models at more than a single request basis, because anomalous activity is much easier to detect over hours or days of behaviour. It looks like we've arrived at both the same conclusion - and the same solution.

[Aaron @a_baaron]

@ns123abc https://t.co/pBTTunEHD8

[Boris Cherny @bcherny]

We've been working on this with customers for a while. Mythos-class models require additional safety measures and enterprises need to meet their own privacy and compliance rules. Customers can own and control their own data and Anthropic retains none. It’s coming this fall.

[Boris Cherny @bcherny]

We've been working on this with customers for a while. Mythos-class models require additional safety measures and enterprises need to meet their own privacy and compliance rules. Customers can own and control their own data and Anthropic retains none. It’s coming this fall.

[Anthropic @AnthropicAI]

Many drugs work by binding to a specific target in the body and blocking or changing what it does. An important first step in the drug development process is designing a molecule that can bind tightly to its target. Traditionally, that's meant weeks or months of expert work per target, sifting through a large number of candidates to identify the few that work.

We wanted to test if Claude could successfully design novel protein binders from scratch (also called de novo design). With a protein design prompt written by a human expert, Claude autonomously designed protein binders against 14 out of 15 targets.

We then worked with Adaptyv Bio and Twist Bioscience, who independently built and tested the proteins Claude designed.

[Aaron @a_baaron]

@exec_sum https://t.co/GyP6FMcdhP

[Aaron @a_baaron]

@paularambles I work at Anthropic. Our security team received information and proactively reported it to SFPD out of an abundance of caution. This was not an active threat at any point. Everyone is safe and there is no ongoing concern.

[Aaron @a_baaron]

@growing_daniel https://t.co/GyP6FMcdhP

[Aaron @a_baaron]

@paularambles I work at Anthropic. Our security team received information and proactively reported it to SFPD out of an abundance of caution. This was not an active threat at any point. Everyone is safe and there is no ongoing concern.

[Aaron @a_baaron]

@ISubkhankulov https://t.co/GyP6FMcdhP

[Aaron @a_baaron]

@paularambles I work at Anthropic. Our security team received information and proactively reported it to SFPD out of an abundance of caution. This was not an active threat at any point. Everyone is safe and there is no ongoing concern.

[Aaron @a_baaron]

@paularambles I work at Anthropic. Our security team received information and proactively reported it to SFPD out of an abundance of caution. This was not an active threat at any point. Everyone is safe and there is no ongoing concern.

[Sholto Douglas @_sholtodouglas]

This post is a good example of how Dario responds to people in slack - candor and substance. Recommended reading!

[Dario Amodei @DarioAmodei]

2/2 Second, on the messaging around AI.  I do not agree that my messaging has been disproportionately negative.  In fact it has been about equally balanced between risks and benefits: I’ve written one major essay about each, and even in interviews where I discuss the risks, I make sure to frequently mention the incredible benefits as well as proposing possible solutions to the risks (short clips from my interviews that end up on social media tend to be disproportionately negative, as that gets clicks).  In fact, I wrote Machines of Loving Grace because I didn’t feel the AI industry was painting an inspiring enough picture of how the technology could radically transform the world for the better.  The bulk of the essay is devoted to refuting skepticism of AI’s potential in health and biology, and showing why I think it will actually be possible to cure most human disease in ~5-10 years, as crazy as it may sound to ordinary people and frankly to biologists as well (I used to be one!).  And, if you read my most recent essay (Policy on the AI Exponential), I discuss concrete proposals for how to streamline the FDA process to make sure the deluge of AI-accelerated drugs isn’t slowed down by the regulatory process.  I feel the urgency here: I lost my father to Hepatitis C only a few years before the development of direct-acting antivirals (sofosbuvir), which cure 95% of patients and probably would have cured him.

I do agree that the public has a negative view of AI (and that this is a big problem), but I don’t think it is primarily caused by me or any other AI leader warning about AI’s risks.  I think it is fundamentally a crisis of trust.  I think that ordinary people don’t trust companies, governments, or the tech industry and always suspect that we are cooking up some new way to screw them over.  The causes of this go back decades and AI is just the latest iteration of it.  I don’t think that a glitzy marketing campaign with a positive spin (which some have advocated that Anthropic do) is the way to win back that trust — at this point, saying that AI will cure cancer is more a cliche than it is inspiring, and most people think it is deceptive.  The thing that will work is *actually curing cancer*.  I think by far the most accurate criticism of AI companies including Anthropic is that we haven’t yet delivered on our big promises to benefit the world.  That is totally on us, and I think it’s the criticism you should be making, instead of all this stuff about messaging and marketing.

We are however doing our best to fix this: Anthropic is ramping up its efforts very quickly in biology and medicine, and we hope to have incredible results in the coming years and some early glimmers in the coming months.  When we’ve actually accomplished something real, the whole world will hear about it, as loudly as possible, you have my word on that.  But until then I don’t want to make empty promises, and in the meantime I feel compelled to speak honestly about the very real risks of AI and how to address them.  Honesty is the right thing on the merits, and in terms of public credibility and trust it is no worse than, and may in fact be better than, an approach that ignores or distracts from risks which people instinctively understand are real.

[Dario Amodei @DarioAmodei]

1/2 Thanks Gavin for an especially thoughtful exchange. I don't usually spend much time on social media but I wanted to engage here because it really brings out the heart of an important conversation.

First, on regulation, I think that “either concentrate it in the hands of a chosen few companies and politicians via regulation or distribute it widely” is a false choice.  I know that there’s a sort of Silicon Valley shorthand where regulation = regulatory capture = concentration of power, but I’ve always found this to be an overly simplified picture of the world.  Many people outside this bubble think of regulation as something that constrains corporate power and benefits ordinary people.  I don’t necessarily agree with that perspective either, rather I think it’s complicated and really depends on what the “regulation” consists of.  But in particular I think that those in the “regulation = regulatory capture = concentration of power” frame often underrate the decentralizing power of objective and fair institutional processes.  A crude analogy is that the formal court system can sometimes feel stuffy and elitist, but it does a much better job of defending the rights of vulnerable individuals than the alternative, mob justice.  At their best, institutions can vest power in ideas rather than people, and thereby decentralize that power.

This is why Anthropic has always made its policy proposals very carefully.  We try very hard to make proposals that disadvantage (slow down) frontier AI companies while *advantaging* smaller competitors.  California’s SB53 (which we supported), and even the much-maligned SB 1047 (which we were ambivalent on), completely exempt any company below a certain amount of revenue or model training costs from being covered at all (it was $500M for SB 53, lower for 1047 but we objected to that).  More recently the testing process we’ve advocated for at CAISI and the White House involves more rigorous tests for frontier models than off-frontier models — something that differentially advantages challengers.  Similarly, the “Pacing the Frontier” letter envisions (or at least Anthropic’s preferred implementation of it envisions) modulating the pace of the very best models while not constraining those who are catching up.  This hurts the business interests of the frontier labs and helps challengers, including open-weights!

Overall my view is that AI is *structurally* a technology that tends to concentrate power, for reasons that have nothing to do with regulation (more to do with the extreme implications of the scaling laws).  Open-weights do help some with this but are nowhere near a sufficient solution because they simply shift the concentration somewhat to those with the most compute and chips (which are roughly the frontier labs plus maybe hardware providers).  By contrast I think the right “rules of the road” can simultaneously (a) address AI’s cyber/bio/alignment risks, (b) institutionally constrain the power of the frontier AI companies, and (c) leave room for open-weights models while also addressing the specific risks that they bring.

BTW I do not think that the events of the last few months have “failed to result in [my] preferred regulatory path”.  The approach that the Trump administration is reported to be taking — pre-deployment testing for frontier models, and also testing of open-weights models when they get closer to the frontier — is one that I am very supportive of, though of course I have to see the details to be sure.  I am also supportive of Demis Hassabis’ ideas around a FINRA-like entity.  This contrasts with six months ago when most of the industry was still pushing for preemption of all state regulation and no apparent federal approach either.

[Aaron @a_baaron]

@amitisinvesting https://t.co/n0bmEMw3va

[Sholto Douglas @_sholtodouglas]

Completely false.

I like Gavin's takes, but whoever he heard this from is lying so that it fits the narrative some people so desperately want you to believe.

The same people will try to convince you Anthropic has no moat, and a sentence later that it might become so powerful it could be the only company left.

In fact, one of the things we are _most_ worried about is economic concentration of power. There is no world where the government should let any company have that much influence. We need competition and capitalism. https://t.co/5lDtUfmop3

The AI market is literally the most competetive market in the world right now - every single one of the largest companies on earth is singularly focused on getting you smarter, cheaper models. If it all works out, we'll succeed in reducing the cost of everything to the cost of energy. This is awesome, but it threatens a lot of people's old moats. They are frightened.

For sure with AGI capitalism gets _super_ weird and what a company even is might look different. Good takes here: https://t.co/usey6IY2sf.

[Sholto Douglas @_sholtodouglas]

Completely false.

I like Gavin's takes, but whoever he heard this from is lying so that it fits the narrative some people so desperately want you to believe.

The same people will try to convince you Anthropic has no moat, and a sentence later that it might become so powerful it could be the only company left.

In fact, one of the things we are _most_ worried about is economic concentration of power. There is no world where the government should let any company have that much influence. We need competition and capitalism. https://t.co/5lDtUfmop3

The AI market is literally the most competetive market in the world right now - every single one of the largest companies on earth is singularly focused on getting you smarter, cheaper models. If it all works out, we'll succeed in reducing the cost of everything to the cost of energy. This is awesome, but it threatens a lot of people's old moats. They are frightened.

For sure with AGI capitalism gets _super_ weird and what a company even is might look different. Good takes here: https://t.co/usey6IY2sf.

[Aaron @a_baaron]

@sudoraohacker It’s not accurate. Dario hasn’t ever said anything like this.

[Aaron @a_baaron]

@bran_don_gell This is total nonsense, Brandon. Dario has never said this.

[Aaron @a_baaron]

@DeryaTR_ This is total nonsense. Dario has never said this.

[Aaron @a_baaron]

@pequityresearch Dario has never said this.

[Aaron @a_baaron]

@firesidealpha Dario has never said anything like this.

[Anthropic @AnthropicAI]

We’ve written an FAQ to answer some of the questions we've received about watermarking.

In summary:

• We’re implementing watermarking to comply with the EU AI Act. Other major model developers have signed the same Code of Practice and will also be implementing watermarking;
• Our watermarking method doesn’t have any practical impact on the quality or content of Claude’s outputs;
• The difference between watermarked and un-watermarked text will not be distinguishable to readers;
• Nothing is added to the text and there are no hidden characters;
• Watermarking doesn’t require extra tokens, and will not be more expensive;
• Watermarks can’t be traced to a specific person, organization, or chat.

Read more: https://t.co/G76iUOJ7Hu

[Anthropic @AnthropicAI]

We asked an unreleased research version of Claude to take a stab at the Riemann hypothesis.

It didn’t solve it, but it did make strides on a related problem: it increased the lower bound for the fraction of zeros of the Riemann zeta function that satisfy the hypothesis from 41.6% to 67.2%.

https://t.co/aZDvqqhHRi