It’s great to see AI leaders like Sam Altman, Dario Amodei, and Demis Hassabis calling for mandatory DNA synthesis screening, which is a no-brainer policy for preventing (AI-enabled) bioterrorism.
But fewer than 50 people in the world currently work on DNA security full-time.
We need a comprehensive plan and at least 5x as many people to secure the DNA supply chain before AI and biotech outpace us.
@jtmonrad and I spent the past two years developing a field strategy for how to do it.
Successfully defending against this risk (while still capturing innovation benefits) requires four things:
1. Coverage: More than 80% of synthetic DNA providers screen both orders and customers
2. Strategic ambiguity: a bad actor can’t easily tell which providers will screen their order
3. Access: legitimate customers can still order DNA cheaply and easily
4. Effectiveness: 90% of providers reliably catch dangerous sequences when red-teamed
We’re already seeing real momentum. Many DNA providers screen voluntarily, and governments in several countries are moving toward mandates. But that doesn’t mean the problem will be solved in time by default.
Our guide lays out exactly which projects we need to launch. We’re looking for founders, operators, and technical experts to own pieces of the solution. We’re also hiring a Senior Program Officer at Sentinel to drive this work. Get in touch if you or someone you know would be a strong fit! (links for EOI form and JD below)
Read our full field strategy in @IFP's Launch Sequence: https://t.co/zzTYZaFMoM
No one should be able to order a bioweapon through the mail.
@IFP & @JoinFAI are proud to co-lead an open letter calling for mandatory DNA synthesis screening & recordkeeping.
Signatories include:
- Sam Altman, CEO & Co-Founder, OpenAI
- Dario Amodei, CEO & Co-Founder, Anthropic
- David Baker, Director, Institute for Protein Design; 2024 Nobel Prize in Chemistry recipient
- Patrick Collison, CEO & Co-Founder, Stripe
- Paul Graham, Founder, Y Combinator
- Demis Hassabis, CEO, Google DeepMind; 2024 Nobel Prize in Chemistry recipient
- Emily Leproust, CEO & Co-Founder, Twist Bioscience
- Lawrence Lessig, Roy L. Furman Professor of Law and Leadership, Harvard Law School
- Gerald W. Parker, former Special Assistant to the President for Biosecurity and Pandemic Response
- Mustafa Suleyman, CEO, Microsoft AI
- Alex Tabarrok, Professor of Economics, George Mason University
- Alexandr Wang, Chief AI Officer, Meta; Founder, Scale AI
- Christine E. Wormuth, President & CEO, Nuclear Threat Initiative; 25th Secretary of the Army
Read the letter and see the full list of signatories: https://t.co/BwZiJXw3JT
Many DNA synthesis companies voluntarily screen orders to mitigate biosecurity risks, but no law requires them to do so.
Leaders in AI, biotech, life sciences, national security, and the nucleic acid synthesis industry agree that Congress should act to strengthen safeguards against biological threats.
@deanwball put it well in the WSJ:
“If you’re synthesizing the stuff that yields biological life and viruses, we’re asking you to screen to see whether it is dangerous in some way. That seems like a reasonable thing for society to insist upon.”
In case you missed it: our Executive Director, @JacobSwett, and several GlycolISER grantees were featured in Vox about their efforts to evaluate glycols as a potential pandemic countermeasure.
Learn more about this exciting work⬇️: https://t.co/lZqbHYZufw
At @IFP, we’ve spent the past 3 years thinking about all the different ways the US government & philanthropy fund R&D.
Until now, R&D funders haven’t had a systematic way to match the innovation problem to the right funding tool.
We built THE ATLAS OF INNOVATION to fill that gap.
https://t.co/XZshJ7pr1f
Alongside @UChi_MSA, we’ve boiled down thousands of hours of research into a handful of questions covering how much the R&D funder knows about:
- the problem they want to solve
- the solution it should have
- the team that should build the solution
Why the Atlas matters:
The US government spends close to $200 billion every year on R&D. And after the Anthropic and OpenAI IPOs, there will be hundreds of billions of dollars in new philanthropic giving.
Choosing the correct funding approach to the social problems they’re trying to solve will mean the difference between success and failure.
For example, NSF research grants have helped seed breakthroughs from MRI machines to search engines, but grants aren’t built to deliver the kind of industrial speed and scale that a project like Operation Warp Speed required.
Picking the wrong funding approach can leave programs behind schedule, over budget, or without anything to show for all the money they spent.
How we built the Atlas:
1. We began by creating a matrix of dozens of considerations that a thoughtful policymaker or funder would ideally weigh before deciding how to fund a project.
2. We looked at every major funding approach, from grants to R&D tax credits to advance market commitments, analyzing when they work well and when they fail to meet the mission.
3. We spent months deep in the weeds of contract theory and incentive design, looking at historical examples and the state-of-the-art research in innovation economics.
4. We then worked to turn that research into a tool that time-strapped policymakers and philanthropic funders could rely on at the start of an innovation funding cycle.
5. Three years later, we are launching just that: a new (and visually stunning) website to help funders decide how to best incentivize innovation. And all they have to know… is what they currently know about their innovation goal! The Atlas takes care of the rest.
How to navigate the Atlas:
Answer questions about your goal to find the funding approach aligned with the information you have.
Each funding mechanism has its purpose for particular technologies and specific moments in development.
There shouldn’t be an ARPA for every field, just like we don’t need a prize or AMC for every innovation. The Atlas helps you navigate those tradeoffs.
Thanks to Camus, the boulder & the absurd get all the attention.
I prefer Stephen Fry's take: just as Sisyphus believed he could escape death (and did!), he believes he'll complete this and be free.
It's a story of cleverness & tenacity of humanity against the 'natural order'.
Three disease outbreaks. Three countries. Three epidemics prevented.
Last year El Salvador, Gabon and Thailand contained outbreaks of malaria, mpox and cholera before they spiraled into epidemics. In a new video, we hear from the health care workers involved about how they acted quickly to stop diseases from spreading using the 7-1-7 target for outbreak detection and response and saved lives.
You can read the full stories in our new Epidemics That Didn’t Happen report, launched today at #WHA79: https://t.co/IpuJrn8dMq
I'm still not super worried about a hantavirus pandemic, but there's also no technical reason this shouldn't be the standard timeline for new threats:
~Hours: definitive confirmation via sequencing
~Days: candidate mRNA vaccine designs
~Weeks: millions of vaccine doses
@KumarAGarg@nanransohoff@AGamick@emiyazono So many gems in here from the regranting stigma to the narrow conception of nonprofits to the need to let the bottlenecks drive the mode of impact to the really excellent history!
With @nanransohoff's GM piece, @AGamick's solving piece, and @emiyazono's field strategist piece, there's basically a new playbook on solving the world's hardest problems: scope it, own it, fund it to the finish (links below).
Recommend you read them all!
This tweet is making a separate point, but the analogy to fire is apt (its also a general purpose technology) and I think few people appreciate that the cost of fire (much of which is the cost of preventing it) has often been >2% of GDP, with some estimate having it higher.
caveman 1: fire will burn the earth. we cannot control it. deaths from the freezing cold are part of the natural order.
caveman 2: no, fire will be incredible, and nothing bad will ever come from it. we must build a giant, eternal fire!
(fog dissipates) wise elder caveman 3: we must weigh the risks and opportunities of fire. it is like berries: some poison us, others nourish us. wisdom lies in learning the difference, and cultivating what is good.
*wild, thunderous applause from onlookers*
On this point about "strategy and execution being two largely non-overlapping skillsets, and can be done by different people", I think this can work when you can transfer all the knowledge from the strategy to the execution. We try to do this through comprehensive blueprints/roadmaps that make the agenda to execute legible to everyone.
Solving matters, but CFCs are an instructive example. The Montreal Protocol solved ozone depletion. But ozone depletion existed because Midgley first “solved” refrigeration with CFCs. Sometimes “working on” a problem (mapping systems, failure modes, externalities) is part of making sure you're solving the right problem at the right level.
This was a great post! It gives helpful data on navigating the current inevitability of infections.
I hope that one day though we look back on strategies like this the way we now look back on variolation and smallpox exposure timing: necessary, but now obsolete!
Avoiding infections is good 👍
But some simply cannot be avoided - multiple exposures over the life course is inevitable
In which case, when is the best time to get infected for the first time? 🤔
https://t.co/I192fFovQn
I’m a disbeliever in accidental discoveries (at least, in biology). Whenever I’ve looked into one, the story turns out to be false.
The most famous is penicillin – supposedly, the fungi wafted in through a window, fell into a petri dish of cultured staphylococci, and suppressed the bacteria’s growth.
But in a recent article (https://t.co/s99LBvhZkY), @kevinsblake explains that doesn’t really work (grown staphylococci aren’t affected by penicillin; it only works if introduced before the bacteria begin growing); plus, Fleming’s notes on the discovery provide very little detail and the specific results he described couldn’t be replicated by other scientists (even though penicillin does work against staphylococci when introduced correctly.)
There are more: Pasteur’s supposedly accidental discovery of a chicken cholera vaccine was more likely the result of systematic work by his then-assistant, Émile Roux. (https://t.co/GzhMmBxPQv)
And, as @NikoMcCarty writes, the discovery of GFP, nanopore sequencing, and optogenetics are also often described as accidents, but none of them happened that way either. https://t.co/0qeStnCNPT
People love serendipity, so why am I bursting their bubble?
I don’t think this is limited to accidental discoveries; I think many historical science anecdotes are highly embellished:
- Edward Jenner didn’t deliberately expose a young boy with full-blown smallpox to test his vaccine (he used variolation); and he wasn’t the first to try using cowpox https://t.co/tPg9k6DqO7
- Cobra catching bounties in British India didn’t lead to a rise in the number of snakebites, and there was only hearsay evidence that cobras were bred in response at all https://t.co/fuXEL49nu2
- Barry Marshall didn’t develop stomach ulcers from drinking a concoction of H. pylori (he did develop gastritis though…) https://t.co/WwG23fkIbI
- No one knows who actually found the highly-productive strain of penicillin on a cantaloupe, but it probably wasn’t 'Moldy Mary' https://t.co/u8q2U4i386
But in this case it irks me for an additional reason – it gives the impression that innovation happens sporadically, by chance, when there are actually ways that we can systematically speed it up – such as better funding, institutions and incentives.
So: are there any true accidental discoveries that hold up to scrutiny?