A roadmap for safeguarding against AI bioweapons

In practice, a roadmap for safeguarding against AI bioweapons. Add Axios as your preferred source to.

Key points

• Just this week, Anthropic confirmed that Claude successfully designed protein binders against 14 targets – an notable step in the drug development process.
• "AI capabilities in biology are advancing really fast, but luckily most dangerous thresholds have not yet been crossed, " RAND lead author Steph Guerra informed me.
• Zoom in: Remember all of that talk regarding AI helping discover drug candidates?
• While there's already considerable debate regarding administration oversight and safeguards around frontier AI firms, RAND calls for more controls and a broad set of cross-industry cooperation.
• And though we all think of public health preparedness as a response to an outbreak, the report frames it as a form of deterrence.

Driving the news: A RAND report out this week outlines nine mitigation strategies targeting a range of actors who could employ AI to design and release a biological weapon.

It recommends protecting the same biological tools and datasets that are contributing to some of today's most exciting medical advances.

Notably, the major picture: The nine measures would prevent a large-scale AI-enabled biological attack by managing access to information that can fall into the wrong hands, disrupting access to the materials needed to produce a weapon, proactively detecting signs of misuse and deterring nefarious activity from occurring in the first place.

Part of the difficulty with AI's rapid advancement is it expands the field of players potentially capable of making a biological weapon, from lone wolves to state-backed actors.

Given the nature of the threat, "we need this layered system of mutually reinforcing approaches."

Zoom in: Remember all of that talk regarding AI helping discover drug candidates? Some of the technology enabling that work could turn dangerous in the wrong hands, Guerra informed me.

For context, a lot of the tools and biological data being generated by pharmaceutical firms and biotechs are proprietary, meaning access is already restricted.

Open-source biological tools and data are more concerning – including those emerging from academia and research institutes.

"Right now, data for biology is freely out there and open since biology. For discovery and saving lives. It's not warfare first, which is a good thing, " Guerra remarked. Yes, but: Restricting what's publicly accessible risks slowing down scientific progress.

"Let's build big moonshot projects and biodata factories that produce the data we need to cure diseases, but we can also create tiered systems of access so legitimate scientists are the ones who access the most misuse-relevant datasets, " Guerra informed me.

Meanwhile, the intrigue: The RAND team has been exploring how the employ of AI agents can produce biological developments more widely accessible, lowering the bar for the level of expertise needed to create bioweapons.

In a blog post, Anthropic acknowledged both the promise and the danger, noting that protein design and other research biology capabilities aren't available for general access in the company's most capable model.

"The uplift provided by the increasingly autonomous research capabilities of AI models will undoubtedly speed the development of human therapies and fundamental scientific discoveries, " the firm wrote.

But, it continued, "without robust safety measures, they could enable bad actors to perform dangerous research, such as the development of bioweapons."

For now, a roadmap for safeguarding against AI bioweapons remains the part of the story worth watching, and further updates are likely as more details are confirmed.