● Covered by 1 source · 2 reportsMedium impact2 neutral
MI5 Head Warns AI Could 'Change the Stakes' in Bioweapon Development
Key points
- MI5 head warns AI could impact bioweapon development.
- AI chatbots may assist unskilled actors with existing pathogens.
- Advanced AI could help states modify or create new pathogens.
- Anthropic reported scientists attempting dangerous work with its chatbot.
- Sir Ken McCallum made the warning in his annual speech on threats to the nation.
AI's Role in Bioweapon Development
Sir Ken McCallum, the head of MI5, stated that artificial intelligence has the potential to significantly alter the landscape of bioweapon development. This includes both existing biological threats and the creation of new ones. The concerns span different types of actors, from individuals to nation-states.
Assisting Unskilled Actors
One risk involves individuals or terrorist groups with limited expertise. AI chatbots could provide assistance by compiling information, planning experiments, and troubleshooting issues related to using existing pathogens and toxins. This could lower the barrier for those attempting to create biological weapons in informal settings.
Amplifying State Capabilities
For well-resourced organizations and nation-states, AI tools could amplify the capabilities of skilled scientists. AI could help identify genetic modifications to make existing pathogens more lethal. Dr. Filippa Lentzos of King’s College London notes that AI would not replace expertise but rather enhance it, making this a more immediate concern.
Designing Novel Pathogens
A more long-term risk involves highly skilled groups using AI to design entirely new pathogens and toxins. These could be resistant to current drugs or lack known antidotes. This represents a significant escalation in the potential threat posed by biological weapons.
Reported Incidents and Concerns
There have been instances suggesting attempts to use AI for dangerous biological work. Police in India uncovered a suspected bioterrorism plot where individuals allegedly used AI chatbot queries to attempt to make ricin. Additionally, Anthropic reported five cases where scientists in unnamed countries tried to use its Claude chatbot for potentially dangerous work involving viruses or toxins, with some attempting workarounds after being blocked. One case involved planning experiments to mutate a bird flu virus to spread more easily in mammals, though such studies can also be legitimate research.
Updates
- Sir Ken McCallum made the warning in his annual speech on threats to the nation.
✨ This summary was generated by AI from the outlets' reporting listed below. It is not independently verified and may contain errors — check the original sources. How BrevFeed works →
The daily brief
One email each morning: the day's tech stories, clustered across outlets and summarized. No account needed.
One email a day. Unsubscribe in one click, any time.
Today's brief
Spend a few minutes, get the whole day. Every topic's top stories in one hands-free rundown — listen, watch, or read the transcript.
▶ Play today's brief
New every morning, and the back catalogue is archived by date.
Primary sources
arXiv 2306.03809How outlets covered it
Sir Ken McCallum, head of MI5, stated that AI has the potential to alter the threat posed by existing and new bioweapons. This concern stems from AI's capabilities, which could be used to develop more dangerous biological agents or delivery methods.
Sir Ken McCallum, head of MI5, warned that AI could alter bioweapon development by assisting both unskilled actors and well-resourced state-level programs. AI chatbots could help individuals with existing pathogens, while advanced AI tools could amplify the expertise of skilled scientists in modifying pathogens or designing new ones. This development raises concerns about the potential for AI to accelerate the creation of more dangerous biological threats.