Anthropic blocked potential biological weapons efforts, company says
AI company Anthropic has revealed it blocked multiple attempts to use its AI models for developing biological weapons. The company detailed instances since late last year where it disrupted potentially malicious AI use, including one case where a lab outside the US accessed Claude to research a highly pathogenic bird flu variant and its potential transmission to humans. Anthropic has banned the associated user accounts, though it remains unclear if the users intended harm or were conducting legitimate research.
These revelations raise urgent questions about the potential for AI to be misused for dangerous purposes, highlighting the need for robust safety measures and oversight in AI development.
The episode also discusses a former AI researcher's warning that AI could kill all humans in a decade and growing calls for increased government oversight of AI, including a proposed AI kill switch bill.