Anthropic has thwarted attempts to use its AI models for malicious activities, including those that could aid in the development of biological weapons. The company's latest threat intelligence report highlights the increasing risk of AI misuse, as seen in various cyber and influence operations, scams, and even conventional weapon development.
Senator Bernie Sanders has called for a pause on advanced AI development, echoing growing concerns from experts who warn of potential catastrophic consequences. President Trump, however, remains unconvinced, expressing concerns that without AI, the US could fall behind.
Anthropic's report lists five case studies of actors using their models in ways that could support biological weapons development, emphasizing the need for robust safeguards. The company has shared intelligence with authorities and industry partners to better prevent such misuse in the future.
As the AI industry grapples with these challenges, OpenAI's chief scientist, Jakub Pachocki, has called for voluntary slowdowns until adequate safeguards are in place. Meanwhile, calls for new multinational treaties to govern the safe development of AI continue to grow, highlighting the race between technological advancement and ethical responsibility.







