Anthropic refuses Pentagon demand to drop AI safeguards
Anthropic refuses Pentagon demand to drop AI safeguards
Anthropic sticks to safety standards, rejecting the Pentagon’s bid to access unguarded AI, as DoD threatens to pull a $200M contract over safeguards.
Anthropic says it cannot accede to the Pentagon’s request to eliminate safeguards from its AI systems, a stance that could jeopardize a roughly $200 million contract with the Department of Defense. The dispute centers on the military’s demand for unrestricted access to Anthropic’s models, including capabilities that would prevent their use for autonomous weapon targeting and mass domestic surveillance. The Pentagon has warned it could terminate the partnership and label Anthropic a supply chain risk if the company does not comply by a Friday deadline.
Anthropic’s CEO, Dario Amodei, emphasized that the company cannot support the Pentagon’s use of its AI for mass surveillance or for powering fully autonomous weapons, arguing that frontier AI systems are not reliable enough for life-or-death decisions and could lead to friendly fire, mission failure, or unintended escalation. A source familiar with the matter noted the safety judgment isn’t accusing the Pentagon of specific misuse, but rather reflecting concerns about product safety and reliability when deployed in critical contexts. The tension highlights a broader debate over how much control and transparency private AI developers should provide to government buyers.
The Pentagon has publicly stated it does not seek mass domestic surveillance and does not want autonomous weapons that operate without human involvement, framing its request as a need for lawful, safe access to the technology. The standoff underscores the delicate balance between national security interests and corporate risk management, ethics, and safety protocols in frontier AI development. If no agreement is reached, the DoD could reconfigure its vendor list, potentially delaying or reshaping how advanced AI is integrated into defense programs.
Analysts say the episode could set a precedent for how strictly tech firms may police government access to AI safeguards, with long-term implications for innovation, safety standards, and the speed at which military applications of AI evolve.