Senior US defense officials, led by the Defense Secretary, held discussions with executives from artificial intelligence company Anthropic this week to resolve a growing disagreement over defense use of the company's powerful Claude AI system. Reports indicate Hegseth issued an ultimatum, giving Anthropic CEO Dario Amodei by Friday to accept the department's terms or face potential consequences.
A Dispute Over Principles and Capabilities
Anthropic, which markets itself as the foremost ethically-focused of the leading AI developers, has been locked in a protracted disagreement with the Department of Defense. The core issue concerns the extent to which the armed forces can utilize the Claude large language model. While Pentagon leaders are demanding broad access to its functions, Anthropic has allegedly resisted allowing its technology to be used for purposes such as mass surveillance or autonomous lethal platforms that could engage targets without human input.
"In my view, if someone wants to profit from the US government, from the US Department of War, those guardrails should be adjusted for our use cases – so long as they’re legal," said a high-ranking Pentagon technology officer recently.
The Pentagon has reportedly integrated Claude into some workflows, but has warned to sever the relationship over what it views as unnecessary restrictions imposed by the AI company.
Billions and Wider AI Deals
This dispute underscores the larger tension of whether the AI industry will push back against state requests for defense applications of their products. The Department of Defense initially struck lucrative deals with several prominent AI companies, such as Anthropic, Google, and OpenAI, providing contracts worth up to $200 million. Previously, Anthropic's Claude was the sole AI model permitted for use in the military's classified systems.
Yet, in a notable move, the DoD finalized a deal on Monday permitting the use of Elon Musk's xAI chatbot within those classified systems. This comes amid previous controversy surrounding that specific AI's generation of problematic content.
Notably that xAI and OpenAI have reportedly agreed to the Pentagon's stipulations on application, with a defense official stating that OpenAI had authorized its model for "any legal purposes."
Political Dimensions and Worldwide Consequences
The context of the meeting is notable, occurring a few weeks after the US military reportedly used Claude to assist in a high-profile international mission. There has been a strong push from the sitting government to embed AI deeply into defense strategy.
Meanwhile, Anthropic's leadership has openly campaigned for stricter AI regulation and has supported initiatives calling for robust safeguards. The firm's perceived political leanings have reportedly affected its business relationships, with some pro-Trump investment firms backing out from planned deals.
The Future of AI in Conflict
The Pentagon has poured billions into pursuing AI-powered systems, from unmanned vehicles to automated decision-making tools. This accelerating progress has raised urgent ethical questions to the forefront, especially regarding the delegation of lethal decision-making to algorithms.
- Autonomous Weapons: Discussions have moved beyond theoretical, with ongoing wars showcasing partially autonomous drones that can operate without direct control.
- Industry Pressure: The outcome of the this negotiation could establish a pattern for how additional AI firms engage with military contracts.
- International Competition: There is a stated objective to lead the worldwide AI technology race, introducing a layer of geopolitical competition to the moral debate.
The weekend deadline approaches, putting significant strain on Anthropic to either accommodate the military's requirements or stick to its stated ethical principles and risk substantial business and partnership repercussions.