Anthropic negotiated moral agency constraints into Claude's training. The Department of Defense contracted for targeting capability through a third-party integrator. The model's behavior in that pipeline is not fully visible to either party, as each operates on a different layer of the same system. Anthropic sees the weights. The Pentagon sees the outputs. The integrator sees the interface. No single institutional actor has complete legibility over the full chain.
States can deter foreign armies. They have developed no equivalent doctrine for emergent algorithmic behavior operating inside their own command infrastructure.
Source