As militaries increasingly incorporate Artificial Intelligence (AI) into their decision-making architecture, legal and ethical debates have primarily focused on Autonomous Weapon Systems (AWS). This paper argues that equally urgent challenges concern AI-enabled Decision-Support Systems (DSS-AI), even though these systems formally preserve human authority over the use of force. We develop the concept of extended meaningful human control (MHC) to address normative risks posed by DSS-AI in operational environments where time pressure, cognitive constraints, and system opacity converge to marginalize human agency in the decision-making loop. Our argument draws on two scenarios in which the integration of AI in military decision-making is linked to the scarcity of temporal resources—whether inherent (as in nuclear early warning systems) or induced (as in the alleged use of DSS-AI by the Israeli Defense Forces in Gaza). Both cases illustrate how taking critical military decisions at AI speed raises profound ethical and legal concerns. To resist the erosion of MHC, we propose three implementation pathways: human-centered system design, clearly distributed responsibility within command structures, and training programs to counter cognitive and institutional sources of automation bias. These measures should be codified in a multilateral treaty or, failing that, embedded in national doctrines and military manuals to resist the systemic drift toward “warfare at AI speed”.

Mauri, D., Amoroso, D., Tamburrini, G. (2026). Warfare at AI Speed and the Extended Meaningful Human Control Problem. In P. Cotta-Ramusino, M. Lowenthal (a cura di), Nuclear Weapon Risks in a Problematic Time: Proceedings of the XXIII Edoardo Amaldi Conference, Accademia Nazionale dei Lincei (pp. 31-43). Springer Nature Switzerland AG.

Warfare at AI Speed and the Extended Meaningful Human Control Problem

Mauri D;
2026-01-01

Abstract

As militaries increasingly incorporate Artificial Intelligence (AI) into their decision-making architecture, legal and ethical debates have primarily focused on Autonomous Weapon Systems (AWS). This paper argues that equally urgent challenges concern AI-enabled Decision-Support Systems (DSS-AI), even though these systems formally preserve human authority over the use of force. We develop the concept of extended meaningful human control (MHC) to address normative risks posed by DSS-AI in operational environments where time pressure, cognitive constraints, and system opacity converge to marginalize human agency in the decision-making loop. Our argument draws on two scenarios in which the integration of AI in military decision-making is linked to the scarcity of temporal resources—whether inherent (as in nuclear early warning systems) or induced (as in the alleged use of DSS-AI by the Israeli Defense Forces in Gaza). Both cases illustrate how taking critical military decisions at AI speed raises profound ethical and legal concerns. To resist the erosion of MHC, we propose three implementation pathways: human-centered system design, clearly distributed responsibility within command structures, and training programs to counter cognitive and institutional sources of automation bias. These measures should be codified in a multilateral treaty or, failing that, embedded in national doctrines and military manuals to resist the systemic drift toward “warfare at AI speed”.
2026
Settore PHIL-02/A - Logica e filosofia della scienza
Settore GIUR-09/A - Diritto internazionale
978-3-032-29873-7
Mauri, D., Amoroso, D., Tamburrini, G. (2026). Warfare at AI Speed and the Extended Meaningful Human Control Problem. In P. Cotta-Ramusino, M. Lowenthal (a cura di), Nuclear Weapon Risks in a Problematic Time: Proceedings of the XXIII Edoardo Amaldi Conference, Accademia Nazionale dei Lincei (pp. 31-43). Springer Nature Switzerland AG.
File in questo prodotto:
File Dimensione Formato  
978-3-032-29873-7_4.pdf

Solo gestori archvio

Tipologia: Post-print
Dimensione 168.29 kB
Formato Adobe PDF
168.29 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10447/718227
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact