致命性自主武器系统议题下有意义的人类控制原则

Principle of Meaningful Human Control under Topic of Lethal Autonomous Weapon System

《常规武器公约》框架下政府专家组会议对致命性自主武器的讨论,确定了有意义的人类控制原则的中枢地位。有意义的人类控制原则之所以被提出,是因为人工智能带来武器系统自主化的背景下,使用武器人的行为与武器系统攻击存在不一致性,后者并不一定是前者的必然结果。为消除伦理危机,实践中在两个方面阐述有意义的人类控制原则:一方面从军控角度出发,建立自开发至使用全流程监管,以期实现武器攻击反映操作员、指挥官意图的目标;另一方面从国际刑法、国家责任法角度出发,落实人(国家)的责任不得被转移至机器的原则。有意义的人类控制原则在约束国家行为以及追究个人刑事责任、国家责任两个层次发挥作用,对我国法律的完善及未来塑造规制致命性自主武器的国际法规则,均有重要参考意义。

The discussion of lethal autonomous weapons at the meeting of the Group of Governmental Experts within the framework of the Convention on Conventional Weapons,has determined the centrality of meaningful human control principles.The fundamental reason for meaningful human control principles is that in the context of artificial intelligence instilled autonomy into the weapon systems,and thus inconsistency between the behavior of weapon operator and the attack launched by the weapon system.The latter is not necessarily the inevitable result of the former.In order to eliminate the ethical crisis,the principle of meaningful human control principles have been elaborated in terms of two aspects:(Ⅰ)from the perspective of arms control,the establishment of a full-process monitoring mechanism,with an aim to ensure that weapon attacks reflecting the intentions of the operator as well as commander;(Ⅱ)from the perspective of International Criminal Law and rules of State Responsibility,responsibility should not be transferred from humans to the machines.The principle of meaningful human control plays a role in restricting state behavior and imposing individual criminal responsibility and state responsibility.It would be of important significance both for sculpting rules of International Law governing Lethal Autonomous Weapon Systems,and for providing guidance for the perfection of applicable domestic regulations of China.