@inproceedings{
acharya2024universal,
title={Universal Trojan Signatures in Reinforcement Learning},
author={Manoj Acharya and Weichao Zhou and Anirban Roy and Xiao Lin and Wenchao Li and Susmit Jha},
booktitle={NeurIPS 2023 Workshop on Backdoors in Deep Learning - The Good, the Bad, and the Ugly},
year={2024},
url={https://openreview.net/forum?id=hLtbmYoW5w}
}
We present a novel approach for characterizing Trojaned reinforcement learning (RL) agents. By monitoring for discrepancies in how an agent's policy evaluates state observations for choosing an action, we can reliably detect whether the policy is Trojaned. Experiments on the IARPA RL challenge benchmarks show that our approach can effectively detect Trojaned models even in transfer settings with novel RL environments and modified architectures.
Universal Trojan Signatures in Reinforcement Learning
Manoj Acharya Weichao Zhou Anirban Roy Xiao Lin Wenchao Li Susmit Jha