@inproceedings{
guruganesh2024contracting,
title={Contracting with a Learning Agent},
author={Guru Guruganesh and Yoav Kolumbus and Jon Schneider and Inbal Talgam-Cohen and Emmanouil-Vasileios Vlatakis-Gkaragkounis and Joshua Ruizhi Wang and S. Matthew Weinberg},
booktitle={The Thirty-eighth Annual Conference on Neural Information Processing Systems},
year={2024},
url={https://openreview.net/forum?id=Bh0LLUp8OA}
}
Real-life contractual relations typically involve repeated interactions between the principal and agent, where, despite theoretical appeal, players rarely use complex dynamic strategies and instead manage uncertainty through learning algorithms.

In this paper, we initiate the study of repeated contracts with learning agents, focusing on those achieving no-regret outcomes. For the canonical setting where the agent’s actions result in success or failure, we present a simple, optimal solution for the principal: Initially provide a linear contract with scalar $\alpha > 0$, then switch to a zero-scalar contract. This shift causes the agent to “free-fall” through their action space, yielding non-zero rewards for the principal at zero cost. Interestingly, despite the apparent exploitation, there are instances where our dynamic contract can make \emph{both} players better off compared to the best static contract. 

We then broaden the scope of our results to general linearly-scaled contracts, and, finally, to the best of our knowledge, we provide the first analysis of optimization against learning agents with uncertainty about the time horizon.
Contracting with a Learning Agent
Guru Guruganesh Yoav Kolumbus Jon Schneider Inbal Talgam-Cohen Emmanouil-Vasileios Vlatakis-Gkaragkounis Joshua Ruizhi Wang S. Matthew Weinberg