@inproceedings{
pirotta2023fast,
title={Fast Imitation via Behavior Foundation Models},
author={Matteo Pirotta and Andrea Tirinzoni and Ahmed Touati and Alessandro Lazaric and Yann Ollivier},
booktitle={NeurIPS 2023 Foundation Models for Decision Making Workshop},
year={2023},
url={https://openreview.net/forum?id=SHNjk4h0jn}
}
Imitation learning (IL) aims at producing agents that can imitate any
behavior given a few expert demonstrations. Yet existing approaches require
many demonstrations and/or running (online or offline) reinforcement
learning (RL) algorithms for each new imitation task. Here we show that recent RL foundation models based on successor measures can
imitate any expert behavior almost instantly
with just a few demonstrations and no need for RL or fine-tuning, while
accommodating several IL
principles (behavioral cloning, feature matching, reward-based, and
goal-based reductions).
In our
experiments, imitation via RL foundation models matches, and often
surpasses, the performance of SOTA offline IL algorithms, and produces
imitation policies from new demonstrations within seconds instead of hours.
Fast Imitation via Behavior Foundation Models
Matteo Pirotta Andrea Tirinzoni Ahmed Touati Alessandro Lazaric Yann Ollivier