While extensive examples of this exceed the scope of this paper,
Appendix REF  contains a single such experiment, testing
QR-DQN [1]} as a passive learning algorithm (the active agent being a Double-DQN).
This is motivated by the observation of [2]},
that QR-DQN outperforms DQN in the offline setting. QR-DQN indeed appears
to be a nontrivially different passive learning algorithm,
significantly better in some games, while curiously worse in others (Fig. REF ).
