We run CQL using the implementation suggested by [1]}, which only provide hyperparameters for the Gym-MuJoCo and AntMaze domains.
For the Maze2D and Adroit datasets, we run both sets of recommended hyperparameters and per-dataset select the better result to report.
We note that hyperparameter settings for the Maze2D and Adroit datasets are also not provided in the original CQL implementation.
An in-depth tuning of CQL on these two domains of datasets is beyond the scope of this paper.
