Multi-fidelity methods [1]} does not run the ML for the full budget for every hyper-parameters but only for a limited budget (low fidelity). Then, only promising hyper-parameters are run for longer (high fidelity). Adapting this method to AutoRL is challenging and also interesting because it might reduce the required time budget for optimization.
