Consequently, SEED RL achieves to a million queries per second on a single machine, the number of actors can be increased to thousands of machines, the learner can be extended to thousands of cores and making it possible to train at millions of frames per second. [1]} adapt two algorithms into the SEED RL to make it successful: V-trace and R2D2.
