* For \(N=100K\), we use \(wd=0.01\), \(lr=0.001/0.002/0.005\), and batch size 24 with fp16;
* For \(N=200K\), we use \(wd=0.01\), \(lr=0.001/0.002/0.005\), and batch size 48 with fp16;
* For \(N=500K\), we use \(wd=0.01\), \(lr=0.001/0.002\), and batch size 96 with fp16;
* For \(N=1M\), we use \(wd=0.01\), \(lr=0.0005/0.001/0.002\), and batch size 192 with fp16;
* For \(N=2M\), we use \(wd=0.005\), \(lr=0.0005/0.001\), and batch size 192 with fp16;
* For \(N=5M\), we use \(wd=0.005\), \(lr=0.0003/0.0005/0.001\), and batch size 384 with fp16.