* For \(N=100K\), we use \(wd=0.01\), \(lr=0.001/0.002/0.005\), and batch size 24 with fp16;
* For \(N=200K\), we use \(wd=0.01\), \(lr=0.001/0.002/0.005\), and batch size 48 with fp16;
* For \(N=500K\), we use \(wd=0.01\), \(lr=0.001/0.002\), and batch size 96 with fp16;
* For \(N=1M\), we use \(wd=0.01\), \(lr=0.0005/0.001/0.002\), and batch size 192 with fp16;
* For \(N=2M\), we use \(wd=0.005\), \(lr=0.0005/0.001\), and batch size 192 with fp16;
* For \(N=5M\), we use \(wd=0.005\), \(lr=0.0003/0.0005/0.001\), and batch size 384 with fp16.
* For \(N=100K\), we use \(wd=0.01\), \(Learning Rate=0.001/0.002/0.005\), and Batch Size 24 with fp16;
* For \(N=200K\), we use \(wd=0.01\), \(Learning Rate=0.001/0.002/0.005\), and Batch Size 48 with fp16;
* For \(N=500K\), we use \(wd=0.01\), \(Learning Rate=0.001/0.002\), and Batch Size 96 with fp16;
* For \(N=1M\), we use \(wd=0.01\), \(Learning Rate=0.0005/0.001/0.002\), and Batch Size 192 with fp16;
* For \(N=2M\), we use \(wd=0.005\), \(Learning Rate=0.0005/0.001\), and Batch Size 192 with fp16;
* For \(N=5M\), we use \(wd=0.005\), \(Learning Rate=0.0003/0.0005/0.001\), and Batch Size 384 with fp16.
* N=100K의 경우, \(wd=0.01\), \(lr=0.001/0.002/0.005\), 배치 크기 24와 fp16을 사용합니다;
* N=200K의 경우, \(wd=0.01\), \(lr=0.001/0.002/0.005\), 배치 크기 48과 fp16을 사용합니다;
* N=500K의 경우, \(wd=0.01\), \(lr=0.001/0.002\), 배치 크기 96과 fp16을 사용합니다;
* N=1M의 경우, \(wd=0.01\), \(lr=0.0005/0.001/0.002\), 배치 크기 192와 fp16을 사용합니다;
* N=2M의 경우, \(wd=0.005\), \(lr=0.0005/0.001\), 배치 크기 192와 fp16을 사용합니다;
* N=5M의 경우, \(wd=0.005\), \(lr=0.0003/0.0005/0.001\), 배치 크기 384와 fp16을 사용합니다.