We train our HaloNet models on ImageNet [1]} (ILSVRC-2012) benchmark with a batch size of 4096 and learning rate of \(1.6\) , which is linearly warmed up for 10 epochs and followed by cosine decay [2]}.
The models are trained for 350 epochs with Nesterov’s Accelerated Gradient [3]}, [4]}, and regularized with dropout [5]}, weight decay, RandAugment [6]} and stochastic depth [7]}.
