Why should I choose a mini-batch size of 32, 64, 128, 256, etc. (i.e., a power of two) and not a size of 50, 100, 500, 1000? Is there any benefit of choosing power of two mini-batch sizes?
valid question