Momentum acceleration is a correction factor applied to SGD that increases the strength of the updates for those dimensions whose gradients point in the same direction whilst decrease the strength on those dimensions pointing in other directions. Momentum acceleration [1]} introduces a correction factor (\(V_{t}\) ) to Cross Entropy equation, resulting on a faster convergence with smaller fluctuations on each epoch, and is defined as:
\(W=W-V_{t}=W-\gamma V_{t-1}+\alpha \nabla wf(w)\) 
