Both [1]} and [2]} highlight strong similarities with the Adam method [3]}. We share these similarities and we highlight them too. The “connection point” is a noisy version of Adam. [1]} describe this method and call it “Noisy Adam” (Algorithm 1 in their paper). The difference to the vanilla version is that at each step, instead of using the current parameter, they use a noisy version of it. The noise magnitude is the pseudo-second order term (\(v_t\)  in the original Adam paper [5]}).
