Beyond recognizing the importance of the learning rate parameter, an actual value for \(\eta \)  needs to be set in practical applications. Several recent papers—including [1]}, [2]}, [3]}, and [4]}—have proposed data-driven choices for the learning rate, with different motivations. Section  describes these methods. The remainder of the paper is focused on a comparison of these different learning rate methods.
