Concerning the experimental setup, we employed five different RBM architectures, in which the main difference lies in the regularization method. In this case, RBM does not employ Dropout, the “Weight" RBM (W-RBM) with L2 regularization employing a penalty of \(5\cdot 10^{-3}\)  (the mean value of the ranges proposed by Hinton [1]}), the “standard-dropout" RBM (D-RBM) uses the traditional Dropout, the “DropConnect" RBM (DC-RBM) uses the traditional DropConnect, and the “E-Dropout" RBM (E-RBM) employs the proposed energy-based Dropout. Additionally, when considering the “standard-dropout" and the “DropConnect", we used \(p = 0.5\)  as stated by Srivastava et al. [2]} and Wan et al. [3]}, respectively.
