In this section, we first re-visit the HM-RNN structure proposed in [1]}, then introduce the proposed HM-AN networks, with details of Gumbel-softmax and Gumbel-sigmoid to estimate the stochastic discrete neurons in the networks.
<FIGURE>