We trained the second stage time-distributed capsule network with an Adam optimizer with learning rate of \(1e^{-4}\) , batch size of 8, and 150 epochs. Similar to the first stage, we used a modified margin loss function to consider more penalty for the minority class. Margin loss is the original loss function for capsule networks introduced in Reference [1]}.
