The Linear model [1]} architecture consists of a linear layer followed by a batchnorm layer, a ReLU activation function and dropout with 0.25 probability (Figure REF ). The linear layer is then followed by a residual block consisting of two linear layers followed by batchnorm layer, ReLU and dropout, where the input and output of this block are connected by a residual connection.
<FIGURE>