The embedding combination occurs at least at two layers (e.g., one
hidden layer and the output layer). A nonlinear activation unit is
needed after each embedding combination step to resolve the sign
confusion [1]}, [2]}.
