We note that in GELU [1]} paper, a similar idea is utilized to obtain their activation functions. They use the product of \(x\)  with the cumulative distribution function of a suitable probability distribution (see [1]} for further details).
<FIGURE>