Is it a must that an activation function of a neural network be differentiable?Why should an activation function of a neural network be differentiable?Is it advantageous to have a differentiable activation function? Why?
Differentiable activation function
neural networks