I have recently observed in many cases that taking mean of the cost function vs sum of cost function results in very different results (specifically in thenano)? Many times sum of cost gives nan while taking mean resolves it. Why is this the case? Mean requires sum too, then what is the possible reason for this behaviour?
Mean vs Sum of cost in theano
machine learning;python;theano