You should not assume that because children services did not intervene last time, they will not intervene this time.
It is correct that in order to change custody, you would have to prove that the mother is unfit.