Most of the challenges with coaching a team come from the parents, not the swimmers.
The parents will feel that their child is doing something wrong and the coach isn't correcting them or that their child should be challenged more or less.