if she did so , the administrator of the children 's share of the estate - that is , his brother sam - was to take action against her in court on the grounds that she was an unfit mother , and the girls were to be taken away from her , and his family appointed guardians .