The airline only wanted to use the seat which was not occupied by the 18 year old who took an earlier flight and thus did NOT board.  The whole family was asked to leave because they wouldn't give up that seat.