"If there's a player in the list you don't want to have in there anymore, simply right-click his/her healthbar and click'""Remove player""' to remove the player."
however, you will automatically turn off the auto-adjust to group feature to prevent the removed player from popping back up again.