during the years when these men had fought against the twisted queens , they could n't gather at an inn without coming to the attention of the queens ' guards and they would n't gather at anyone 's home and put that man 's family at risk .