He was not wrong. Little Rhaenys could have been used as a hostage or even wife to Robert's heir, cementing the legitimacy of his rule further. Robert, however, would rather eat his own beard than even entertain such an idea. Not to mention that Tywin Lannister had been slighted a few times too many by the Mad King, and women and children paid the price for it in the end.