They must have thought he meant something snarky by that comment, for Dudley piped up, "I should have given you my spare bedroom a lot earlier." As if he was apologizing for the cupboard under the stairs.