He remembered the argument they had 4th year, jumping down from that tree to laugh at Harry...being transfigured into a ferret. What a horrible embarrassing memory, but he knew he deserved it. I'm sorry Harry...I didn't mean it!