I think it is because when one is younger shorter amounts of time represent a larger portion of one's entire life.  For a 5 year old one summer is 5% of their total life while for a 10 year old one summer is only 2.5%.  