This reminds me of another commonly-told incorrect fact: our ancestors lived short lives. This is incorrect, and neanderthals commonly lives into their ~~60s~~ 40s. The "average" age is low due to all the deaths during childbirth and small illnesses like the measles being deadly.