I think that the dropping numbers is down to the fact that rarely does a series keep getting better.
After the 1st series, like Lost, the plots and scripts start getting weaker and weaker as writers struggle to keep a storyline going.