Or another way of looking at it is that with more few people chasing few houses, prices will remain stable. 

Hence, the size of mortgage loans will also remain stable. Instead of decreasing as they would have to if the population were to start decreasing as well.