One of the most important things the rich want is exclusivity: the ability to restrict who can call themselves their neighbors.  Opposing development or fighting for the "character" of a neighborhood (when character means $500K+ homes) gives them that.

I think affordable housing advocates make a terrible mistake when they hold hands with nimbys.