I'm pretty much with Amy, May 14 2013 on this one, especially if this is a repeated behavior.
Sometimes the woman has every right to take pulling away personally if this behavior follows a disagreement in the relationship and this is consistently how the man handles it.