He's probably holding you at an arm's length because he feels like his plate is full. It's the simplest explanations that tend to be the correct one. He's afraid of being overwhelmed, he's got kids...