the white house was a simple three-story box with porches on the first and second floors and a hip roof with dormers , but the elegance of the proportions and the sheer size of the damn thing were what put it so solidly in mansion territory .