In 1835 he became Speaker of the House; 10 years later, he was occupying the White House
The White House Biography of James 
Knox Polk [DOC] [TLE] James K. Polk - PBS [PAR] As a protg of Andrew Jackson (he was often called "Young Hickory"), Polk had 
... [He] was the eldest of the ten children of Samuel and Jane Knox Polk.