When his father died in 1751, he inherited Philipsburg Manor, a 52000 acres hereditary estate comprising much of southern Westchester County, the accompanying title, and commercial interests, including the share of family holdings his father had received from Adolphus Philipse, a bachelor uncle and son of Frederick I, the first Lord of Philipsborough.