He was, along with his sisters sisters Susanna (1727–1822), Mary (1730–1825), and Margaret (1733-1752), a one-quarter heir to the roughly 250 sqmi "Highland Patent" of his father (later to become known as the Philipse Patent, and in time today's Putnam County of southeastern New York).