Byng was married at St Paul's, Covent Garden, on 6 March 1691 to Margaret Master, daughter of James Master of East Langdon in Kent.
Together the couple had fifteen children (eleven sons and four daughters) of whom six lived to survive him:
Pattee Byng (1699–1747), 2nd Viscount Torrington, died without surviving progeny.

George Byng (1701–1750), 3rd Viscount Torrington
Robert Byng (1703–1740), Governor of Barbados (1739–1740), from whom the Earls of Strafford stem.

John Byng (1704–1757), Admiral controversially court-martialled and shot at the outbreak of the Seven Years' War in Europe.

Edward Byng (1706–1756)
Sarah Byng (1695–1775)
Byng was married at St Paul's, Covent Garden, on 6 March 1691 to Margaret Master, daughter of James Master of East Langdon in Kent. Together the couple had fifteen children (eleven sons and four daughters) of whom six lived to survive him:
Pattee Byng (1699–1747), 2nd Viscount Torrington, died without surviving progeny.
George Byng (1701–1750), 3rd Viscount Torrington
Robert Byng (1703–1740), Governor of Barbados (1739–1740), from whom the Earls of Strafford stem.
John Byng (1704–1757), Admiral controversially court-martialled and shot at the outbreak of the Seven Years' War in Europe.
Edward Byng (1706–1756)
Sarah Byng (1695–1775)
George Byng, 1st Viscount Torrington