In 1417, John Talbot, 2nd Earl of Shrewsbury built White's Castle to guard the bridge, 620 meters to the SSW and on the opposite site of the river, and the centre of gravity of the town of Athy shifted to the south, leaving Woodstock Castle isolated.