Then Osborne had the intolerable sense of former benefits to goad and irritate him: these are always a cause of hostility aggravated. 
Then Osborne had the intolerable sense of former benefits to irritate him. 