He had always lived with the consciousness that such a burden was on him and might crush him at any time. 
He had always lived with the consciousness that such a burden lay on him and might crush him at any time. 