The pair sat down by the Major and fell into a conversation of which he could not help hearing somewhat. 
The pair sat down by the Major and fell into a conversation in German which he could not help overhearing. 