Looking back at the hour or two that had just passed he was aware that he had allowed himself not only to be frightened in the dinner-room,--but also to seem to be frightened. 
Looking back at the past hour or two he was aware that he had allowed himself to be frightened - and also to seem to be frightened. 