Both the battle for Castle Black and the battle of Hardhome were vastly different from having two armies face off on an open field. His fights in his last life didn't count, as he had always fought alone and with magic against completely different opponents.