It all depends on context. If he said it in the same manner as Hillary said, "What difference does it make" regarding the deaths of four Americans in Benghazi then he's out of line, but I doubt that was the case.