Draco was worried, sure, but what could they have that would be so damaging? He almost convinced himself that everything would be fine. There was still a nagging doubt in the back of his mind but he locked it away, much like a boggart into a cabinet. The element of fear, especially the suppressed version, would be present in both scenarios.