Because there’s no one who would ever consider making him wear something like it other than Harry. He saw a part of Draco that he refused to show to anyone else. The part of him that was weak, soft, vulnerable.