It was his own stench. The wardens only used cleaning spells on the inmates when the stench finally reached their offices, which were on the opposite end of the castle. And it was the other cell that he was sandwiched between.