Even without the dementors to guard it, Azkaban is excessively cold. A place in which life cannot be sustained, just like the rose bushes outside Malfoy Manor, who no matter the enchantment wilt at first frost.