They managed to break in. The Dark Lord had applied a seed to all the wards that grew to encompass them. The seed was connected to him. All he had to do was vanish the seed and the wards would vanish with it.