At the same time, He Xuan fairly believes that the weird voice has its own plans on him and the situation in general. That is the possible reason why it stopped this "accidental magic" before "Mr. Fur accident". (The only thing Harry is grateful for, as it gave him a chance to know what the family is not only in dreams, but also in reality. If his magic appeared earlier, the tension would escalate much quicker). 