Professor Flitwick didn’t believe it was from a memory charm. It was only when Professor Slughorn examined her that he believe she’d had some memories forcibly removed. Likely, Hermione had resisted the memories be taken, which was the cause for the patchwork feeling.