They had to use magic for others, but they themselves were the ones who needed it the most.
While magic produced their food and made a better world for them, they hated it because they couldn't do it for themselves.