It is because matriarchy and misandry are far smaller problems in our world that patriarchy and misogyny.  Not to say that they (matriarchy and misardry) don't exist to some extent, but they clearly are not a big factor in most of the global problems and issues that patriarchy and misogyny are central to.