Nope, it's all the same stuff.  If you're a writer (or artist or whatever) you should be free to use the material you want to use to tell your story. People have always done so in the past.  

Then it's a matter of whether you tell the story well or not, meaningfully or not, for all and sundry. This is art, not political one-up-manship. 

And if you want to encourage diversity and the understanding that comes with diversity, I see no reason to obstruct cross-cultural storytelling, regardless of whether one group is advantaged or disadvantaged.  Cultural appropriation polemics merely create silos, it sure doesn't heal them.