Black holes pack a huge amount of mass into an extremely small space, making gravity a major player at the quantum scale, where it can usually be ignored.
Either locality or unitarity is the source of the conflict.