I think it's because the bum did all those things first.

I had a minor run-in with a homeless person this morning; I looked at him and he started yelling at me. I did not glare or stare. I let it go.