Context: 

I am a 6'0 male I workout a little. Never been real scared of confrontation.

I live in a mid-sized southern city. Southern hospitality is big here and so is treating others with respect. Despite it being the south the city is very open-minded and accepting. 

Our city has a VERY LARGE homeless population especially for the size of the town. Most of them are relatively nice but as is with any large population there will be some outliers.

 Also, I am by no means a homeless hater (or maybe I am that's your call to make), but because I think this is relevant I'm going to mention it; just this week I have given $20 to a homeless man I thought really needed it and I received an extraordinary amount of food (Chipotle leftovers from an organization I'm a part of) and the first thing I did was walk down my street and gave some to the homeless community.

Story:

I was walking from my parking spot to my apartment, on the phone with my mom. I had one airpod in so it's likely the guy approaching me didn't see it (even though I was in the middle of a sentence with my mom). Encounter below. 

Sam: "come here" (he's walking off of the train tracks I have to cross over to come up to me)

Me (on phone with mom): "no"

Me: \*continues walking 4/5 steps

S: "Fuck you what the fuck do you mean no?"

Me: "hold on mom." - obviously to my mom

Me: "I mean I don't know you and I don't want to know you."

S: "I was going to ask you where XYZ is"

I should note this has become an extremely common tactic in my city for the homeless people to come up to you and ask you where something is and then get aggressive once you don't give them money.

Me: "I don't know nothing about XYZ and I don't know nothing about you so you need to get gone."

S: "Imma beat your ass nigga" -he is black I am not

Me: \*stops walking\* "here I am what's stopping you"

S: "You need t-"

I cut him off 

Me: "I'm going to tell you what you need to do you need to stop talking about whose ass your going to beat and etiher do it or get your ass back on those train tracks before I put you there."

S: "Fuck you fuck this I have a home to go to"

Me: "Man I know you don't. I saw you come off those train tracks get lost."

So let me know reddit AmITheAsshole? 

P.S.

If you need anymore details ask and I'll respond!