I commute to and from work on public transit. One day an older  guy (in his 60s), I'll call him Gus, asked me for change for a pass. I didn't have change so I bought him a pass with my debit card. After that we chatted until I had to get off of the train. To my surprise the next time I saw Gus he gave me a beautifully handwritten thank you note for buying him that pass. We chatted until we had to part ways again. After that I'd run into Gus quite a bit on my way to or from work and we would always chat about stuff whenever we saw each other.

After knowing Gus for a little over a year and having a lot of conversations with him he saw me one night on my way to work and flagged me down. I was walking to work when he saw me. We were not on the train. I stopped said hi and explained that I was late for work and I need to get there immediately, but Gus wasn't allowing me to leave that easily. He started asking me about my day and was trying to tell me about a drawing he's trying to sell (Gus lives on a fixed income has a gambling addiction and sells nicely handwritten notes and drawings to get by) I told him again that I'm late for work, I don't have time to chat and I need to get there ASAP and that if he wants he could meet me at the train station in the morning and shut down the conversation before he could really get one going. 

Last night on my way to work I bumped into Gus for the first time since that happened. Gus did not hesitate to tell me that I hurt his feelings. Gus told me he felt like I should have at least asked him how he was doing and took the time to look at his work. I feel bad about hurting his feelings, but I did not apologize for blowing him off that night because I would do it again and I don't think it is wrong to prioritize work over chatting with anyone. A rule of mine is to not apologize just because someone's feelings are hurt. Needless to say me and Gus are no longer on talking terms. 

Tl;dr: Running late for work when an acquaintance tried to stop me to chit chat. I blew them off. The next time I saw them they expected an apology and I refused to give them one because I don't think I was wrong and I'd do it again.

Was I the asshole in both situations, just one or in none of them? 