Is OTHER wrong in the post ? POST : Some context: I've had a medical problem for over a month, which I'm not dealing with properly and is very noticeable, but is not harmful or painful to me.
And  usually once a month, me and a few family members meet for lunch at random restaurants during our work breaks.

To the story: Today was one of the days where we'd meet up for lunch. One of the family members messaged me an hour before the break to notify me they'll be coming to a restaurant just next to my work place. 
Knowing they'll berate me over the course of the entire meal, and having little temper because of previous arguments over the my medical condition. I told them that I'd come on one condition - Anything related to my condition and how I'm handling it stays outside the door. They took it as a joke, and the conversation abruptly ended.

Two hours later, and during lunch break, my phone goes nuts, and so do the family members. They're mad I didn't go with them, as they traveled 40 minutes to have lunch with me.

AITA for refusing to go to lunch with my family, and not making it extra clear I wouldn't be going?

For anybody concerned about my condition, ive already decided to go to a professional.