To make this less of an issue, I have taken to cooking dinner for us at my place or drumming up occasions for dinner to be my treat.
I often cook dinner for us at my place or make up excuses to take them out to dinner in order to not make a big deal of this.