I am sorry your in-laws are being bullies about this issue.  It's part of becoming a parent that you take an unpopular stand with some people.  Loving grandparents would not give you this ultimatum.  Do what you have to do.