Not enjoying post doc work environment I think this is more of an interpersonal/workplace question rather than an academic but still related I think.

I'm in the first year of a three year post doc in the UK. I enjoy the work I do with my advisor for the most part and I enjoy working with my advisor. Its unfortunately, everything else about the position I dont like.

The building doesnt feel 'academic', rather more of a generic office building. While this is likely minor for most, one of the reasons I chose academia over industry was the dislike of 'office culture' ie semi-forced social events, rumours, cliques, almost timed coffee breaks, offices with many people leading to volume issues or temperature disagreements etc. While some of this may be UK culture (American), I still find it hard to want to come into work. Some interpersonal issues as well in regards to politics (centrist with regards to American politics, which is apparently far far right in the UK).

This has led to me working from home or working odd hours (~6am to 2-4 pm) so that I attempt to remain productive while not having to deal with these issues. This led to rumours about me being depressed and 'raised eyebrows' about how I leave much earlier than others. Outside of work, I enjoy my hobbies and the area and I am mostly content, but having to come into work 5 days a week just drains me and stresses me out and is wreaking havoc on my emotional state and to an extent my productivity.

I have brought this up to my advisor, and we may try and change my location in the building, but there's likely not a free 1 person office so all the previous issues are still there.. just different desk location? Im not as productive at home and Im unsure how 'okay' the department is with regards to me working from home even if my boss is okay with it.

I'm unsure I can manage 2 more years at this rate. Advice?

TL;DR I like the work I do and my boss, I just dont like going to work or being at work. What should I do.
Sadly, I am an American postdoc in an American lab, and I am experiencing the same issues. The details are different, but the sentiment is the same--the laboratory is not conducive to work. At all. It is a noisy, distracting place with coworkers of all varieties doing any number of distracting activities. And right now, I have to write, and i have to write a lot. My PI/boss likes to be able to also come into lab and look over our shoulders, to make suggestions and check progress. This is entirely unnerving to me. it's compromised my ability to be productive and keep those standard hours in the lab. So, I employ strategies- noise-cancelling headphones. Working from home. Telling everyone I'm writing and getting the biggest headphones and possibly sporting a slight scowl in general. It's not fun and i'd love an office. But for me, the bottom line is what I have to show for this experience when it's over. And I'm willing to do whatever it takes, because this is a great opportunity to advance my career. And i need it and i want it badly enough. But, that said. ...it is difficult and the environment works against me, daily. It might be something you encounter in an ideal setting. 

And what i've found...is doing 'whatever you must' to be productive, might get some odd looks. People might talk or be judging. Someone might not like you working from home or keeping odd hours. 

But you will have those first author papers. And that matters. That matters to your boss, the department, and for your career--far more than whatever situational annoyances arise in the process. You've got to get yours.