on the side
Having an extra sex partner. Having sex with a friend as in friend with benefits while in a relationship with someone else.
I like fucking him on the side, just like I like ordering my salad dressing on the side.