I should think you'd be at a special disadvantage if you haven't formally interviewed yet.
I wouldn't want my first impression to be made in a socially awkward setting like the smoker where you might only get to talk to one member of the SC.