the remainder of the afternoon passed with a relative unease between the two , neither one really wanting to address the elephant in the room ; olivia not wanting to talk about why she knew that house , fearful it would bring up shadows of the past , and alexander worried that olivia was starting to remember .