on his way back to williamstown , in the late afternoon , he stopped on a cliff top , dismounted , and walked his bike down to the entry gate of a luxurious house that sat on its own , overlooking the bay .