and he was either a family member or servant , sleeping in the palazzo , although the scent was n't familiar , or the intruder had left immediately after returning to the room , which did n't make sense .