Context Word: baby. 
Question: The baby cried when PersonX held him but smiled when PersonY did because _ rarely spent time with the baby. 
Answer: PersonX
The baby cried when PersonX held him but smiled when PersonY did because _ always spent time with the baby.