[1]} propose a few-shot learning method to train a ConvDR model using the teacher-student knowledge distillation framework [2]}, where the query encoder of ConvDR (student) learns to produce the output of the query encoder of a well-trained ad hoc dense retrieval model (teacher).
Specifically, the method assumes that we have
