We showed that our approach is competitive against a more naive 'contextualize and select' pipeline. This was demonstrated by comparison both to the previous contextualized model by<cite> Gadetsky et al. (2018)</cite> and to the Transformerbased SELECT variation of our model, which differs from the proposed architecture only in the context encoding pipeline.