Another integration method is based on attention mechanisms [1]}. The main idea of this fashion is adopting additional encoders (in various architectures) to encode retrieved target sentences, and integrate them through attention [2]}, [3]}, [4]}. Since the attention mechanism is becoming [1]}, [6]} a key module in lots of NLP models, integrating retrieved memory through attention becomes a very nature and efficient way.
