There has been a lot of progress in question answering systems. However, the task of long-form question answering was recently shown to be problematic even with state-of-the-art Transformer-based systems [1]}.
Furthermore, it has been suggested that dense representations are inadequate when scaled up to large index sizes [2]}. Despite that, the current trend is based on this retrieval mechanism [3]}, [4]}, [5]}.
