Robustness is a crucial aspect to be considered in all systems. RALM systems, despite exhibiting performance benefits in several domains, introduce a multitude of uncertainties to the architecture due to the incorporation of retrieval as a technique. As elucidated by Hu et al. (2024), through exceedingly simple prefix attacks, not only can the relevance and accuracy of RALM output be diminished, but even the retrieval strategy of the retriever can be altered.