Large Language Models (LLMs) exhibit outstanding capabilities in executing tasks that demand extensive memorization of factual data (Chowdhery et al., 2023). However, their memorization capabilities are constrained when dealing with less frequent entities (Mallen et al., 2023; Kandpal et al., 2023; Sun et al., 2023), and even the largest models may encounter the well-known "hallucination" problem (Shuster et al., 2021) and temporal degradation (Kasai et al., 2022). Consequently, when LLMs are intended for deployment in less resourced domains, customization becomes imperative to ensure optimal performance. A common example is within the industrial setup, where chatbots or Question Answering (QA) systems need to accurately answer users' questions about a proprietary knowledge graph or intra-company terminology with limited textual description.