**Baselines without retrievals.** We evaluate strong publicly available pre-trained LLMs, Llama278133 (Touvron et al., 2023), instruction-tuned models, Alpac278133 (Dubois et al., 2023) (our replication based on Llama2); and models trained and reinforced using private data, Chat-GPT (Ouyang et al., 2022) and Llama2-chat1333. For instruction-tuned LMs, we use the official system prompt or instruction format used during training if publicly available. We also compare our method to concurrent work, CoVE65(Dhuliawala et al., 2023), which introduces iterative prompt engineering to improve the factuality of LLM generations.