Figure 11: Prompt template used in Contrastive Filtering to compare the responses of the strong and the target LLMs. We directly use the strong LLM with this template as the scorer \(S\) to avoid additional costs from calling a third-party LLM.