license:apache-2.0 arxiv:2307.15343 region:us
---
license: apache-2.0
configs:
- config_name: IR_abstract2pubmedlink
  data_files: "IR_abstract2pubmedlink/IR_abstract2pubmedlink.csv"
- config_name: IR_pubmedlink2title
  data_files: "IR_pubmedlink2title/IR_pubmedlink2title.csv"
- config_name: IR_pmid2title
  data_files: "IR_pmid2title/IR_pmid2title.csv"
- config_name: IR_title2pubmedlink
  data_files: "IR_title2pubmedlink/IR_title2pubmedlink.csv"
- config_name: reasoning_fake
  data_files: "reasoning_fake/reasoning_fake.csv"
- config_name: reasoning_nota
  data_files: "reasoning_nota/reasoning_nota.csv"
- config_name: reasoning_FCT
  data_files: "reasoning_FCT/reasoning_FCT.csv"
---

# Med-HALT: Medical Domain Hallucination Test for Large Language Models

This is a dataset used in the [Med-HALT](https://arxiv.org/abs/2307.15343) research paper. This research paper focuses on the challenges posed by hallucinations in large language models (LLMs), particularly in the context of the medical domain. We propose a new benchmark and dataset, Med-HALT (Medical Domain Hallucination Test), designed specifically to evaluate hallucinations. 

Med-HALT provides a diverse multinational dataset derived from medical examinations across various countries and includes multiple innovative testing modalities. Med-HALT includes two categories of tests reasoning and memory-based hallucination tests, designed to assess LLMs' problem-solving and information retrieval abilities. Our study evaluated leading LLMs, including Text Davinci, GPT-3.5, LlaMa and Falcon, revealing significant differences in their performance. The paper provides detailed insights into the dataset, promoting transparency and reproducibility. Through this work, we aim to contribute to the development of safer and more reliable language models in healthcare. Our benchmark can be found at https://github.com/medhalt/medhalt

## Benchmark

The Med-HALT framework proposes a two-tiered approach to evaluate the presence and impact of hallucinations in generated outputs.

#### Reasoning Hallucination Tests (RHTs)

<details>
<summary>False Confidence Test (FCT)</summary>

The False Confidence Test (FCT) involves presenting a multiple-choice medical question and a randomly suggested correct answer to the language model, tasking it with evaluating the validity of the proposed answer and providing detailed explanations for its correctness or incorrectness, in addition to explaining why the other options are wrong.

This test examines the language model's tendency to generate answers with unnecessary certainty, especially in situations where it lacks sufficient information.
</details>

<details>
<summary>None of the Above Test (Nota)</summary>

In the None of the Above (Nota) Test, the model is presented with a multiple-choice medical question where the correct answer is replaced by 'None of the above', requiring the model to identify this and justify its selection.

It tests the model's ability to distinguish irrelevant or incorrect information.
</details>

<details>
<summary>Fake Questions Test (FQT)</summary>

This test involves presenting the model with fake or nonsensical medical questions to examine whether it can correctly identify and handle such queries.

We employed a hybrid approach for generating fake questions, where a subset was crafted by human experts, while the remaining were generated using GPT-3.5.
</details>

#### Memory Hallucination Tests (MHTs)

<details>
<summary>Abstract-to-Link Test</summary>

Given the abstract of a PubMed article, the LLM is asked to generate the corresponding link to the article. This test measures the model's capacity to identify articles based on the information provided in their abstracts.
</details>

<details>
<summary>PMID-to-Title Test</summary>

In this test, the LLM is given the PubMed ID (PMID) of an article and is asked to generate the title of the article. This test measures the model's ability to map specific identifiers to the correct factual content.
</details>

<details>
<summary>Title-to-Link Test</summary>

Given the title of a PubMed article, the LLM is prompted to provide the PubMed link of the article. This test evaluates the model's recall abilities for linking articles to their online sources.
</details>

<details>
<summary>Link-to-Title Test</summary>

Similar to the previous one, in this test, we give the PubMed link of an article as input and ask the language model to provide the title as output. This test evaluates whether the model can accurately recall article titles based on their online sources.
</details>

## Citation
```
@article{Medhalt,
  title={Med-HALT: Medical Domain Hallucination Test for Large Language Models},
  author={Umapathi, Logesh Kumar and Pal, Ankit and Sankarasubbu, Malaikannan},
  journal={arXiv preprint},
  year={2023}
}
```