license:bsd region:us
---
license: bsd
---
# OpenMP Question Answering Dataset
OpenMP Question Answering Dataset is a new OpenMP question answering introduced in paper "LM4HPC: Towards Effective Language Model Application in High-Performance Computing". 
It is designed to probe the capabilities of language models in single-turn interactions with users. Similar to other QA datasets, we include
some request-response pairs which are not strictly question-answering pairs. The categories and examples of questions in the OMPQA dataset can be found in below table.

| **Category** | **Count** | **Example Questions** |
| ------------ | --------- | --------------------- |
| Basics | 40 | What is a worksharing construct in OpenMP? |
| Examples | 20 | Give an example OpenMP C code for computing PI using numerical integration. |
| Compilers | 24 | In what language is LLVM written? <br> How is a parallel region represented in Clang? |
| Benchmarks | 23 | What are the NAS Parallel benchmarks? <br> Which benchmark assesses data race detection tools? |

# Data Usage
The dataset is provided in a CSV file, with each entry in the CSV table representing a pair of question and answer. 

# Contribute
Welcome to join us and become a contributor to this project! If you want to share some datasets, put them in csv file and email to lechen AT iastate.edu. Thank you!

# Citation
If you use the data collection, code, or experimental findings in this repository, please cite our IWOMP paper:

@article{chen2023lm4hpc,
  title={LM4HPC: Towards Effective Language Model Application in High-Performance Computing},
  author={Chen, Le and Lin, Pei-Hung and Vanderbruggen, Tristan and Liao, Chunhua and Emani, Murali and de Supinski, Bronis},
  journal={arXiv preprint arXiv:2306.14979},
  year={2023}
}


