task_categories:question-answering size_categories:1M<n<10M language:en LM region:us
---
dataset_info:
  features:
  - name: question
    dtype: string
  - name: answer
    dtype: string
  splits:
  - name: train
    num_bytes: 905142526
    num_examples: 3567659
  - name: validation
    num_bytes: 66583039
    num_examples: 151825
  download_size: 396719226
  dataset_size: 971725565
task_categories:
- question-answering
language:
- en
tags:
- LM
size_categories:
- 1M<n<10M
---
# MFAQ

- Source: https://huggingface.co/datasets/clips/mfaq
- Num examples: 
  - 3,567,659 (train)
  - 151,825 (validation)
- Language: English

```python
from datasets import load_dataset

load_dataset("vietgpt/mfaq_en")
```

- Format for QA task

```python
def preprocess(
    sample,
    instruction_key="### Instruction:",
    response_key="<|endofprompt|>",
    end_key="<|endoftext|>",
):
    question = sample['question']
    completion = sample['answer']
    return {'text': """Below is an instruction that describes a task. Write a response that appropriately completes the request.
{instruction_key}
{question}
{response_key}
{completion}
{end_key}""".format(
    instruction_key=instruction_key,
    question=question,
    response_key=response_key,
    completion=completion,
    end_key=end_key,
)}

"""
Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
After the application of WOL, can we start the transmission before we have obtained the Wireless Operating License?
<|endofprompt|>
No, one is not legally supposed to begin the operational transmission. However, you can try doing test transmission.
<|endoftext|>
"""
```