region:us
---
configs:
- config_name: default
  data_files:
  - split: train
    path: data/train-*
  - split: test
    path: data/test-*
dataset_info:
  features:
  - name: Title
    dtype: string
  - name: Abstract
    dtype: string
  - name: Question
    dtype: string
  - name: Answer
    dtype: string
  splits:
  - name: train
    num_bytes: 633145356
    num_examples: 798682
  - name: test
    num_bytes: 158654392
    num_examples: 200278
  download_size: 398488431
  dataset_size: 791799748
---
# Dataset Card for "synthetic-data-gen"

This is the synthetically generated dataset used for preliminary research results from [arcee's](https://www.arcee.ai/) open-source [DALM](https://github.com/arcee-ai/DALM/) repo, 
implementing E2E Rag fine-tuning over a generator and retriever with cross-gradient propogation. 

Implementation research from E2E Rag:
* TACL paper    - https://direct.mit.edu/tacl/article/doi/10.1162/tacl_a_00530/114590/Improving-the-Domain-Adaptation-of-Retrieval
* Previous code - https://github.com/huggingface/transformers/blob/main/examples/research_projects/rag-end2end-retriever/README.md