region:us
# A New General Language Generation Evaluation Benchmark

This original dataset and instruction can be found [here](https://github.com/microsoft/glge)

To create a dataset and with specific version, you can simply run:

```commandline
git clone https://huggingface.co/datasets/shijli/glge
cd glge/data
bash preprocess.sh dataset version model
```

by replacing dataset version and model with your own parameters.
For example

```commandline
bash preprocess.sh cnndm easy prophetnet_en
```

will create the easy version of cnndm data using the prophetnet_en vocabulary file. Please rename and move the
vocabulary file into the ./vocab directory.
