| language: | |
| - en | |
| BigBirdPegasus weights before finetuning as per [this](https://github.com/google-research/bigbird) repo. | |
| Converted to PyTorch as per [this](https://github.com/huggingface/transformers/blob/v4.25.1/src/transformers/models/bigbird_pegasus/convert_bigbird_pegasus_tf_to_pytorch.py) script. |