language: | |
- en | |
BigBirdPegasus weights before finetuning as per (this)[https://github.com/google-research/bigbird] repo. | |
Converted to PyTorch as per (this)[https://github.com/huggingface/transformers/blob/v4.25.1/src/transformers/models/bigbird_pegasus/convert_bigbird_pegasus_tf_to_pytorch.py] script. |