SacreBLEU update
{'login': 'devrimcavusoglu', 'id': 46989091, 'node_id': 'MDQ6VXNlcjQ2OTg5MDkx', 'avatar_url': 'https://avatars.githubusercontent.com/u/46989091?v=4', 'gravatar_id': '', 'url': 'https://api.github.com/users/devrimcavusoglu', 'html_url': 'https://github.com/devrimcavusoglu', 'followers_url': 'https://api.github.com/users/devrimcavusoglu/followers', 'following_url': 'https://api.github.com/users/devrimcavusoglu/following{/other_user}', 'gists_url': 'https://api.github.com/users/devrimcavusoglu/gists{/gist_id}', 'starred_url': 'https://api.github.com/users/devrimcavusoglu/starred{/owner}{/repo}', 'subscriptions_url': 'https://api.github.com/users/devrimcavusoglu/subscriptions', 'organizations_url': 'https://api.github.com/users/devrimcavusoglu/orgs', 'repos_url': 'https://api.github.com/users/devrimcavusoglu/repos', 'events_url': 'https://api.github.com/users/devrimcavusoglu/events{/privacy}', 'received_events_url': 'https://api.github.com/users/devrimcavusoglu/received_events', 'type': 'User', 'site_admin': False}
[{'id': 1935892857, 'node_id': 'MDU6TGFiZWwxOTM1ODkyODU3', 'url': 'https://api.github.com/repos/huggingface/datasets/labels/bug', 'name': 'bug', 'color': 'd73a4a', 'default': True, 'description': "Something isn't working"}]
[]
['Hi @devrimcavusoglu, \r\nI tried your code with latest version of `datasets`and `sacrebleu==1.5.1` and it\'s running fine after changing one small thing:\r\n```\r\nsacrebleu = datasets.load_metric(\'sacrebleu\')\r\npredictions = ["It is a guide to action which ensures that the military always obeys the commands of the party"]\r\nreferences = [["It is a guide to action that ensures that the military will forever heed Party commands"]]  # double brackets here should do the work\r\nresults = sacrebleu.compute(predictions=predictions, references=references)\r\nprint(results)\r\noutput: {\'score\': 41.180376356915765, \'counts\': [11, 8, 6, 4], \'totals\': [18, 17, 16, 15], \'precisions\': [61.111111111111114, 47.05882352941177, 37.5, 26.666666666666668], \'bp\': 1.0, \'sys_len\': 18, \'ref_len\': 16}\r\n```'
 "@bhavitvyamalik hmm. I forgot double brackets, but still didn't work when used it with double brackets. It may be an isseu with platform (using win-10 currently), or versions. What is your platform and your version info for datasets, python, and sacrebleu ?"
 "You can check that here, I've reproduced your code in [Google colab](https://colab.research.google.com/drive/1X90fHRgMLKczOVgVk7NDEw_ciZFDjaCM?usp=sharing). Looks like there was some issue in `sacrebleu` which was fixed later from what I've found [here](https://github.com/pytorch/fairseq/issues/2049#issuecomment-622367967). Upgrading `sacrebleu` to latest version should work."
 "It seems that next release of `sacrebleu` (v2.0.0) will break our `datasets` implementation to compute it. See my Google Colab: https://colab.research.google.com/drive/1SKmvvjQi6k_3OHsX5NPkZdiaJIfXyv9X?usp=sharing\r\n\r\nI'm reopening this Issue and making a Pull Request to fix it."
 "> It seems that next release of `sacrebleu` (v2.0.0) will break our `datasets` implementation to compute it. See my Google Colab: https://colab.research.google.com/drive/1SKmvvjQi6k_3OHsX5NPkZdiaJIfXyv9X?usp=sharing\r\n> \r\n> I'm reopening this Issue and making a Pull Request to fix it.\r\n\r\nHow did you solve him"]
With the latest release of [sacrebleu](https://github.com/mjpost/sacrebleu), `datasets.metrics.sacrebleu` is broken, and getting error.

    AttributeError: module 'sacrebleu' has no attribute 'DEFAULT_TOKENIZER'

this happens since in new version of sacrebleu there is no `DEFAULT_TOKENIZER`, but sacrebleu.py tries to import it anyways. This can be fixed currently with fixing `sacrebleu==1.5.0`

## Steps to reproduce the bug
```python
sacrebleu= datasets.load_metric('sacrebleu')
predictions = ["It is a guide to action which ensures that the military always obeys the commands of the party"]
references = ["It is a guide to action that ensures that the military will forever heed Party commands"]
results = sacrebleu.compute(predictions=predictions, references=references)
print(results)
```

## Environment info
<!-- You can run the command `datasets-cli env` and copy-and-paste its output below. -->
- `datasets` version: 1.11.0
- Platform: Windows-10-10.0.19041-SP0
- Python version: Python 3.8.0
- PyArrow version: 5.0.0

{'url': 'https://api.github.com/repos/huggingface/datasets/issues/2737/reactions', 'total_count': 0, '+1': 0, '-1': 0, 'laugh': 0, 'hooray': 0, 'confused': 0, 'heart': 0, 'rocket': 0, 'eyes': 0}