Add KLUE dataset
{'login': 'jungwhank', 'id': 53588015, 'node_id': 'MDQ6VXNlcjUzNTg4MDE1', 'avatar_url': 'https://avatars.githubusercontent.com/u/53588015?v=4', 'gravatar_id': '', 'url': 'https://api.github.com/users/jungwhank', 'html_url': 'https://github.com/jungwhank', 'followers_url': 'https://api.github.com/users/jungwhank/followers', 'following_url': 'https://api.github.com/users/jungwhank/following{/other_user}', 'gists_url': 'https://api.github.com/users/jungwhank/gists{/gist_id}', 'starred_url': 'https://api.github.com/users/jungwhank/starred{/owner}{/repo}', 'subscriptions_url': 'https://api.github.com/users/jungwhank/subscriptions', 'organizations_url': 'https://api.github.com/users/jungwhank/orgs', 'repos_url': 'https://api.github.com/users/jungwhank/repos', 'events_url': 'https://api.github.com/users/jungwhank/events{/privacy}', 'received_events_url': 'https://api.github.com/users/jungwhank/received_events', 'type': 'User', 'site_admin': False}
[]
[]
['I\'m not sure why I got error like below when I auto-generate dummy data "mrc" \r\n```\r\ndatasets.keyhash.DuplicatedKeysError: FAILURE TO GENERATE DATASET !\r\nFound duplicate Key: 0\r\nKeys should be unique and deterministic in nature\r\n```'
 '> I\'m not sure why I got error like below when I auto-generate dummy data "mrc"\r\n> \r\n> ```\r\n> datasets.keyhash.DuplicatedKeysError: FAILURE TO GENERATE DATASET !\r\n> Found duplicate Key: 0\r\n> Keys should be unique and deterministic in nature\r\n> ```\r\n\r\nPlease check out the suggestion below. I think it might be a cause.'
 '> > I\'m not sure why I got error like below when I auto-generate dummy data "mrc"\r\n> > ```\r\n> > datasets.keyhash.DuplicatedKeysError: FAILURE TO GENERATE DATASET !\r\n> > Found duplicate Key: 0\r\n> > Keys should be unique and deterministic in nature\r\n> > ```\r\n> \r\n> Please check out the suggestion below. I think it might be a cause.\r\n\r\nThe problem was `id_` in mrc when yield was not unique. (I used index in `enumerate(paragraphs)` by mistake)\r\nI fixed it and update all the things'
 'To fix the CI you can just merge master into your branch and it should be all green hopefully :)'
 "@lhoestq\r\nThanks for reviewing!\r\n\r\nIt's harder than I thought to add dataset card. 😅 \r\nI checked and updated your suggestion (script, readme details, dummy data). \r\n\r\ndummy data is little bit larger than expected because `ner` dataset is about 80 lines and `dp` dataset is about 25 lines to avoid 0 examples.\r\n\r\nI'm not sure why some CI keep fails, can u check for this?"
 'Thanks ! That makes sense for ner and dp\r\n\r\nFor mrc on the other hand there are still too many examples, maybe you can generate the dummy data for 5 examples for all tasks except ner and dp ?'
 '> Thanks ! That makes sense for ner and dp\r\n> \r\n> For mrc on the other hand there are still too many examples, maybe you can generate the dummy data for 5 examples for all tasks except ner and dp ?\r\n\r\nYes, I generate default lines in dataset-cli for other dataset except "dp" and "ner"\r\nI fixed mrc dataset, hope it\'s fine now :)\r\n\r\nthe reason CI failed was I forgot to merge master into my branch 😅 ']
{'url': 'https://api.github.com/repos/huggingface/datasets/pulls/2416', 'html_url': 'https://github.com/huggingface/datasets/pull/2416', 'diff_url': 'https://github.com/huggingface/datasets/pull/2416.diff', 'patch_url': 'https://github.com/huggingface/datasets/pull/2416.patch', 'merged_at': datetime.datetime(2021, 6, 4, 17, 45, 15)}
Add `KLUE (Korean Language Understanding Evaluation)` dataset released recently from [paper](https://arxiv.org/abs/2105.09680), [github](https://github.com/KLUE-benchmark/KLUE) and [webpage](https://klue-benchmark.com/tasks).
Please let me know if there's anything missing in the code or README.
Thanks!



{'url': 'https://api.github.com/repos/huggingface/datasets/issues/2416/reactions', 'total_count': 2, '+1': 2, '-1': 0, 'laugh': 0, 'hooray': 0, 'confused': 0, 'heart': 0, 'rocket': 0, 'eyes': 0}