'cp950' codec error from load_dataset('xtreme', 'tydiqa')
{'login': 'jerryIsHere', 'id': 50871412, 'node_id': 'MDQ6VXNlcjUwODcxNDEy', 'avatar_url': 'https://avatars.githubusercontent.com/u/50871412?v=4', 'gravatar_id': '', 'url': 'https://api.github.com/users/jerryIsHere', 'html_url': 'https://github.com/jerryIsHere', 'followers_url': 'https://api.github.com/users/jerryIsHere/followers', 'following_url': 'https://api.github.com/users/jerryIsHere/following{/other_user}', 'gists_url': 'https://api.github.com/users/jerryIsHere/gists{/gist_id}', 'starred_url': 'https://api.github.com/users/jerryIsHere/starred{/owner}{/repo}', 'subscriptions_url': 'https://api.github.com/users/jerryIsHere/subscriptions', 'organizations_url': 'https://api.github.com/users/jerryIsHere/orgs', 'repos_url': 'https://api.github.com/users/jerryIsHere/repos', 'events_url': 'https://api.github.com/users/jerryIsHere/events{/privacy}', 'received_events_url': 'https://api.github.com/users/jerryIsHere/received_events', 'type': 'User', 'site_admin': False}
[{'id': 2067388877, 'node_id': 'MDU6TGFiZWwyMDY3Mzg4ODc3', 'url': 'https://api.github.com/repos/huggingface/datasets/labels/dataset%20bug', 'name': 'dataset bug', 'color': '2edb81', 'default': False, 'description': 'A bug in a dataset script provided in the library'}]
[]
["This is probably a Windows issue, we need to specify the encoding when `load_dataset()` reads the original CSV file.\r\nTry to find the `open()` statement called by `load_dataset()` and add an `encoding='utf-8'` parameter.\r\nSee issues #242 and #307 "
 'It should be in `xtreme.py:L755`:\r\n```python\r\n        if self.config.name == "tydiqa" or self.config.name.startswith("MLQA") or self.config.name == "SQuAD":\r\n            with open(filepath) as f:\r\n                data = json.load(f)\r\n```\r\n\r\nCould you try to add the encoding parameter:\r\n```python\r\nopen(filepath, encoding=\'utf-8\')\r\n```'
 'Hello @jerryIsHere :) Did it work ?\r\nIf so we may change the dataset script to force the utf-8 encoding'
 '@lhoestq sorry for being that late, I found 4 copy of xtreme.py. I did the changes as what has been told to all of them.\r\nThe problem is not solved'
 "Could you provide a better error message so that we can make sure it comes from the opening of the `tydiqa`'s json files ?\r\n"
 '@lhoestq \r\nThe error message is same as before:\r\nException has occurred: UnicodeDecodeError\r\n\'cp950\' codec can\'t decode byte 0xe2 in position 111: illegal multibyte sequence\r\n  File "D:\\python\\test\\test.py", line 3, in <module>\r\n    dataset = load_dataset(\'xtreme\', \'tydiqa\')\r\n\r\n![image](https://user-images.githubusercontent.com/50871412/87748794-7c216880-c829-11ea-94f0-7caeacb4d865.png)\r\n\r\nI said that I found 4 copy of xtreme.py and add the 「, encoding=\'utf-8\'」 parameter to the open() function\r\nthese python script was found under this directory\r\nC:\\Users\\USER\\AppData\\Local\\Programs\\Python\\Python37\\Lib\\site-packages\\nlp\\datasets\\xtreme\r\n'
 "Hi there !\r\nI encountered the same issue with the IMDB dataset on windows. It threw an error about charmap not being able to decode a symbol during the first time I tried to download it. I checked on a remote linux machine I have, and it can't be reproduced.\r\nI added ```encoding='UTF-8'``` to both lines that have ```open``` in ```imdb.py```  (108 and 114) and it worked for me.\r\nThank you !"
 "> Hi there !\r\n> I encountered the same issue with the IMDB dataset on windows. It threw an error about charmap not being able to decode a symbol during the first time I tried to download it. I checked on a remote linux machine I have, and it can't be reproduced.\r\n> I added `encoding='UTF-8'` to both lines that have `open` in `imdb.py` (108 and 114) and it worked for me.\r\n> Thank you !\r\n\r\nHello !\r\nGlad you managed to fix this issue on your side.\r\nDo you mind opening a PR for IMDB ?"
 "> This is probably a Windows issue, we need to specify the encoding when `load_dataset()` reads the original CSV file.\r\n> Try to find the `open()` statement called by `load_dataset()` and add an `encoding='utf-8'` parameter.\r\n> See issues #242 and #307\r\n\r\nSorry for not responding for about a month.\r\nI have just found that it is necessary to change / add the environment variable as what was told in #242.\r\nEverything works after I add the new environment variable and restart my PC.\r\n\r\nI think the encoding issue for windows isn't limited to the open() function call specific to few dataset, but actually in the entire library, depends on the machine / os you use."
 'Since #481 we shouldn\'t have other issues with encodings as they need to be set to "utf-8" be default.\r\n\r\nClosing this one, but feel free to re-open if you gave other questions']
![image](https://user-images.githubusercontent.com/50871412/86744744-67481680-c06c-11ea-8612-b77eba92a392.png)

I guess the error is related to python source encoding issue that my PC is trying to decode the source code with wrong encoding-decoding tools, perhaps :
https://www.python.org/dev/peps/pep-0263/

I guess the error was triggered by the code " module = importlib.import_module(module_path)" at line 57 in the source code:  nlp/src/nlp/load.py / (https://github.com/huggingface/nlp/blob/911d5596f9b500e39af8642fe3d1b891758999c7/src/nlp/load.py#L51)

Any ideas?

p.s. tried the same code on colab, that runs perfectly

{'url': 'https://api.github.com/repos/huggingface/datasets/issues/347/reactions', 'total_count': 0, '+1': 0, '-1': 0, 'laugh': 0, 'hooray': 0, 'confused': 0, 'heart': 0, 'rocket': 0, 'eyes': 0}