Adding The Microsoft Terminology Collection dataset.
{'login': 'leoxzhao', 'id': 7915719, 'node_id': 'MDQ6VXNlcjc5MTU3MTk=', 'avatar_url': 'https://avatars.githubusercontent.com/u/7915719?v=4', 'gravatar_id': '', 'url': 'https://api.github.com/users/leoxzhao', 'html_url': 'https://github.com/leoxzhao', 'followers_url': 'https://api.github.com/users/leoxzhao/followers', 'following_url': 'https://api.github.com/users/leoxzhao/following{/other_user}', 'gists_url': 'https://api.github.com/users/leoxzhao/gists{/gist_id}', 'starred_url': 'https://api.github.com/users/leoxzhao/starred{/owner}{/repo}', 'subscriptions_url': 'https://api.github.com/users/leoxzhao/subscriptions', 'organizations_url': 'https://api.github.com/users/leoxzhao/orgs', 'repos_url': 'https://api.github.com/users/leoxzhao/repos', 'events_url': 'https://api.github.com/users/leoxzhao/events{/privacy}', 'received_events_url': 'https://api.github.com/users/leoxzhao/received_events', 'type': 'User', 'site_admin': False}
[]
[]
["I have to manually copy a dataset_infos.json file from other dataset and modify it since the `datasets-cli` isn't able to handle manually downloaded datasets yet (as far as I know)."
 'you can generate the dataset_infos.json file even for dataset with manual data\r\nTo do so just specify `--data_dir <path/to/the/folder/containing/the/manual/data>`'
 'Also, dummy_data seems having difficulty to handle manually downloaded datasets. `python datasets-cli dummy_data datasets/ms_terms  --data_dir ...` reported `error: unrecognized arguments: --data_dir` error. Without `--data_dir`, it reported this error:\r\n```\r\nDataset ms_terms with config BuilderConfig(name=\'ms_terms-full\', version=1.0.0, data_dir=None, data_files=None, description=\'...\\n\') seems to already open files in the method `_split_generators(...)`. You might consider to instead only open files in the method `_generate_examples(...)` instead. If this is not possible the dummy data has to be created with less guidance. Make sure you create the file None.\r\nTraceback (most recent call last):\r\n  File "datasets-cli", line 36, in <module>\r\n    service.run()\r\n  File "/Users/lzhao/Downloads/huggingface/datasets/src/datasets/commands/dummy_data.py", line 326, in run\r\n    dataset_builder=dataset_builder, mock_dl_manager=mock_dl_manager\r\n  File "/Users/lzhao/Downloads/huggingface/datasets/src/datasets/commands/dummy_data.py", line 406, in _print_dummy_data_instructions\r\n    for split in generator_splits:\r\nUnboundLocalError: local variable \'generator_splits\' referenced before assignment\r\n```'
 "Oh yes `--data_dir` seems to only be supported for the `datasets_cli test` command. Sorry about that.\r\n\r\nCan you try to build the dummy_data.zip file manually ?\r\n\r\nIt has to be inside `./datasets/ms_terms/dummy/ms_terms-full/1.0.0`.\r\nInside this folder, please create a folder `dummy_data` that contains a dummy file `MicrosoftTermCollection.tbx` (with just a few examples in it). Then you can zip the `dummy_data` folder to `dummy_data.zip`\r\n\r\nThen you can check if it worked using the command\r\n```\r\npytest tests/test_dataset_common.py::LocalDatasetTest::test_load_dataset_ms_terms\r\n```\r\n\r\nFeel free to use some debugging print statements in your script if it doesn't work first try to see what `dl_manager.manual_dir` ends up being and also `path_to_manual_file`.\r\n\r\nFeel free to ping me if you have other questions"
 '`pytest tests/test_dataset_common.py::LocalDatasetTest::test_load_dataset_ms_terms` gave `1 passed, 4 warnings in 8.13s`. Existing datasets, like `wikihow`, and `newsroom`, also report 4 warnings. So, I guess that is not related to this dataset.'
 'Could you run `make style` before we merge @leoxzhao ?'
 "the other errors are fixed on master so it's fine"
 '> Could you run `make style` before we merge @leoxzhao ?\r\n\r\nSure thing. Done. Thanks Quentin. I have other datasets in mind. All of which requires manual download. This process is very helpful'
 'Thank you :) ']
{'url': 'https://api.github.com/repos/huggingface/datasets/pulls/973', 'html_url': 'https://github.com/huggingface/datasets/pull/973', 'diff_url': 'https://github.com/huggingface/datasets/pull/973.diff', 'patch_url': 'https://github.com/huggingface/datasets/pull/973.patch', 'merged_at': datetime.datetime(2020, 12, 4, 15, 12, 46)}
{'url': 'https://api.github.com/repos/huggingface/datasets/issues/973/reactions', 'total_count': 0, '+1': 0, '-1': 0, 'laugh': 0, 'hooray': 0, 'confused': 0, 'heart': 0, 'rocket': 0, 'eyes': 0}