hindi discourse analysis dataset commit
{'login': 'duttahritwik', 'id': 31453142, 'node_id': 'MDQ6VXNlcjMxNDUzMTQy', 'avatar_url': 'https://avatars.githubusercontent.com/u/31453142?v=4', 'gravatar_id': '', 'url': 'https://api.github.com/users/duttahritwik', 'html_url': 'https://github.com/duttahritwik', 'followers_url': 'https://api.github.com/users/duttahritwik/followers', 'following_url': 'https://api.github.com/users/duttahritwik/following{/other_user}', 'gists_url': 'https://api.github.com/users/duttahritwik/gists{/gist_id}', 'starred_url': 'https://api.github.com/users/duttahritwik/starred{/owner}{/repo}', 'subscriptions_url': 'https://api.github.com/users/duttahritwik/subscriptions', 'organizations_url': 'https://api.github.com/users/duttahritwik/orgs', 'repos_url': 'https://api.github.com/users/duttahritwik/repos', 'events_url': 'https://api.github.com/users/duttahritwik/events{/privacy}', 'received_events_url': 'https://api.github.com/users/duttahritwik/received_events', 'type': 'User', 'site_admin': False}
[]
[]
["That's a great dataset to have! We need a couple more things to be good to go:\r\n- you should `make style` and `flake8 datasets` before pushing to make the code quality check happy :) \r\n- the dataset will need some dummy data which you should be able to auto-generate and test locally: https://github.com/huggingface/datasets/blob/master/ADD_NEW_DATASET.md#automatically-add-code-metadata\r\n- there's some good information in your current README, but we need the format to follow the template [here](https://github.com/huggingface/datasets/blob/master/templates/README.md) and to have YAML tags at the top, as described in the guide: https://github.com/huggingface/datasets/blob/master/ADD_NEW_DATASET.md#tag-the-dataset-and-write-the-dataset-card\r\n\r\nLEt us know if you need any help!"
 "Hi @yjernite \r\nI was successfully able to generate the dataset_info.json file using the command \r\npython datasets-cli test datasets/<your-dataset-folder> --save_infos --all_configs\r\n\r\nBut unfortunately, could not generate the dummy data\r\n\r\nWhile running the command \r\npython datasets-cli dummy_data datasets/<your-dataset-folder> --auto_generate\r\nI got an error as \r\n\r\nValueError: Couldn't parse columns ['0', '1', '2', '3', '4', ......, '9982']. Maybe specify which json field must be used to read the data with --json_field <my_field>.\r\n\r\nThe thing is the dataset I am trying to upload is of the format \r\n{\r\n   '0': {'Story_no': 15, 'Sentence': ' गाँठ से साढ़े तीन रुपये लग गये, जो अब पेट में जाकर खनकते भी नहीं! जो तेरी करनी मालिक! ” “इसमें मालिक की क्या करनी है? ”', 'Discourse Mode': 'Dialogue'},\r\n  '1': {'Story_no': story_no, 'Sentence': sentence, 'Discourse Mode': discourse_mode},\r\n   .......,\r\n  '9982': {'Story_no': story_no, 'Sentence': sentence, 'Discourse Mode': discourse_mode}\r\n}\r\n\r\nCan you please suggest any errors I am making in the  _generate_examples method?\r\n\r\nThanks!"
 "The dummy data generator doesn't support this kind of json format yet.\r\nCan you create the dummy data manually please ? You can get the instructions by running the \r\n```\r\ndatasets-cli dummy_data ./datasets/dataset_name\r\n```\r\ncommand."
 'Hi, I created the dummy data manually but the tests are still failing it seems.\r\nCan you suggest the format of JSON which is supported by dummy data generator?\r\nI will have to modify my _generate_examples method accordingly.\r\nPlease advice on the same.\r\nThanks much.\r\n'
 "Can you run `make style` to format the code for the CI please ?\r\n\r\nAlso about the dummy data, here is how to generate them:\r\n\r\nWe need a dummy_data.zip file in ./datasets/hindiDiscourse/dummy/1.0.0 (or replace hindiDiscourse by hindi_discourse since we have to rename the folder anyway)\r\nTo create the zip file, first go in this directory and create a folder named dummy_data.\r\nThen inside the dummy_data folder create a file `discourse_dataset.json` and fill it with something like 5 examples.\r\nFinally zip the dummy_data folder to end up with the dummy_data.zip file\r\n\r\nOnce it's done you can check if the dummy data test passes with \r\n```\r\nRUN_SLOW=1 pytest tests/test_dataset_common.py::LocalDatasetTest::test_load_dataset_all_configs_hindi_discourse\r\n```\r\n\r\nIf it passes you can then remove the dummy_data folder to keep only the dummy_data.zip file"
 'Hi @duttahritwik did you manage to make the dummy data ?\r\nFeel free to ping me if you have questions or if we can help'
 "The error `tests/test_file_utils.py::TempSeedTest::test_tensorflow` just appeared because of tensorflow's update.\r\nOnce it's fixed on master we'll be free to merge this one"
 'Ci is green on master :) ' 'merging since the CI is fixed on master']
{'url': 'https://api.github.com/repos/huggingface/datasets/pulls/1152', 'html_url': 'https://github.com/huggingface/datasets/pull/1152', 'diff_url': 'https://github.com/huggingface/datasets/pull/1152.diff', 'patch_url': 'https://github.com/huggingface/datasets/pull/1152.patch', 'merged_at': datetime.datetime(2020, 12, 14, 19, 44, 48)}
{'url': 'https://api.github.com/repos/huggingface/datasets/issues/1152/reactions', 'total_count': 0, '+1': 0, '-1': 0, 'laugh': 0, 'hooray': 0, 'confused': 0, 'heart': 0, 'rocket': 0, 'eyes': 0}