Add VCTK dataset
{'login': 'jaketae', 'id': 25360440, 'node_id': 'MDQ6VXNlcjI1MzYwNDQw', 'avatar_url': 'https://avatars.githubusercontent.com/u/25360440?v=4', 'gravatar_id': '', 'url': 'https://api.github.com/users/jaketae', 'html_url': 'https://github.com/jaketae', 'followers_url': 'https://api.github.com/users/jaketae/followers', 'following_url': 'https://api.github.com/users/jaketae/following{/other_user}', 'gists_url': 'https://api.github.com/users/jaketae/gists{/gist_id}', 'starred_url': 'https://api.github.com/users/jaketae/starred{/owner}{/repo}', 'subscriptions_url': 'https://api.github.com/users/jaketae/subscriptions', 'organizations_url': 'https://api.github.com/users/jaketae/orgs', 'repos_url': 'https://api.github.com/users/jaketae/repos', 'events_url': 'https://api.github.com/users/jaketae/events{/privacy}', 'received_events_url': 'https://api.github.com/users/jaketae/received_events', 'type': 'User', 'site_admin': False}
[]
[]
['Hello @patrickvonplaten, I hope it\'s okay to ping you with a (dumb) question!\r\n\r\nI\'ve been trying to get `dl_manager.download_and_extract(_DL_URL)` to work with no avail. I verified that this is a problem on two different machines (lab server, GCP), so I doubt it\'s an issue with network connectivity. Here is the full trace.\r\n\r\n```\r\n(venv) (base) jaketae@jake-gpu1:~/documents/datasets$ datasets-cli test datasets/vctk --save_infos --all_configs\r\nTesting builder \'main\' (1/1)\r\nDownloading and preparing dataset vctk/main to /home/jaketae/.cache/huggingface/datasets/vctk/main/0.9.2/2bfa52a93469fa9d6d4b1831c6511db5442b9f4e48620aef2bc3890d7a5268a8...\r\nTraceback (most recent call last):\r\n  File "/home/jaketae/documents/datasets/venv/bin/datasets-cli", line 33, in <module>\r\n    sys.exit(load_entry_point(\'datasets\', \'console_scripts\', \'datasets-cli\')())\r\n  File "/home/jaketae/documents/datasets/src/datasets/commands/datasets_cli.py", line 33, in main\r\n    service.run()\r\n  File "/home/jaketae/documents/datasets/src/datasets/commands/test.py", line 146, in run\r\n    builder.download_and_prepare(\r\n  File "/home/jaketae/documents/datasets/src/datasets/builder.py", line 593, in download_and_prepare\r\n    self._download_and_prepare(\r\n  File "/home/jaketae/documents/datasets/src/datasets/builder.py", line 659, in _download_and_prepare\r\n    split_generators = self._split_generators(dl_manager, **split_generators_kwargs)\r\n  File "/home/jaketae/.cache/huggingface/modules/datasets_modules/datasets/vctk/2bfa52a93469fa9d6d4b1831c6511db5442b9f4e48620aef2bc3890d7a5268a8/vctk.py", line 76, in _split_generators\r\n    root_path = dl_manager.download_and_extract(_DL_URL)\r\n  File "/home/jaketae/documents/datasets/src/datasets/utils/download_manager.py", line 283, in download_and_extract\r\n    return self.extract(self.download(url_or_urls))\r\n  File "/home/jaketae/documents/datasets/src/datasets/utils/download_manager.py", line 195, in download\r\n    downloaded_path_or_paths = map_nested(\r\n  File "/home/jaketae/documents/datasets/src/datasets/utils/py_utils.py", line 234, in map_nested\r\n    return function(data_struct)\r\n  File "/home/jaketae/documents/datasets/src/datasets/utils/download_manager.py", line 216, in _download\r\n    return cached_path(url_or_filename, download_config=download_config)\r\n  File "/home/jaketae/documents/datasets/src/datasets/utils/file_utils.py", line 298, in cached_path\r\n    output_path = get_from_cache(\r\n  File "/home/jaketae/documents/datasets/src/datasets/utils/file_utils.py", line 608, in get_from_cache\r\n    raise ConnectionError(f"Couldn\'t reach {url}")\r\nConnectionError: Couldn\'t reach https://datashare.is.ed.ac.uk/bitstream/handle/10283/3443/VCTK-Corpus-0.92.zip\r\n```\r\n\r\nOn my local, however, the URL correctly points to the download zip file. My admittedly naive guess is that the website is web-crawler or scraper proof (requiring specific headers, etc.), but I also think I might have just missed a very basic step in the process.\r\n\r\nApologies for the delayed PR, and TIA for the help!'
 "Hey @jaketae, \r\n\r\nHmm, yeah I don't know really either - the link also works correctly for me when doing:\r\n\r\n```\r\nwget https://datashare.is.ed.ac.uk/bitstream/handle/10283/3443/VCTK-Corpus-0.92.zip\r\n```\r\n\r\nI think however that I had a similar problem previously with Edinburgh's (`.ed.ac.uk`) websites which I solved with the following hack. Not sure if this could be the same problem here...\r\nhttps://github.com/huggingface/datasets/blob/e1104ad5d3e83f8b1571e0d6fef4fdabf0a1fde5/datasets/ami/ami.py#L364\r\n\r\n"
 'The AMI dataset is stored under a different website though it seems: `"https://groups.inf.ed.ac.uk/ami/AMICorpusMirror//amicorpus/{}/audio/{}"`\r\n\r\nso not 100p sure if this solves the problem'
 "Hi @patrickvonplaten,\r\n\r\nThanks for the feedback! Sadly, disabling multi-processing didn't cut it for me. \r\n\r\nI've been looking at VCTK code in [`torchaudio`](https://pytorch.org/audio/stable/_modules/torchaudio/datasets/vctk.html) and [`tfds`](https://github.com/tensorflow/datasets/blob/master/tensorflow_datasets/audio/vctk.py). I don't think they're using a hack to accomplish this, so I'll try to look into it to see if I can pinpoint the cause. I'll keep you in the loop here. Thank you!"
 "Hi @patrickvonplaten, \r\n\r\nAfter more investigation, I found that simply increasing `etag_timeout` in `get_from_cache` from 10 to 100 solved it. However, unless I'm missing something, an issue is that `etag_timeout` is basically hard-coded as a default parameter because `cached_path`, which calls `get_from_cache` has no way of modifying the default. \r\n\r\nhttps://github.com/huggingface/datasets/blob/b25ac1d62670e7b339ed552ecc37846d2abd30c7/src/datasets/utils/file_utils.py#L298-L310\r\n\r\nhttps://github.com/huggingface/datasets/blob/b25ac1d62670e7b339ed552ecc37846d2abd30c7/src/datasets/utils/file_utils.py#L497-L510\r\n\r\n\r\nI can think of two solutions.\r\n\r\n* Simply increase the default to 100\r\n* Allow `etag_timeout` to be modifiable on a per-dataset basis by integrating it to `download_config` (maybe this is already supported?)\r\n\r\nThank you!"
 'I think in this case we can increase the `etag_timeout` - what do you think @lhoestq @albertvillanova ?'
 "Yes let's increase it to 100 for the moment. Later we can see if it really needed to move it into `download_config` or not"
 "Thanks for the feedback @patrickvonplaten @lhoestq, I'll continue working on this in that direction!"
 'Hello @patrickvonplaten, VCTK is ready for review! \r\n\r\n```python\r\n>>> from datasets import load_dataset\r\n>>> ds = load_dataset("vctk")\r\nUsing the latest cached version of the module from /home/lily/jt856/.cache/huggingface/modules/datasets_modules/datasets/vctk/b7aa278182de3a7aa2897cbd12c1e19f1af9840a2ead69a6d710fdbc1d2df02a (last modified on Sat Dec 25 00:47:31 2021) since it couldn\'t be found locally at vctk., or remotely on the Hugging Face Hub.\r\nReusing dataset vctk (/home/lily/jt856/.cache/huggingface/datasets/vctk/main/0.9.2/b7aa278182de3a7aa2897cbd12c1e19f1af9840a2ead69a6d710fdbc1d2df02a)\r\n100%|████████████████████████████████████████████████████████████████████████████████| 1/1 [00:00<00:00, 198.35it/s]\r\n>>> len(ds["train"])\r\n88156\r\n>>> ds["train"][0]\r\n{\'speaker_id\': \'p225\', \'audio\': {\'path\': \'/home/lily/jt856/.cache/huggingface/datasets/downloads/extracted/8ed7dad05dfffdb552a3699777442af8e8ed11e656feb277f35bf9aea448f49e/wav48_silence_trimmed/p225/p225_001_mic1.flac\', \'array\': array([0.00485229, 0.00689697, 0.00619507, ..., 0.00811768, 0.00836182,\r\n       0.00854492], dtype=float32), \'sampling_rate\': 48000}, \'file\': \'/home/lily/jt856/.cache/huggingface/datasets/downloads/extracted/8ed7dad05dfffdb552a3699777442af8e8ed11e656feb277f35bf9aea448f49e/wav48_silence_trimmed/p225/p225_001_mic1.flac\', \'text\': \'Please call Stella.\', \'text_id\': \'001\', \'age\': \'23\', \'gender\': \'F\', \'accent\': \'English\', \'region\': \'Southern England\', \'comment\': \'\'}\r\n```\r\nA number of tests are failing on CircleCI, but from my limited knowledge they appear to be complaining about `conda` and `pip`/`wheel`-related incompatibilities. But if I\'m reading them wrong and it\'s an issue with this PR, please let me know and I\'ll try to fix them.\r\n\r\nBelated merry Christmas and a happy new year!']
{'url': 'https://api.github.com/repos/huggingface/datasets/pulls/3351', 'html_url': 'https://github.com/huggingface/datasets/pull/3351', 'diff_url': 'https://github.com/huggingface/datasets/pull/3351.diff', 'patch_url': 'https://github.com/huggingface/datasets/pull/3351.patch', 'merged_at': datetime.datetime(2021, 12, 28, 15, 5, 7)}
Fixes #1837. 
{'url': 'https://api.github.com/repos/huggingface/datasets/issues/3351/reactions', 'total_count': 0, '+1': 0, '-1': 0, 'laugh': 0, 'hooray': 0, 'confused': 0, 'heart': 0, 'rocket': 0, 'eyes': 0}