load_dataset('cnn_dalymail', '3.0.0') gives a 'Not a directory' error
{'login': 'vishal-burman', 'id': 19861874, 'node_id': 'MDQ6VXNlcjE5ODYxODc0', 'avatar_url': 'https://avatars.githubusercontent.com/u/19861874?v=4', 'gravatar_id': '', 'url': 'https://api.github.com/users/vishal-burman', 'html_url': 'https://github.com/vishal-burman', 'followers_url': 'https://api.github.com/users/vishal-burman/followers', 'following_url': 'https://api.github.com/users/vishal-burman/following{/other_user}', 'gists_url': 'https://api.github.com/users/vishal-burman/gists{/gist_id}', 'starred_url': 'https://api.github.com/users/vishal-burman/starred{/owner}{/repo}', 'subscriptions_url': 'https://api.github.com/users/vishal-burman/subscriptions', 'organizations_url': 'https://api.github.com/users/vishal-burman/orgs', 'repos_url': 'https://api.github.com/users/vishal-burman/repos', 'events_url': 'https://api.github.com/users/vishal-burman/events{/privacy}', 'received_events_url': 'https://api.github.com/users/vishal-burman/received_events', 'type': 'User', 'site_admin': False}
[]
[]
['I get the same error. It was fixed some days ago, but again it appears'
 "Hi @mrm8488 it's working again today without any fix so I am closing this issue."
 'I see the issue happening again today - \r\n\r\n[nltk_data] Downloading package stopwords to /root/nltk_data...\r\n[nltk_data]   Package stopwords is already up-to-date!\r\nDownloading and preparing dataset cnn_dailymail/3.0.0 (download: 558.32 MiB, generated: 1.28 GiB, post-processed: Unknown size, total: 1.82 GiB) to /root/.cache/huggingface/datasets/cnn_dailymail/3.0.0/3.0.0/0128610a44e10f25b4af6689441c72af86205282d26399642f7db38fa7535602...\r\n\r\n---------------------------------------------------------------------------\r\n\r\nNotADirectoryError                        Traceback (most recent call last)\r\n\r\n<ipython-input-9-cd4bf8bea840> in <module>()\r\n     22 \r\n     23 \r\n---> 24 train = load_dataset(\'cnn_dailymail\', \'3.0.0\', split=\'train\')\r\n     25 validation = load_dataset(\'cnn_dailymail\', \'3.0.0\', split=\'validation\')\r\n     26 test = load_dataset(\'cnn_dailymail\', \'3.0.0\', split=\'test\')\r\n\r\n5 frames\r\n\r\n/root/.cache/huggingface/modules/datasets_modules/datasets/cnn_dailymail/0128610a44e10f25b4af6689441c72af86205282d26399642f7db38fa7535602/cnn_dailymail.py in _find_files(dl_paths, publisher, url_dict)\r\n    132     else:\r\n    133         logging.fatal("Unsupported publisher: %s", publisher)\r\n--> 134     files = sorted(os.listdir(top_dir))\r\n    135 \r\n    136     ret_files = []\r\n\r\nNotADirectoryError: [Errno 20] Not a directory: \'/root/.cache/huggingface/datasets/downloads/1bc05d24fa6dda2468e83a73cf6dc207226e01e3c48a507ea716dc0421da583b/cnn/stories\'\r\n\r\nCan someone please take a look ?'
 'Sometimes happens. Try in a while' 'It is working now, thank you. '
 'Has anyone solved this ? I still get this error '
 '> atal("Unsupported publisher: %s", publisher) --> 134 files = sorted(os.listdir(top_dir)) 135 136 ret_files = []\r\n> \r\n> NotADirectoryError: [Errno 20] Not a directory: \'/root/.cache/huggingface/datasets/downloads/1bc05d24fa6dda2468e83a73cf6dc207226e01e3c48a507ea716dc0421da583b/cnn/stories\'\r\n> \r\n> Can someone please take a look ?\r\n\r\n2 short-term workarounds:\r\n\r\n1.  Use this line instead `dataset = load_dataset(\'ccdv/cnn_dailymail\', \'3.0.0\')`. [In a related issue](https://github.com/huggingface/datasets/issues/996#issuecomment-997343101), this person mentioned another data source copy that just works.\r\n2.  Use the same data source, but edit the urls.  Instead of google drive quota problems mentioned in #996, I was getting the "can\'t scan this file for viruses" problem, which results in that prompted html getting downloaded instead of the files.  You can get around this by:\r\n    1. Look at the traceback and find out where `cnn_dailymail.py` is on your computer.\r\n    2. Edit the `cnn_stories` and `dm_stories` url\'s by adding the following to the end of them `&confirm=t`.  This should be around line 67.\r\n    3. You may have to remove those confirmation html files in your download directory (`~/.cache/huggingface/datasets/downloads` for me) so that they don\'t get in the way of the new download attempts.\r\n\r\nEither method works for me.  I would\'ve made a PR, but not sure if they want to go with the new ccdv/cnn_dailymail source or not.'
 'experience the same problem, ccdv/cnn_dailymail not working either. \r\n\r\nSolve this problem by installing datasets library from the master branch:\r\npython -m pip install git+https://github.com/huggingface/datasets.git@master'
 'Seem to be getting this again even with 1.18.4. I believe it worked yesterday.'
 'Hitting this one as well.'
 '>Hitting this one as well.\r\n\r\nHas anyone solved this ? I still get this error'
 "@yoheimiyamoto The solution provided by @davidshinn  (i.e. `dataset = load_dataset('ccdv/cnn_dailymail', '3.0.0')`) worked for me."]
```
from datasets import load_dataset
dataset = load_dataset('cnn_dailymail', '3.0.0')
```
Stack trace:
```
---------------------------------------------------------------------------

NotADirectoryError                        Traceback (most recent call last)

<ipython-input-6-2e06a8332652> in <module>()
      1 from datasets import load_dataset
----> 2 dataset = load_dataset('cnn_dailymail', '3.0.0')

5 frames

/usr/local/lib/python3.6/dist-packages/datasets/load.py in load_dataset(path, name, data_dir, data_files, split, cache_dir, features, download_config, download_mode, ignore_verifications, save_infos, script_version, **config_kwargs)
    608         download_config=download_config,
    609         download_mode=download_mode,
--> 610         ignore_verifications=ignore_verifications,
    611     )
    612 

/usr/local/lib/python3.6/dist-packages/datasets/builder.py in download_and_prepare(self, download_config, download_mode, ignore_verifications, try_from_hf_gcs, dl_manager, **download_and_prepare_kwargs)
    513                     if not downloaded_from_gcs:
    514                         self._download_and_prepare(
--> 515                             dl_manager=dl_manager, verify_infos=verify_infos, **download_and_prepare_kwargs
    516                         )
    517                     # Sync info

/usr/local/lib/python3.6/dist-packages/datasets/builder.py in _download_and_prepare(self, dl_manager, verify_infos, **prepare_split_kwargs)
    568         split_dict = SplitDict(dataset_name=self.name)
    569         split_generators_kwargs = self._make_split_generators_kwargs(prepare_split_kwargs)
--> 570         split_generators = self._split_generators(dl_manager, **split_generators_kwargs)
    571 
    572         # Checksums verification

/root/.cache/huggingface/modules/datasets_modules/datasets/cnn_dailymail/0128610a44e10f25b4af6689441c72af86205282d26399642f7db38fa7535602/cnn_dailymail.py in _split_generators(self, dl_manager)
    252     def _split_generators(self, dl_manager):
    253         dl_paths = dl_manager.download_and_extract(_DL_URLS)
--> 254         train_files = _subset_filenames(dl_paths, datasets.Split.TRAIN)
    255         # Generate shared vocabulary
    256 

/root/.cache/huggingface/modules/datasets_modules/datasets/cnn_dailymail/0128610a44e10f25b4af6689441c72af86205282d26399642f7db38fa7535602/cnn_dailymail.py in _subset_filenames(dl_paths, split)
    153     else:
    154         logging.fatal("Unsupported split: %s", split)
--> 155     cnn = _find_files(dl_paths, "cnn", urls)
    156     dm = _find_files(dl_paths, "dm", urls)
    157     return cnn + dm

/root/.cache/huggingface/modules/datasets_modules/datasets/cnn_dailymail/0128610a44e10f25b4af6689441c72af86205282d26399642f7db38fa7535602/cnn_dailymail.py in _find_files(dl_paths, publisher, url_dict)
    132     else:
    133         logging.fatal("Unsupported publisher: %s", publisher)
--> 134     files = sorted(os.listdir(top_dir))
    135 
    136     ret_files = []

NotADirectoryError: [Errno 20] Not a directory: '/root/.cache/huggingface/datasets/downloads/1bc05d24fa6dda2468e83a73cf6dc207226e01e3c48a507ea716dc0421da583b/cnn/stories'
```
I have ran the code on Google Colab
{'url': 'https://api.github.com/repos/huggingface/datasets/issues/873/reactions', 'total_count': 1, '+1': 1, '-1': 0, 'laugh': 0, 'hooray': 0, 'confused': 0, 'heart': 0, 'rocket': 0, 'eyes': 0}