`load_dataset` caches two arrow files?
{'login': 'hwijeen', 'id': 29157715, 'node_id': 'MDQ6VXNlcjI5MTU3NzE1', 'avatar_url': 'https://avatars.githubusercontent.com/u/29157715?v=4', 'gravatar_id': '', 'url': 'https://api.github.com/users/hwijeen', 'html_url': 'https://github.com/hwijeen', 'followers_url': 'https://api.github.com/users/hwijeen/followers', 'following_url': 'https://api.github.com/users/hwijeen/following{/other_user}', 'gists_url': 'https://api.github.com/users/hwijeen/gists{/gist_id}', 'starred_url': 'https://api.github.com/users/hwijeen/starred{/owner}{/repo}', 'subscriptions_url': 'https://api.github.com/users/hwijeen/subscriptions', 'organizations_url': 'https://api.github.com/users/hwijeen/orgs', 'repos_url': 'https://api.github.com/users/hwijeen/repos', 'events_url': 'https://api.github.com/users/hwijeen/events{/privacy}', 'received_events_url': 'https://api.github.com/users/hwijeen/received_events', 'type': 'User', 'site_admin': False}
[{'id': 1935892912, 'node_id': 'MDU6TGFiZWwxOTM1ODkyOTEy', 'url': 'https://api.github.com/repos/huggingface/datasets/labels/question', 'name': 'question', 'color': 'd876e3', 'default': True, 'description': 'Further information is requested'}]
[]
Hi ! Files that starts with `cache-*` are cached computation files, i.e. they are the cached results of map/filter/cast/etc. operations. For example if you used `map` on your dataset to transform it, then the resulting dataset is going to be stored and cached in a `cache-*` file. These files are used to avoid having to load the dataset in RAM, even after many transforms Thanks @lhoestq! Hmm.. that's strange because I specifically turned off auto caching, and saved mapped result, using `save_to_disk`, to another location. At this location, the following file is created:`355G	cache-ed205e500a7dc44c.arrow`

To my observation, both `load_dataset` and `map` creates `cache-*` files, and I wonder what the `cache-*` file from `load_dataset` is for (as I believe the same information is stored in `json-train.arrow`. This is a wrong report -- `cache-*` files are created only my `map`, not by `load_dataset`. 
Hi,

I am using datasets to load large json file of 587G.
I checked the cached folder and found that there are two arrow files created:
* `cache-ed205e500a7dc44c.arrow` - 355G
*  `json-train.arrow` - 582G

Why is the first file created?
If I delete it, would I still be able to `load_from_disk`?
{'url': 'https://api.github.com/repos/huggingface/datasets/issues/2196/reactions', 'total_count': 0, '+1': 0, '-1': 0, 'laugh': 0, 'hooray': 0, 'confused': 0, 'heart': 0, 'rocket': 0, 'eyes': 0}