Unable to view the dataset and loading the same dataset throws the error - ArrowInvalid: Exceeded maximum rows
{'login': 'Pavithree', 'id': 23344465, 'node_id': 'MDQ6VXNlcjIzMzQ0NDY1', 'avatar_url': 'https://avatars.githubusercontent.com/u/23344465?v=4', 'gravatar_id': '', 'url': 'https://api.github.com/users/Pavithree', 'html_url': 'https://github.com/Pavithree', 'followers_url': 'https://api.github.com/users/Pavithree/followers', 'following_url': 'https://api.github.com/users/Pavithree/following{/other_user}', 'gists_url': 'https://api.github.com/users/Pavithree/gists{/gist_id}', 'starred_url': 'https://api.github.com/users/Pavithree/starred{/owner}{/repo}', 'subscriptions_url': 'https://api.github.com/users/Pavithree/subscriptions', 'organizations_url': 'https://api.github.com/users/Pavithree/orgs', 'repos_url': 'https://api.github.com/users/Pavithree/repos', 'events_url': 'https://api.github.com/users/Pavithree/events{/privacy}', 'received_events_url': 'https://api.github.com/users/Pavithree/received_events', 'type': 'User', 'site_admin': False}
[{'id': 1935892857, 'node_id': 'MDU6TGFiZWwxOTM1ODkyODU3', 'url': 'https://api.github.com/repos/huggingface/datasets/labels/bug', 'name': 'bug', 'color': 'd73a4a', 'default': True, 'description': "Something isn't working"}]
[]
["Thanks for reporting. I'm looking at it"
 '  It\'s not related to the dataset viewer in itself. I can replicate the error with:\r\n\r\n```\r\n>>> import datasets as ds\r\n>>> d = ds.load_dataset(\'Pavithree/explainLikeImFive\')\r\nUsing custom data configuration Pavithree--explainLikeImFive-b68b6d8112cd8a51\r\nDownloading and preparing dataset json/Pavithree--explainLikeImFive to /home/slesage/.cache/huggingface/datasets/json/Pavithree--explainLikeImFive-b68b6d8112cd8a51/0.0.0/ac0ca5f5289a6cf108e706efcf040422dbbfa8e658dee6a819f20d76bb84d26b...\r\nDownloading data: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 305M/305M [00:03<00:00, 98.6MB/s]\r\nDownloading data: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 17.9M/17.9M [00:00<00:00, 75.7MB/s]\r\nDownloading data: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 11.9M/11.9M [00:00<00:00, 70.6MB/s]\r\nDownloading data files: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 3/3 [00:05<00:00,  1.92s/it]\r\nExtracting data files: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 3/3 [00:00<00:00, 1948.42it/s]\r\nFailed to read file \'/home/slesage/.cache/huggingface/datasets/downloads/5fee9c8819754df277aee6f252e4db6897d785231c21938407b8862ca871d246\' with error <class \'pyarrow.lib.ArrowInvalid\'>: Exceeded maximum rows\r\nTraceback (most recent call last):\r\n  File "/home/slesage/hf/datasets/src/datasets/packaged_modules/json/json.py", line 144, in _generate_tables\r\n    dataset = json.load(f)\r\n  File "/home/slesage/.pyenv/versions/3.8.11/lib/python3.8/json/__init__.py", line 293, in load\r\n    return loads(fp.read(),\r\n  File "/home/slesage/.pyenv/versions/3.8.11/lib/python3.8/json/__init__.py", line 357, in loads\r\n    return _default_decoder.decode(s)\r\n  File "/home/slesage/.pyenv/versions/3.8.11/lib/python3.8/json/decoder.py", line 340, in decode\r\n    raise JSONDecodeError("Extra data", s, end)\r\njson.decoder.JSONDecodeError: Extra data: line 1 column 916 (char 915)\r\n\r\nDuring handling of the above exception, another exception occurred:\r\n\r\nTraceback (most recent call last):\r\n  File "<stdin>", line 1, in <module>\r\n  File "/home/slesage/hf/datasets/src/datasets/load.py", line 1691, in load_dataset\r\n    builder_instance.download_and_prepare(\r\n  File "/home/slesage/hf/datasets/src/datasets/builder.py", line 605, in download_and_prepare\r\n    self._download_and_prepare(\r\n  File "/home/slesage/hf/datasets/src/datasets/builder.py", line 694, in _download_and_prepare\r\n    self._prepare_split(split_generator, **prepare_split_kwargs)\r\n  File "/home/slesage/hf/datasets/src/datasets/builder.py", line 1151, in _prepare_split\r\n    for key, table in logging.tqdm(\r\n  File "/home/slesage/.pyenv/versions/datasets/lib/python3.8/site-packages/tqdm/std.py", line 1168, in __iter__\r\n    for obj in iterable:\r\n  File "/home/slesage/hf/datasets/src/datasets/packaged_modules/json/json.py", line 146, in _generate_tables\r\n    raise e\r\n  File "/home/slesage/hf/datasets/src/datasets/packaged_modules/json/json.py", line 122, in _generate_tables\r\n    pa_table = paj.read_json(\r\n  File "pyarrow/_json.pyx", line 246, in pyarrow._json.read_json\r\n  File "pyarrow/error.pxi", line 143, in pyarrow.lib.pyarrow_internal_check_status\r\n  File "pyarrow/error.pxi", line 99, in pyarrow.lib.check_status\r\npyarrow.lib.ArrowInvalid: Exceeded maximum rows\r\n```\r\n\r\ncc @lhoestq @albertvillanova @mariosasko '
 'It seems that train.json is not a valid JSON Lines file: it has several JSON objects in the first line (the 915th character in the first line starts a new object, and there\'s no "\\n")\r\n\r\nYou need to have one JSON object per line'
 "I'm closing this issue.\r\n\r\n@Pavithree, please, feel free to re-open it if fixing the JSON file does not solve it."
 'Thank you! that fixes the issue.']
## Dataset viewer issue - -ArrowInvalid: Exceeded maximum rows

**Link:** *https://huggingface.co/datasets/Pavithree/explainLikeImFive*

*This is the subset of original eli5 dataset  https://huggingface.co/datasets/vblagoje/lfqa. I just filtered the data samples which belongs to one particular subreddit thread. However, the dataset preview for train split  returns  the below mentioned error:
Status code:   400
Exception:     ArrowInvalid
Message:       Exceeded maximum rows
When I try to load the same dataset it returns ArrowInvalid: Exceeded maximum rows error*

Am I the one who added this dataset ? Yes 

{'url': 'https://api.github.com/repos/huggingface/datasets/issues/4107/reactions', 'total_count': 0, '+1': 0, '-1': 0, 'laugh': 0, 'hooray': 0, 'confused': 0, 'heart': 0, 'rocket': 0, 'eyes': 0}