How to disable making arrow tables in load_dataset ?
Only datasets like wikipedia, wiki40b, wiki_dpr and natural questions are available already processed on the HF google storage. This is used to download directly the arrow file instead of building it from the original data files.
Is there a way to disable the construction of arrow tables, or to make them on the fly as the dataset is being used ?
How to disable making arrow tables in load_dataset ? 
 Is there a way to disable the construction of arrow tables, or to make them on the fly as the dataset is being used ? 
 Only datasets like wikipedia, wiki40b, wiki_dpr and natural questions are available already processed on the HF google storage. This is used to download directly the arrow file instead of building it from the original data files.