Add option to delete temporary files (e.g. extracted files) when loading dataset
Also, if I delete the extracted files they need to be re-extracted again instead of loading from the Arrow cache files
I'm loading a dataset constituted of 44 GB of compressed JSON files.

When loading the dataset with the JSON script, extracting the files create about 200 GB of uncompressed files before creating the 180GB of arrow cache tables

Having a simple way to delete the extracted files after usage (or even better, to stream extraction/delete) would be nice to avoid disk cluter.

I can maybe tackle this one in the JSON script unless you want a more general solution.
Add option to delete temporary files (e.g. extracted files) when loading dataset 
 I'm loading a dataset constituted of 44 GB of compressed JSON files.

When loading the dataset with the JSON script, extracting the files create about 200 GB of uncompressed files before creating the 180GB of arrow cache tables

Having a simple way to delete the extracted files after usage (or even better, to stream extraction/delete) would be nice to avoid disk cluter.

I can maybe tackle this one in the JSON script unless you want a more general solution. 
 Also, if I delete the extracted files they need to be re-extracted again instead of loading from the Arrow cache files