WIP. Updated download file. Can now download all files. Need to integrate that code to loop through all files to download or combine files first into a single dataframe and then save that
0a77c60
Corey Morriscommited on
added new test for a file that currently can be downloaded
6251f5a
Corey Morriscommited on
Replicating 404 error with a test so I can troubleshoot
9adae3c
Corey Morriscommited on
Updated download_file method
b58e1f0
Corey Morriscommited on
Build URL from file path is working
cc32c4f
Corey Morriscommited on
Find files is working as expected
30fa96a
Corey Morriscommited on
WIP commit. Finding files can be identical as the method in results_data_processor.
c32735e
Corey Morriscommited on
added mostly hardcoded generate url method and test
83a34f0
Corey Morriscommited on
Added download file method and test
513e813
Corey Morriscommited on
Added basic structure of details data processing and testing. For downloading huggingface details dataset files