<commit_before>This document describes the process of processing IceBridge images. 

The data is available from

https://nsidc.org/data/icebridge/data_summaries.html#camera

including camera information, raw imagery, orthorectified imagery, LIDAR point clouds
that can be used for alignment, and pre-existing DEMs for some of the flights. 

To be able to fetch any data, one should create an account with NSIDC,
and then set up bulk downloading by following the instructions at

https://nsidc.org/support/faq/what-options-are-available-bulk-downloading-data-https-earthdata-login-enabled

For some flights, the camera (and hence its calibration file) changed in mid-flight, detailed info about this is available at 

https://nsidc.org/data/IODCC0/versions/1

in the "User Guide" tab, while all the camera calibration files can be
fetched recursively using the command:

wget -e robots=off --load-cookies ~/.urs_cookies --save-cookies ~/.urs_cookies --keep-session-cookies --no-check-certificate --auth-no-challenge=on --no-parent -r -l 10 https://n5eil01u.ecs.nsidc.org/ICEBRIDGE/IODCC0.001/

A pdf file containing camera information can be converted to the .tsai format used by ASP using the script

StereoPipeline/src/asp/IceBridge/process_calibration_file.py 

The images can then be processed via the script:

StereoPipeline/src/asp/IceBridge/full_processing_script.py 
<commit_msg>Reword README.txt<commit_after>This document describes the process of processing IceBridge images to
create DEMs that are aligned to the LIDAR ground reference.

The data is available from

https://nsidc.org/data/icebridge/data_summaries.html#camera

including camera information, raw imagery, orthorectified imagery, LIDAR point clouds
that can be used for alignment, and pre-existing DEMs for some of the flights. 

To be able to fetch any data, one should create an account with NSIDC,
and then set up bulk downloading by following the instructions at

https://nsidc.org/support/faq/what-options-are-available-bulk-downloading-data-https-earthdata-login-enabled

For some flights, the camera (and hence its calibration file) changed in mid-flight, detailed info about this is available at 

https://nsidc.org/data/IODCC0/versions/1

in the "User Guide" tab. The camera calibration files can be fetched
recursively using the command:

wget -e robots=off --load-cookies ~/.urs_cookies --save-cookies ~/.urs_cookies --keep-session-cookies --no-check-certificate --auth-no-challenge=on --no-parent -r -l 10 https://n5eil01u.ecs.nsidc.org/ICEBRIDGE/IODCC0.001/

These files are in the PDF format, and can be converted to the .tsai
format used by ASP using the script

StereoPipeline/src/asp/IceBridge/process_calibration_file.py 

The images can then be processed via the tool:

StereoPipeline/src/asp/IceBridge/full_processing_script.py 

{'fraction_non_alphanumeric': 0.07793127878143818, 'fraction_numerical': 0.0077931278781438185, 'mean_word_length': 4.515625, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 8, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 4, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '4598712', 'n_tokens_mistral': 891, 'n_tokens_neox': 831, 'n_words': 310}