<commit_before>AO Image Reduction and Analysis Scripts
-----------------------------------------

Use these scripts to reduce data. Use the following steps:

  1. python classify.py N*.fits
  2. cat FLAT*.list DARK.list > CALS.list
  3. cat OBJECT*.list > SCI.list
  4. Process calibration frames:

    ```
    nprepare @CALS.list
    niflat flatfile=FLATFILE lampson=n//@FLAT-OPEN.list lampsoff=n//@FLAT-CLOSED.list darks=n//@DARKS.list thresh_dlo=20 thresh_dup=5000
    ```
  5. nprepare @SCI.list bpm=FLATFILE_bpm.pl<commit_msg>Skip the first of all frames<commit_after>AO Image Reduction and Analysis Scripts
-----------------------------------------

Use these scripts to reduce data. Use the following steps:

  1. python classify.py N*.fits --skip-first
  2. cat FLAT*.list DARK.list > CALS.list
  3. cat OBJECT*.list > SCI.list
  4. Process calibration frames:

    ```
    nprepare @CALS.list
    niflat flatfile=FLATFILE lampson=n//@FLAT-OPEN.list lampsoff=n//@FLAT-CLOSED.list darks=n//@DARKS.list thresh_dlo=20 thresh_dup=5000
    ```
  5. nprepare @SCI.list bpm=FLATFILE_bpm.pl
{'fraction_non_alphanumeric': 0.17889908256880735, 'fraction_numerical': 0.02018348623853211, 'mean_word_length': 2.588815789473684, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 7, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '6129801', 'n_tokens_mistral': 396, 'n_tokens_neox': 369, 'n_words': 97}