<commit_before>```mermaid
graph LR;
REQ([Request from Orangelight])-->OPEN{Library Open?}
OPEN--Yes-->INPROCESS{In Process?}
OPEN--No--------->HELP([Help Me Get It])
INPROCESS--No-->ONORDER{On Order?}
INPROCESS--Yes-->EMAIL([Email Request])
ONORDER--No-->ITEMS{Has Items?}
ITEMS--YES-->AVAIL{Available?}
AVAIL--Yes-->OFFSITE{"Offsite?"}
ITEMS--No------>EMAIL
ONORDER--Yes-->EMAIL
AVAIL--No----->ILL([Inter Library Loan])
OFFSITE--No-->INLIB{In Library Only?}
INLIB--Yes-->DIG{Can Digitize?}
DIG--Yes-->L([Digitize])
DIG--No-->NOOPT([??No Form Options?? ])
INLIB--No-->NOOPT
OFFSITE--Yes-->OFFSITEDIG{Can Digitize?}
OFFSITEDIG--Yes--->PICKDIG([Pick up or Digitize])
OFFSITEDIG--No--->PICK([Pickup])
```<commit_msg>Updated to validate the entire doc<commit_after>```mermaid
graph LR;
REQ([Request from Orangelight])-->AEON{In AEON}
AEON--Yes----------->AEONSYS([AEON Open URL])
AEON--No-->OPEN{Library Open?}
OPEN--Yes-->INPROCESS{In Process?}
OPEN--No---------->HELP([Help Me Get It])
INPROCESS--No-->ONORDER{On Order?}
INPROCESS--Yes-->EMAIL([Email Request])
ONORDER--No-->ITEMS{Has Items?}
ITEMS--YES-->AVAIL{Available?}
AVAIL--Yes-->INLIB{In Library Only?}
ITEMS--No------->EMAIL
ONORDER--Yes-->EMAIL
AVAIL--No------>ILL([Inter Library Loan])
INLIB--Yes-->OFFSITE{"Offsite?"}
INLIB--No-->DIG{Can Digitize?}
DIG--Yes-->PICKDIG
DIG--No-->PICK
OFFSITE--Yes-->OFFSITEDIG{Can Digitize?}
OFFSITE--No-->OFFSITEINDIG{Can Digitize?}
OFFSITEINDIG--Yes--->DIGITIZE([Digitze])
OFFSITEINDIG--No--->NOOPT([No Form Options ])
OFFSITEDIG--Yes--->PICKDIG([Pick-up or Digitize])
OFFSITEDIG--No--->PICK([Pick-up])
```
{'fraction_non_alphanumeric': 0.255625, 'fraction_numerical': 0.0, 'mean_word_length': 4.115015974440895, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 45, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '1754624', 'n_tokens_mistral': 642, 'n_tokens_neox': 615, 'n_words': 98}