<jupyter_start><jupyter_text>THE SHAHNAMA OF FIRDAUSI DONE INTO ENGLISH BY ARTHUR GEORGE WARNER, M.A. AND EDMOND WARNER, B.A.---> The homes that are the dwellings of today>>Will sink 'neath shower and sunshine to decay,>>But storm and rain shall never mar what I>>Have built - the palace of my poetry.---<NAME>, TRENCH, TRUBNER & CO. L DEYDEN HOUSE, GERRARD STREET, W.1905  Data sourcing  Book 1[archive.org](https://archive.org/details/FirdausiShahnamaTrWarnerVol1) / [pdf](https://ia902803.us.archive.org/19/items/FirdausiShahnamaTrWarnerVol1/FirdausiShahnamaTrWarnerVol1.pdf) / [text](https://archive.org/stream/FirdausiShahnamaTrWarnerVol1/FirdausiShahnamaTrWarnerVol1_djvu.txt)  Book 1 pdf download from [archive.org](https://archive.org/details/FirdausiShahnamaTrWarnerVol1)<jupyter_code>import wget
import pathlib
import os

sourceUrl = "https://ia902803.us.archive.org/19/items/FirdausiShahnamaTrWarnerVol1/FirdausiShahnamaTrWarnerVol1.pdf"
wget.download(sourceUrl, os.path.join('./', 'book1.pdf'))<jupyter_output><empty_output><jupyter_text>Book 1 text download from [archive.org](https://archive.org/details/FirdausiShahnamaTrWarnerVol1)<jupyter_code>import wget
import pathlib
import os

sourceUrl = "https://archive.org/stream/FirdausiShahnamaTrWarnerVol1/FirdausiShahnamaTrWarnerVol1_djvu.txt"
wget.download(sourceUrl, os.path.join('./', 'book1.txt'))<jupyter_output><empty_output><jupyter_text>Book 2[archive.org](https://archive.org/details/FirdausiShahnamaTrWarnerVol2) / [pdf](https://archive.org/download/FirdausiShahnamaTrWarnerVol2/FirdausiShahnamaTrWarnerVol2.pdf) / [text](https://archive.org/stream/FirdausiShahnamaTrWarnerVol2/FirdausiShahnamaTrWarnerVol2_djvu.txt)  Book 2 pdf download from [archive.org](https://archive.org/details/FirdausiShahnamaTrWarnerVol2)<jupyter_code>import wget
import pathlib
import os

sourceUrl = "https://archive.org/download/FirdausiShahnamaTrWarnerVol2/FirdausiShahnamaTrWarnerVol2.pdf"
wget.download(sourceUrl, os.path.join('./', 'book2.pdf'))<jupyter_output><empty_output><jupyter_text>Book 2 text download from [archive.org](https://archive.org/details/FirdausiShahnamaTrWarnerVol2)<jupyter_code>import wget
import pathlib
import os

sourceUrl = "https://archive.org/stream/FirdausiShahnamaTrWarnerVol2/FirdausiShahnamaTrWarnerVol2_djvu.txt"
wget.download(sourceUrl, os.path.join('./', 'book2.txt'))<jupyter_output><empty_output>
{'fraction_non_alphanumeric': 0.12473838426119715, 'fraction_numerical': 0.021766429468396818, 'mean_word_length': 7.445229681978798, 'pattern_counts': {'":': 0, '<': 18, '<?xml version=': 0, '>': 25, 'https://': 14, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 10, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'chain_length': '4', 'dir': 'jupyter-structured-clean-dedup', 'id': '454728', 'license': 'MIT', 'n_tokens_mistral': 959, 'n_tokens_neox': 900, 'n_words': 125, 'path': 'docs/books/en/warner/shahnama.ipynb', 'repo_name': 'hdorgeval/le-livre-des-rois', 'size': '2399'}