<commit_before><commit_msg>initial commit (extracted from Donload.pm)<commit_after><div id="terms">

<div class="displayPanel">
<span class="displayPanelHeader">Terms of use</span>
<div class="displayPanelContent">

If you intend to use the data in a publication, we ask you to:</p>

<ul>
<li>Notify some of the major contributors about your research.</li>
<li>Invite them to join your research project if you think it would be appropriate.</li>
<li>Either cite the download, acknowledge the major contributors by name in your paper, or cite the relevant <a href="?page=OSA">Online Systematics Archive</a>.</li>
<li><a href="?page=join_us">Join the PaleoDB</a> and contribute more data.</li>
<li>At a bare minimum, <a href="?a=publications">request a publication number</a> once your paper is accepted.</li>
</li>
</ul>

<p>If you agree to these terms, <a href="#" onClick="document.getElementById('mainPanel').style.display='inline'; document.getElementById('terms').style.display='none';">click here</a> to access the data.</p>

</div>
</div>

<div class="displayPanel" style="padding-bottom: 1em;">
<span class="displayPanelHeader">How to cite the data</span>
<div class="displayPanelContent">

<p>Example using <i>Paleobiology</i> format:</p>

<p style="margin-left: 1em;">%%paleobiology_authors%% %%year%%. %%title%%. Paleobiology Database. http://paleodb.org.</p>

<div id="show_ris">You can also upload the citation using <span class="mockLink" onClick="document.getElementById('ris_citation').style.display='inline'; document.getElementById('show_ris').style.display='none';">RIS format</span>.</div>

<div id="ris_citation" style="display: none;">
<p>Example using RIS format:</p>
<div class="small" style="margin-left: 1em; margin-bottom: 1em;">TY DBASE<br>
AU %%major_contributors%%<br>
%%keywords%%
PY %%year%%<br>
TI %%title%%<br>
DB Paleobiology Database<br>
UR http://paleodb.org<br>
Y2 %%year%%<br>
N1 The data file consists of %%occurrence_count%% occurrences that were downloaded on %%day%% %%month%% %%year%%. They derive from %%ref_count%% references and were contributed to the Paleobiology Database by %%contributor_count%% researchers.<br>
</div>
</div>

</div>
</div>

<div class="displayPanel">
<span class="displayPanelHeader">Major contributors</span>
<div class="displayPanelContent">

<p>The major contributors to this data set were:</p>

<ul>
%%major_contributor_list%%
</ul>

<p>Additional contributors include
%%other_contributors%%.
</p>

<p class="small">Each percentage is based on the estimated amount of time spent entering data by the authorizer and associated data enterers. The grand total is %%hours%% hours (equivalent to %%monthyears%%). The estimate is based on (1) date stamps for keystroked collections and (2) counts of published references used to document uploaded collections.</p>

</div>
</div>

<div class="displayPanel">
<span class="displayPanelHeader">Major sources</span>
<div class="displayPanelContent">

<p>Here are the publications that yielded the most records in this data set, in order of importance. Please cite some or all of them in any publication based on it. If possible, please also include the <a href="%%file_path%%">%%file_name%%</a> file as online supplementary information.</p>

<p>%%cites%%</p>

</div>
</div>

</div>
<div id="mainPanel" style="display: none;">

{'fraction_non_alphanumeric': 0.1548831635710006, 'fraction_numerical': 0.002396644697423607, 'mean_word_length': 6.322368421052632, 'pattern_counts': {'":': 0, '<': 92, '<?xml version=': 0, '>': 92, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 2, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '1876252', 'n_tokens_mistral': 1054, 'n_tokens_neox': 990, 'n_words': 349}