<commit_before><div id="about">
  <h3>Background</h3>
  <p>
    Experts in both <a href="http://www.fluentin3months.com/80-20-rule/">language learning</a> and <a href="http://www.fourhourworkweek.com/blog/2009/01/20/learning-language/">workflow efficiency</a> apply the Pareto principle, or the 80-20 rule, to learning a foreign language. That principle states that roughly 80% of outcomes result from only 20% of the inputs.
  </p>
  <p>
    <a href="www.oxforddictionaries.com/us/words/the-oec-facts-about-the-language">Oxford Dictionaries</a> estimates that just 10 different lemmas, or basic word forms, account for 25% of English language content. That figure jumps to 50% at 100 words and 75% at 1000. So why focus on complicated grammar and vocabulary when so few words comprise so much of our everyday communication?
  </p>
  <p>
    This site displays the most common words in <%= Language.all.length %> languages, as gathered from sources like <a href="http://www.opensubtitles.org/">Open SubTitles</a> and <a href="https://en.wiktionary.org/wiki/Wiktionary:Frequency_lists">Wiktionary frequency lists</a>. Users can test their knowledge of essential vocabulary by hovering over each word for the Google Translation to English.
  </p>
  
  <h3>Technical Features:</h3>
    <ul>
      <li><p>Frequency lists of foreign language vocabulary for 12 languages.</p></li>
      <li><p>Ajax (for faster page loads) and <a href="">Pjax</a> (to maintain permalinking and bookmarking).</p></li>
      <li><p>Google translations for each word appear in real-time on mouseover.</p></li>
      <li><p>JavaScript game to test foreign language knowledge.</p></li>
    </ul>
    <p>The full code is accessible <a href="https://github.com/chriskohlbrenner/language8020">on Github</a>.</p>
    
  <h3>The Team:</h3>
    <p>Language 80/20 was built by <a href="https://github.com/chriskohlbrenner"><NAME></a>, <a href="https://github.com/JisuKim82"><NAME></a>, and <a href="https://github.com/amcaplan"><NAME></a> while they were students at the Flatiron School in New York.</p>
</div><commit_msg>revise typo<commit_after><div id="about">
  <h3>Background</h3>
  <p>
    Experts in both <a href="http://www.fluentin3months.com/80-20-rule/">language learning</a> and <a href="http://www.fourhourworkweek.com/blog/2009/01/20/learning-language/">workflow efficiency</a> apply the Pareto principle, or the 80-20 rule, to learning a foreign language. That principle states that roughly 80% of outcomes result from only 20% of the inputs.
  </p>
  <p>
    <a href="www.oxforddictionaries.com/us/words/the-oec-facts-about-the-language">Oxford Dictionaries</a> estimates that just 10 different lemmas, or basic word forms, account for 25% of English language content. That figure jumps to 50% at 100 words and 75% at 1000. So why focus on complicated grammar and vocabulary when so few words comprise so much of our everyday communication?
  </p>
  <p>
    This site displays the most common words in <%= Language.all.length %> languages, as gathered from sources like <a href="http://www.opensubtitles.org/">Open SubTitles</a> and <a href="https://en.wiktionary.org/wiki/Wiktionary:Frequency_lists">Wiktionary frequency lists</a>. Users can test their knowledge of essential vocabulary by hovering over each word for the Google Translation to English.
  </p>
  
  <h3>Technical Features:</h3>
    <ul>
      <li><p>Frequency lists of foreign language vocabulary for 14 languages.</p></li>
      <li><p>Ajax (for faster page loads) and <a href="">Pjax</a> (to maintain permalinking and bookmarking).</p></li>
      <li><p>Google translations for each word appear in real-time on mouseover.</p></li>
      <li><p>JavaScript game to test foreign language knowledge.</p></li>
    </ul>
    <p>The full code is accessible <a href="https://github.com/chriskohlbrenner/language8020">on Github</a>.</p>
    
  <h3>The Team:</h3>
    <p>Language 80/20 was built by <a href="https://github.com/chriskohlbrenner"><NAME></a>, <a href="https://github.com/JisuKim82"><NAME></a>, and <a href="https://github.com/amcaplan"><NAME></a> while they were students at the Flatiron School in New York.</p>
</div>
{'fraction_non_alphanumeric': 0.13854266538830298, 'fraction_numerical': 0.02588686481303931, 'mean_word_length': 4.2293233082706765, 'pattern_counts': {'":': 0, '<': 123, '<?xml version=': 0, '>': 123, 'https://': 10, 'lorem ipsum': 0, 'www.': 8, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '2208501', 'n_tokens_mistral': 1399, 'n_tokens_neox': 1260, 'n_words': 434}