<commit_before>  === About
  Simple application that helps you learn foreign words.

  === Installation
  Installation process is quite simple (notice, that ruby could be already installed)

  * install ruby from http://www.ruby-lang.org/en/downloads/

  * install rubygems from http://rubygems.org/pages/download

  * execute
        gem install learn_words
    to install application itself

  === Words file
  To use this application you need to have a file in a special format:

  * any number of lines with foreign word and it's translation separated by <tt><Tab></tt>

  * if there are more than one variant for foreign word, separate them by "/"

  * if line starts with "#" it is ignored

  Examples:
      apple       яблоко
      # some comments
      city/town   город

  === Usage
  Now execute
      learn_words /path/to/file/with/words
  to start learning words. There are two options:

  * <tt>--limit N</tt> - used for setting limit of words learning,
    you would be asked while you answer N times correctly

  * <tt>--part M/K</tt> - used for splitting big lists of words into parts,
    K - total number of parts, M - index of part to learn (1 <= M <= K)

  While learning words you can use 3 commands:
  * <tt>exit</tt> - to quit (or <tt>^C</tt>, or <tt>^D</tt>)
  * <tt>?</tt> - to get stats (how many learned, how many to learn)
  * <tt>!</tt> - to mark the word as learnt (or ban it)
<commit_msg>And more fixes at README<commit_after>  === About
  Simple application for learning foreign language words

  === Installation
  Installation process is quite simple (notice, that ruby could be already installed)

  * install ruby from http://www.ruby-lang.org/en/downloads/

  * install rubygems from http://rubygems.org/pages/download

  * execute
        gem install learn_words
    to install application itself

  === Words file
  To use this application you need to have a file in a special format:

  * any number of lines with foreign word and it's translation separated by <tt><Tab></tt>

  * if there are more than one variant for foreign word, separate them by "/"

  * if line starts with "#" it is ignored

  Example:
      apple       яблоко
      # some comments
      city/town   город

  === Usage
  Now execute
      learn_words /path/to/file/with/words
  to start learning words. There are some options:

  * <tt>--limit N</tt> - used for setting limit of words learning,
    you would be asked while you answer +N+ times correctly

  * <tt>--part M/K</tt> - used for splitting big lists of words into parts,
    +K+ - total number of parts, +M+ - index of part to learn (1 <= +M+ <= +K+)

  While learning words you can use these commands:
  * <tt>exit</tt> - to quit (or <tt>^C</tt>, or <tt>^D</tt>)
  * <tt>?</tt> - to get stats (how many learned, how many to learn)
  * <tt>!</tt> - to mark the word as learnt (or ban it)

  ---------------------------------------------------------------------
  Copyright © 2010 <NAME>, released under the MIT license.
{'fraction_non_alphanumeric': 0.12116154873164219, 'fraction_numerical': 0.002336448598130841, 'mean_word_length': 2.668298653610771, 'pattern_counts': {'":': 0, '<': 42, '<?xml version=': 0, '>': 38, 'https://': 0, 'lorem ipsum': 0, 'www.': 2, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 4, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '1615828', 'n_tokens_mistral': 891, 'n_tokens_neox': 850, 'n_words': 388}