<commit_before>LanguageTool Change Log

2.2-dev (release planned for 2013-06-30)

 -Breton:
  -added/improved several rules
  -fixed some false alarms
  -updated POS dictionary from Apertium (svn r45122)

 -Catalan:
  -improved rules
  -fixed false alarms
  -rules have been categorized according to the upcoming Internationalization Tag Set (ITS)
   Version 2.0 standard from W3C.

 -Dutch:
  -updated rules to fix false alarms, thanks to <NAME>
  -The Dutch spell checking has been switched back to Hunspell for now to avoid too
   many false alarms because of unknown compounds. Unfortunately, Dutch spell
   checking does not provide suggestions anymore, for performance reasons.
   The dictionary used is the one at
   http://www.opentaal.org/bestanden/doc_download/20-woordenlijst-v-210g-voor-openofficeorg-3

 -Esperanto
  -added/improved several rules
  -fixed some false alarms
  -updated <url> links to PMEG.

 -French:
  -added/improved several rules
  -fixed some false alarms
  -updated POS tag dictionary and Hunspell dictionary to Dicollecte-4.10

 -Greek:
  -added a few rules (by <NAME>)

 -Khmer:
  -added some rules (by <NAME>)

 -Portuguese:
  -added/improved several rules
  -it now has around 2000 compound words taken from a huge Porto Editora dictionary

 -Russian:
  -added some new rules (thanks for these rules to <NAME>)
  -fixed some false alarms
  -added new segmentation rules
  -added false-friend rule
  -added bitext rule
  -added new style rules

 -Ukrainian:
  -new POS dictionary
  -new synthesizer dictionary
  -new spelling dictionary
  -new grammar rules
  -updated sentence tokenizer rules
  -disambiguator implemented
  -word tokenizer updated to ignore accent and soft hyphen and understand different apostrophes


 -HTTP server:
  -enabling and disabling rules at the same time (keeping the rest of the default options) is now allowed.
   To disable all the rules except those explicitly enabled, you can use the parameter enabledOnly=yes. Ex.:
   http://localhost:8081/?language=en&enabled=STRANGE_RULE,ANOTHER_RULE&enabledOnly=yes&text=my+text

 -Fix bug "java.lang.StringIndexOutOfBoundsException" in DifferentLengthRule
  (Ex.:http://localhost:8081/?language=ru&text=№&srctext=No.&motherTongue=en )

 -Updated Tika (used for language detection) from 0.9 to 1.3<commit_msg>update changes<commit_after>LanguageTool Change Log

2.2 (2013-06-30)

 -Breton:
  -added/improved several rules
  -fixed some false alarms
  -updated POS dictionary from Apertium (svn r45122)

 -Catalan:
  -added/improved many rules
  -fixed false alarms
  -rules have been categorized according to the upcoming Internationalization Tag Set (ITS)
   Version 2.0 standard from W3C.

 -Dutch:
  -updated rules to fix false alarms, thanks to <NAME>
  -The Dutch spell checking has been switched back to Hunspell for now to avoid too
   many false alarms because of unknown compounds. Unfortunately, Dutch spell
   checking does not provide suggestions anymore, for performance reasons.
   The dictionary used is the one at
   http://www.opentaal.org/bestanden/doc_download/20-woordenlijst-v-210g-voor-openofficeorg-3

 -English:
  -added/improved a few rules

 -Esperanto:
  -added/improved several rules
  -fixed some false alarms
  -updated <url> links to PMEG.

 -French:
  -added/improved several rules
  -fixed some false alarms
  -updated POS tag dictionary and Hunspell dictionary to Dicollecte-4.10

 -German:
  -added/improved several rules

 -Greek:
  -added a few rules (by Panagiotis Minos)

 -Italian:
  -small rule improvement

 -Khmer:
  -added some rules (by <NAME>)

 -Polish:
  -added a few new rules

 -Portuguese:
  -added/improved a few rules
  -it now has around 2000 compound words taken from a huge Porto Editora dictionary

 -Russian:
  -added some new rules (thanks for these rules to <NAME>)
  -fixed some false alarms
  -added new segmentation rules
  -added false-friend rule
  -added bitext rule
  -added new style rules

 -Ukrainian:
  -new POS dictionary
  -new synthesizer dictionary
  -new spelling dictionary
  -new grammar rules
  -updated sentence tokenizer rules
  -disambiguator implemented
  -word tokenizer updated to ignore accent and soft hyphen and understand different apostrophes


 -HTTP server:
  -enabling and disabling rules at the same time (keeping the rest of the default options) is now allowed.
   To disable all the rules except those explicitly enabled, you can use the parameter enabledOnly=yes. Ex.:
   http://localhost:8081/?language=en&enabled=STRANGE_RULE,ANOTHER_RULE&enabledOnly=yes&text=my+text

 -Fix bug "java.lang.StringIndexOutOfBoundsException" in DifferentLengthRule
  (Ex.:http://localhost:8081/?language=ru&text=№&srctext=No.&motherTongue=en )

 -Updated Tika (used for language detection) from 0.9 to 1.3
{'fraction_non_alphanumeric': 0.0706839032527106, 'fraction_numerical': 0.01793160967472894, 'mean_word_length': 3.792207792207792, 'pattern_counts': {'":': 0, '<': 12, '<?xml version=': 0, '>': 12, 'https://': 0, 'lorem ipsum': 0, 'www.': 2, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 2, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5507398', 'n_tokens_mistral': 1518, 'n_tokens_neox': 1365, 'n_words': 565}