<commit_before>
A roadmap to release 1.1
------------------------

- Add local interfaces to: 

carrot2-filter-ahc
carrot2-filter-fuzzyants

- Add these clustering algorithms to the demo application:

carrot2-filter-ahc
carrot2-filter-fuzzyants

- Add OpenSearch Descriptor support for carrot2-input-opensearch?

- Unify coding style (reformat existing code)

- Check out Unicode segmentation spec (info from Andrzej Zydro):
http://www.unicode.org/reports/tr29/tr29-10.html

- replace string concatenations with a stringbuffer in JavaScript?
http://www.softwaresecretweapons.com/jspwiki/Wiki.jsp?page=JavascriptStringConcatenation

- add lucene input source to the demo application

- modify xslt-output to work with frames? (ajax-based?)

- refactor Language use (tokenization, stemming) in Lingo.

- Highlight user search terms in document snippets in the demo application (reuse
Lucene's highlighter?).<commit_msg>A new idea on the roadmap.<commit_after>
A roadmap to release 1.1
------------------------

- Add local interfaces to: 

carrot2-filter-ahc
carrot2-filter-fuzzyants

- Add these clustering algorithms to the demo application:

carrot2-filter-ahc
carrot2-filter-fuzzyants

- Add OpenSearch Descriptor support for carrot2-input-opensearch?

- Unify coding style (reformat existing code)

- Check out Unicode segmentation spec (info from Andrzej Zydro):
http://www.unicode.org/reports/tr29/tr29-10.html

- replace string concatenations with a stringbuffer in JavaScript?
http://www.softwaresecretweapons.com/jspwiki/Wiki.jsp?page=JavascriptStringConcatenation

- add lucene input source to the demo application

- modify xslt-output to work with frames? (ajax-based?)

- refactor Language use (tokenization, stemming) in Lingo.

- Highlight user search terms in document snippets in the demo application (reuse
Lucene's highlighter?).

- Write a clustering plugin for Kneobase?
  http://www.kneobase.com/en/kneobase
{'fraction_non_alphanumeric': 0.10062240663900415, 'fraction_numerical': 0.013485477178423237, 'mean_word_length': 4.089709762532982, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 5, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '2615377', 'n_tokens_mistral': 617, 'n_tokens_neox': 574, 'n_words': 189}