<commit_before>GN, May, 2016:

Defined Maven project and git

1. remove unnecessary code

de.dfki.lt.mdparser.algorithm	-> DONE
de.dfki.lt.mdparser.archive		-> DONE
de.dfki.lt.mdparser.data		-> DONE
de.dfki.lt.mdparser.eval		-> DONE
de.dfki.lt.mdparser.features	-> DONE
de.dfki.lt.mdparser.model		-> DONE
de.dfki.lt.mdparser.outputformat-> DONE	
de.dfki.lt.mdparser.parser		-> DONE
de.dfki.lt.mdparser.sentenceSplitter -> DONE
de.dfki.lt.mdparser.xmlrpc		-> DONE


2.	Integrate GNT

3. 	Do training and testing with GNT<commit_msg>comments<commit_after>GN, May, 2016:

1.	Defined Maven project and git -> DONE

2. 	remove unnecessary code

	de.dfki.lt.mdparser.algorithm	-> DONE
	de.dfki.lt.mdparser.archive		-> DONE
	de.dfki.lt.mdparser.data		-> DONE
	de.dfki.lt.mdparser.eval		-> DONE
	de.dfki.lt.mdparser.features	-> DONE
	de.dfki.lt.mdparser.model		-> DONE
	de.dfki.lt.mdparser.outputformat-> DONE	
	de.dfki.lt.mdparser.parser		-> DONE
	de.dfki.lt.mdparser.sentenceSplitter -> DONE
	de.dfki.lt.mdparser.xmlrpc		-> DONE


2.		Integrate GNT

3. 		Do training and testing with GNT
{'fraction_non_alphanumeric': 0.13043478260869565, 'fraction_numerical': 0.013876040703052728, 'mean_word_length': 3.2766798418972334, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 24, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 2}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '7112191', 'n_tokens_mistral': 477, 'n_tokens_neox': 462, 'n_words': 85}