<commit_before>This tool kit is intended to help people who are interested in using Numenta's 
nupic on vision related problems.

An simple example of how these tools can be used:

# get training data set
images, tags = dataset_readers.getImagesAndTags(trainingXMLFileName)
# convert images to bit vectors
vectors = image_encoders.imagesToVectors(images)

# train nupic on the data set for 10 repetitions
for i in range(10)
  VisionTestBench.train(vectors,tags)

# get testing data set
images, tags = getImagesAndTags(testingXMLFileName)
# convert images to bit vectors
vectors = imagesToVectors(images)
# test nupic's image recognition accuracy
test(vectors,tags)



Look at train_and_test.py for a more detailed example.
<commit_msg>Put HTML tags around comments in code example to keep markdown from making the comments HUGE.<commit_after>This tool kit is intended to help people who are interested in using Numenta's 
nupic on vision related problems.

An simple example of how these tools can be used:

<h3># get training data set </h3>
images, tags = dataset_readers.getImagesAndTags(trainingXMLFileName)
<h3># convert images to bit vectors </h3>
vectors = image_encoders.imagesToVectors(images)

<h3># train nupic on the data set for 10 repetitions </h3>
for i in range(10)
  VisionTestBench.train(vectors,tags)

<h3># get testing data set </h3>
images, tags = getImagesAndTags(testingXMLFileName)
<h3># convert images to bit vectors </h3>
vectors = imagesToVectors(images)
<h3># test nupic's image recognition accuracy </h3>
test(vectors,tags)



Look at train_and_test.py for a more detailed example.

{'fraction_non_alphanumeric': 0.06894409937888199, 'fraction_numerical': 0.012422360248447204, 'mean_word_length': 5.418326693227091, 'pattern_counts': {'":': 0, '<': 15, '<?xml version=': 0, '>': 15, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '6010313', 'n_tokens_mistral': 505, 'n_tokens_neox': 481, 'n_words': 197}