<commit_before># Datasets
This folder contains scripts to download, format and analyze the input 
datasets. 

## Before you start
The `UCI Human Activity data` is the most interesting dataset for 
someone looking to evaluate the classification of time series with HTM. 
This is a good temporal dataset to start with and it was the most challenging 
to classify. The data lives under `nupic.research/projects/capybara/datasets/uci_har`.

## Usage
To download and format the data, run: `./run.sh`. The UCR data is password 
protected, so you'll have to download it manually:
* Download the zipped data [here](http://www.cs.ucr.edu/~eamonn/time_series_data/UCR_TS_Archive_2015.zip)<commit_msg>more tips about what datasets to use<commit_after># Datasets
This folder contains scripts to download, format and analyze the input 
datasets. 

## Before you start
The `UCI Human Activity data` is the most interesting dataset for 
someone looking to evaluate the classification of time series with HTM. 
This is a good temporal dataset to start with and it was the most challenging 
to classify. The data lives under `nupic.research/projects/capybara/datasets/uci_har`. 

Other datasets that are good to use for classification tasks:
1. `ucr`: a collection of time series. Particularly the collection of time series called `synthetic_data`. [Source](http://www.cs.ucr.edu/~eamonn/time_series_data) 
2. `SyntheticData`: synthetic sequences using a pool of sequence motifs.


## Usage
To download and format the data, run: `./run.sh`. The UCR data is password 
protected, so you'll have to download it manually:
* Download the zipped data [here](http://www.cs.ucr.edu/~eamonn/time_series_data/UCR_TS_Archive_2015.zip)
{'fraction_non_alphanumeric': 0.07327080890973037, 'fraction_numerical': 0.005861664712778429, 'mean_word_length': 4.709030100334449, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 3, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 8, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '349428', 'n_tokens_mistral': 506, 'n_tokens_neox': 474, 'n_words': 217}