<commit_before># Announcing the dat stable alpha 

The first code went into dat a year ago, [on August 17th 2013](https://github.com/maxogden/dat/commit/e5eda57b53f60b05c0c3d97da90c10cd17dcbe19). The first six months were spent making a prototype (thanks to the [Knight foundation Prototype Fund](http://www.knightfoundation.org/grants/201346305/)) and the last six months have been spent on taking dat beyond the prototype phase and into something more concrete. Today, after a year of work, we really excited to release the first major version of dat.

Our overall goal with dat is to make a set of tools for creating and sharing streaming data pipelines, a sort of [ETL](http://en.wikipedia.org/wiki/Extract,_transform,_load) style system but designed from the ground up to be developer friendly, open source and streaming. We are aligned with the goals of the [frictionless data](http://blog.okfn.org/2013/04/24/frictionless-data-making-it-radically-easier-to-get-stuff-done-with-data/) initiative.

In April of this year we were able to expand the team working on dat from 1 person to 3 persons, thanks to [support from the Sloan foundation](http://usodi.org/2014/04/02/dat). Sloan's proposition was that they like the initial dat prototype but wanted to see scientific data use cases be treated as top priority. As a result we expanded the scope of the project from it's tabular data specific beginnings and have focused on adding features that will help us work with larger scientific datasets.

Up until this point the dat API has been in flux as we were constantly iterating on it. From this point forward we will be taking backwards compatibility much more seriously so tha third party developers can feel confident in building on top of dat.

## How to get involved

### Try it out

You can [install dat today](https://github.com/maxogden/dat#install) and play around with it by importing or cloning a dataset.

The dat REST API comes bundled with the [dat-editor](https://github.com/maxogden/dat-editor#readme) web application.

<a href="https://github.com/maxogden/dat-editor">
  <img height="200" title="dat editor" alt="dat editor" src="https://raw.githubusercontent.com/maxogden/dat-editor/master/screenshot.png"/>
</a>

To start learning about how to use dat please read our [getting started guide](https://github.com/maxogden/dat/blob/master/docs/getting-started.md).

To help you choose an approach to loading data into dat we have created a [data importing guide](https://github.com/maxogden/dat/blob/master/docs/importing.md).

### Write a module or 5<commit_msg>Minor copy editing changes<commit_after># Announcing the dat stable alpha 

The first code went into dat a year ago, [on August 17th 2013](https://github.com/maxogden/dat/commit/e5eda57b53f60b05c0c3d97da90c10cd17dcbe19). The first six months were spent making a prototype (thanks to the [Knight foundation Prototype Fund](http://www.knightfoundation.org/grants/201346305/)) and the last six months have been spent on taking dat beyond the prototype phase and into something more concrete. Today, after a year of work, we really excited to release the first major version of dat.

Our overall goal with dat is to make a set of tools for creating and sharing streaming data pipelines, a sort of [ETL](http://en.wikipedia.org/wiki/Extract,_transform,_load) style system but designed from the ground up to be developer friendly, open source and streaming. We are aligned with the goals of the [frictionless data](http://blog.okfn.org/2013/04/24/frictionless-data-making-it-radically-easier-to-get-stuff-done-with-data/) initiative.

In April of this year we were able to expand the team working on dat from 1 person to 3 persons, thanks to [support from the Sloan foundation](http://usodi.org/2014/04/02/dat). Sloan's proposition was that they like the initial dat prototype but wanted to see scientific data use cases be treated as top priority. As a result we expanded the scope of the project from its tabular-data-specific beginnings and have focused on adding features that will help us work with larger scientific datasets.

Up until this point, the dat API has been in flux, as we were constantly iterating on it. From this point forward we will be taking backwards compatibility much more seriously, so that third party developers can feel confident building on top of dat.

## How to get involved

### Try it out

You can [install dat today](https://github.com/maxogden/dat#install) and play around with it by importing or cloning a dataset.

The dat REST API comes bundled with the [dat-editor](https://github.com/maxogden/dat-editor#readme) web application.

<a href="https://github.com/maxogden/dat-editor">
  <img height="200" title="dat editor" alt="dat editor" src="https://raw.githubusercontent.com/maxogden/dat-editor/master/screenshot.png"/>
</a>

To start learning about how to use dat please read our [getting started guide](https://github.com/maxogden/dat/blob/master/docs/getting-started.md).

To help you choose an approach to loading data into dat we have created a [data importing guide](https://github.com/maxogden/dat/blob/master/docs/importing.md).

### Write a module or 5
{'fraction_non_alphanumeric': 0.08029337965643699, 'fraction_numerical': 0.022389500096506466, 'mean_word_length': 4.626492942453854, 'pattern_counts': {'":': 0, '<': 9, '<?xml version=': 0, '>': 9, 'https://': 14, 'lorem ipsum': 0, 'www.': 2, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5075783', 'n_tokens_mistral': 1486, 'n_tokens_neox': 1378, 'n_words': 659}