<commit_before># data-forge

JavaScript data transformation and analysis toolkit inspired by Pandas and LINQ.

Works in both NodeJS and the browser. 

For articles and information please see [The Data Wrangler](http://www.the-data-wrangler.com/).

----------

**Warning**: This project is a work in progress, the API is now stabilizing and I'm turning my focus to performance. Moving forward I'm making every effort to keep the API backward compatible, however some small changes should still be expected and the version number will be updated appropriately.

Please contribute or give feedback and help guide the direction of *data-forge*.

I am currently figuring out how plugins should work with data-forge. Please let me know if you have an thoughts on the subject.

**Note**: Data-Forge relies heavily on [linq.js](https://github.com/mihaifm/linq) which I use extensively for all aspects of my JavaScript work. Over time I'll reduce Data-Forge reliance on linq.js although it will remain an invaluable resource.  

# Generated API docs

See here for [generated API docs](./docs/api.md) that are taking shape.

# Examples

Examples and some tests have been removed to a [separate repository](https://github.com/data-forge/data-forge-js-examples-and-tests).

# Contents

<!-- START doctoc generated TOC please keep comment here to allow auto update -->
<!-- DON'T EDIT THIS SECTION, INSTEAD RE-RUN doctoc TO UPDATE -->
**Table of Contents**  *generated with [DocToc](https://github.com/thlorenz/doctoc)*

- [Project Overview](#project-overview)
- [Installation](#installation)
- [Key Concepts](#key-concepts)<commit_msg>Updated readme.<commit_after># data-forge

JavaScript data transformation and analysis toolkit inspired by Pandas and LINQ.

Works in both NodeJS and the browser. 

For articles and information please see [The Data Wrangler](http://www.the-data-wrangler.com/).

----------

**Breaking changes**

I've removed the DataForge functions that apply to MongoDB and REST APIs. Sorry if you were depending on these, but they had to go. 
They limited DataForge's application and it was my mistake to have added them in the first place. If they belong at all they should live in 
separate packages (and be plugins to DataForge). If you were relying on these functions please log an issue here and I'll help you rectify the situation.

**Big update**: 

The TypeScript version of DataForge is on its way!  Please take a look at the new repo to see what's happening:

https://github.com/data-forge/data-forge-ts

**The book**

If you have an interest in data wrangling and analysis in JavaScript please check out [my new book on the subject!](http://bit.ly/2t2cJu2)

# Generated API docs

See here for [generated API docs](./docs/api.md) that are taking shape.

# Examples

Examples and some tests have been removed to a [separate repository](https://github.com/data-forge/data-forge-js-examples-and-tests).

# Contents

<!-- START doctoc generated TOC please keep comment here to allow auto update -->
<!-- DON'T EDIT THIS SECTION, INSTEAD RE-RUN doctoc TO UPDATE -->
**Table of Contents**  *generated with [DocToc](https://github.com/thlorenz/doctoc)*

- [Project Overview](#project-overview)
- [Installation](#installation)
- [Key Concepts](#key-concepts)
{'fraction_non_alphanumeric': 0.0951361272560416, 'fraction_numerical': 0.0009177118384827164, 'mean_word_length': 4.198728139904611, 'pattern_counts': {'":': 0, '<': 7, '<?xml version=': 0, '>': 7, 'https://': 6, 'lorem ipsum': 0, 'www.': 2, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '6998631', 'n_tokens_mistral': 962, 'n_tokens_neox': 877, 'n_words': 414}