<commit_before># Ferry

## What is Ferry?
Ferry is a data migration and data manipulation tool that seeks to quickly and easily reduce overhead when dealing with big data problems.

## What can I use Ferry for? (Use Cases)
See [github.com/cmu-is-projects/ferry_demo.com] for a demo ROR/Sqlite app for guidance on using Ferry!

Manipulation Use Cases
  - RESTful column/ row interaction

Migration
  - Exporting data to various file formats (.csv, .sql, .yml)
  - Importing data from various file formats
  - Migrating data to third party hosts (Amazon S3, Oracle)
  - Migrating data to a different database

## TO-DOs
- [ ] Refactoring before public release
- [x] Define action-items for refactor
- [x] Provide working example(s) of using ferry (ferry_demo app)
- [ ] CLI tool
- [ ] Simple CSV export
  - [ ] using sqlite3
  - [ ] using psql
- [ ] RESTful column interaction
  - [ ] Understanding relationships between generating migrations and migration files in place
- [ ] Tests
- [ ] Rolling back on errors / mishaps during migrations and manipulations
  - [ ] Host documentation site via GitHub pages

## Installation
Add this line to your application's Gemfile:

    gem 'ferry'<commit_msg>saving<commit_after># Ferry

## What is Ferry?
Ferry is a data migration and data manipulation tool that seeks to quickly and easily reduce overhead when dealing with big data problems.

## What can I use Ferry for? (Use Cases)
See the [ferry_demo](http://github.com/cmu-is-projects/ferry_demo.com) ROR/Sqlite app for guidance on using Ferry!

Manipulation Use Cases
  - RESTful column/ row interaction

Migration
  - Exporting data to various file formats (.csv, .sql, .yml)
  - Importing data from various file formats
  - Migrating data to third party hosts (Amazon S3, Oracle)
  - Migrating data to a different database

## TO-DOs
- [ ] Refactoring before public release
- [x] Define action-items for refactor
- [x] Provide working example(s) of using ferry (ferry_demo app)
- [ ] CLI tool
- [ ] Simple CSV export
  - [ ] using sqlite3
  - [ ] using psql
- [ ] RESTful column interaction
  - [ ] Understanding relationships between generating migrations and migration files in place
- [ ] Tests
- [ ] Rolling back on errors / mishaps during migrations and manipulations
  - [ ] Host documentation site via GitHub pages

## Installation
Add this line to your application's Gemfile:

    gem 'ferry'
{'fraction_non_alphanumeric': 0.07717980809345015, 'fraction_numerical': 0.001668752607425949, 'mean_word_length': 3.6927592954990214, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '4057663', 'n_tokens_mistral': 709, 'n_tokens_neox': 673, 'n_words': 303}