<commit_before># Nice-Slicer-Dicer
#greytHR Hackathon

Deploy application by running npm start.

Note: You'll need a mongodb instance running on your system to be able to do so.<commit_msg>Modified Readme with application description and instructions to run<commit_after>**Nice-Slicer-Dicer -- An Analyst's Helpline !**

**Description:**
The business analyst's biggest dread, given a dump of semi-structured data and asked to find patterns inside it that could help/point to the company's growth strategy. I know the analysts among you would smile at how optimistic that statement above was. However the grain of truth (or more like a thorn in the flesh?) in it is that often times there's a whole bunch of data with about a 100 dimensions/features (or more) and almost always semi-structured dirty (Dirty here meaning, values that don't have a consistent format across data points for a given column.) data.
The challenge here is two-fold,
A. Cleaning the data into a consistent format.
B. Extract underlying patterns/ correlated variables out of the various dimensions.

**Solution:**
The Application Nice-Slicer-Dicer solves it all !

**Features:**
1. Configurable query builder for a dataset
2. Ability to drill down across multiple (configured) dimensions
3. Ability to Roll-up over multiple (configured) dimensions
4. Ability to configure measures/ quantitative values and apply common (sum, average, etc.) sql functions on them.
5. A GUI for choosing the drill down, roll-up, pivot options and display the plots.

**Instruction to run:**
1) Have a Mongo DB instance running on your system
2) Deploy the Nice-Slicer-Dicer application by running npm start.

**Technology Stack:**
1) The application is built on top of the MEAN Stack.
2) Analytics is provided using pivottable.

**Screenshots:**
Home Page:
![home page](https://github.com/mitshubh/Nice-Slicer-Dicer/blob/master/uploads/home.png)

Heat Map for a data plot:
![analytics page](https://github.com/mitshubh/Nice-Slicer-Dicer/blob/master/uploads/data-analysis.png)
{'fraction_non_alphanumeric': 0.07589945786101528, 'fraction_numerical': 0.005914243469689502, 'mean_word_length': 4.7507082152974505, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 2, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '1478726', 'n_tokens_mistral': 573, 'n_tokens_neox': 532, 'n_words': 276}