<commit_before># soa_codeschool [![Build Status](https://travis-ci.org/pengyuchen/Team-HW-1-Ideate-and-Scrape.svg?branch=master)](https://travis-ci.org/pengyuchen/Team-HW-1-Ideate-and-Scrape)[![Gem Version](https://badge.fury.io/rb/soa_codeschool.svg)](https://badge.fury.io/rb/soa_codeschool)

https://rubygems.org/gems/soa_codeschool

A simple Ruby Gem to scrap the website codeschool and to get courses and its instructors.


## Usage

Run the following command:

```
gem install soa_codeschool
```
### Command line usage

```
codeschool
```

## License

Distributed under the [MIT License](LICENSE).
<commit_msg>Additional usage documentation<commit_after># soa_codeschool [![Build Status](https://travis-ci.org/pengyuchen/Team-HW-1-Ideate-and-Scrape.svg?branch=master)](https://travis-ci.org/pengyuchen/Team-HW-1-Ideate-and-Scrape)[![Gem Version](https://badge.fury.io/rb/soa_codeschool.svg)](https://badge.fury.io/rb/soa_codeschool)

https://rubygems.org/gems/soa_codeschool

A simple Ruby Gem to scrap the website codeschool and to get courses and its instructors.


## Usage

Run the following command:

```
gem install soa_codeschool
```
### Command line usage

```
codeschool  # Puts JSON array of code school courses and teachers to command line
```

### Usage in ruby code
```
require 'scrape'

code_school = SiteScraper.new
code_school.course_names  # Returns array of course names
code_school.code_school_data  # Returns JSON array of code school courses and teachers
code_school.code_school_output  # Puts JSON array of code school courses and teachers
```

## License

Distributed under the [MIT License](LICENSE).

{'fraction_non_alphanumeric': 0.12998160637645617, 'fraction_numerical': 0.002452483139178418, 'mean_word_length': 5.158490566037736, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 10, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '6357791', 'n_tokens_mistral': 587, 'n_tokens_neox': 542, 'n_words': 128}