<commit_before># news-fetcher

[![Dependency Status](https://david-dm.org/plantain-00/news-fetcher.svg)](https://david-dm.org/plantain-00/news-fetcher)
[![devDependency Status](https://david-dm.org/plantain-00/news-fetcher/dev-status.svg)](https://david-dm.org/plantain-00/news-fetcher#info=devDependencies)
[![Build Status: Linux](https://travis-ci.org/plantain-00/news-fetcher.svg?branch=master)](https://travis-ci.org/plantain-00/news-fetcher)
[![Build Status: Windows](https://ci.appveyor.com/api/projects/status/github/plantain-00/news-fetcher?branch=master&svg=true)](https://ci.appveyor.com/project/plantain-00/news-fetcher/branch/master)
[![type-coverage](https://img.shields.io/badge/dynamic/json.svg?label=type-coverage&prefix=%E2%89%A5&suffix=%&query=$.typeCoverage.atLeast&uri=https%3A%2F%2Fraw.githubusercontent.com%2Fplantain-00%2Fnews-fetcher%2Fmaster%2Fpackage.json)](https://github.com/plantain-00/news-fetcher)

## install

```bash
git clone https://github.com/plantain-00/news-fetcher-release.git . --depth=1 && npm i --production
```

Set environment variable NEWS_FETCHER_KEY

```bash
node dist/start.js
```

Then open `http://localhost:9994` in your browser.<commit_msg>docs: add github ci badge<commit_after># news-fetcher

[![Dependency Status](https://david-dm.org/plantain-00/news-fetcher.svg)](https://david-dm.org/plantain-00/news-fetcher)
[![devDependency Status](https://david-dm.org/plantain-00/news-fetcher/dev-status.svg)](https://david-dm.org/plantain-00/news-fetcher#info=devDependencies)
[![Build Status: Linux](https://travis-ci.org/plantain-00/news-fetcher.svg?branch=master)](https://travis-ci.org/plantain-00/news-fetcher)
[![Build Status: Windows](https://ci.appveyor.com/api/projects/status/github/plantain-00/news-fetcher?branch=master&svg=true)](https://ci.appveyor.com/project/plantain-00/news-fetcher/branch/master)
![Github CI](https://github.com/plantain-00/news-fetcher/workflows/Github%20CI/badge.svg)
[![type-coverage](https://img.shields.io/badge/dynamic/json.svg?label=type-coverage&prefix=%E2%89%A5&suffix=%&query=$.typeCoverage.atLeast&uri=https%3A%2F%2Fraw.githubusercontent.com%2Fplantain-00%2Fnews-fetcher%2Fmaster%2Fpackage.json)](https://github.com/plantain-00/news-fetcher)

## install

```bash
git clone https://github.com/plantain-00/news-fetcher-release.git . --depth=1 && npm i --production
```

Set environment variable NEWS_FETCHER_KEY

```bash
node dist/start.js
```

Then open `http://localhost:9994` in your browser.
{'fraction_non_alphanumeric': 0.19509251810136766, 'fraction_numerical': 0.032180209171359615, 'mean_word_length': 6.146551724137931, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 23, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '6281344', 'n_tokens_mistral': 987, 'n_tokens_neox': 921, 'n_words': 75}