<commit_before>FDButils
====
[![github release](https://img.shields.io/github/release/davebraze/FDButils.svg?label=current+release)](https://github.com/davebraze/FDButils/releases)
[![Travis-CI Build Status](https://travis-ci.org/davebraze/FDButils.svg?branch=master)](https://travis-ci.org/davebraze/FDButils)
[![license](https://img.shields.io/badge/license-MIT-orange.svg)](LICENSE)

Utility functions for use in other FDB packages. Code in this package
should make use only of functions in the dozen or so "base R"
packages. It should also be pretty stable, as other packages may
depend on it.

Install with devtools::install\_github():

```R
install.packages("devtools") ## If you don't already have it.
library(devtools)
install_github("davebraze/FDButils")
```
<commit_msg>README.md<commit_after>FDButils
====
[![github release](https://img.shields.io/github/release/davebraze/FDButils.svg?label=current+release)](https://github.com/davebraze/FDButils/releases)
[![Travis-CI Build Status](https://travis-ci.org/davebraze/FDButils.svg?branch=master)](https://travis-ci.org/davebraze/FDButils)
[![license](https://img.shields.io/badge/license-MIT-green.svg)](LICENSE)

Utility functions for use in other FDB packages. Code in this package
should make use only of functions in the dozen or so "base R"
packages. It should also be pretty stable, as other packages may
depend on it.

Install with devtools::install\_github():

```R
install.packages("devtools") ## If you don't already have it.
library(devtools)
install_github("davebraze/FDButils")
```

{'fraction_non_alphanumeric': 0.14983922829581994, 'fraction_numerical': 0.0, 'mean_word_length': 6.009009009009009, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 10, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '6139856', 'n_tokens_mistral': 527, 'n_tokens_neox': 513, 'n_words': 118}