<commit_before>gfw_whitelist2domains
=====================

# Introduction
Extract domains from pac file of gfw_whitelist project (https://github.com/n0wa11/gfw_whitelist).

The domains extracted by this program can be used as excluded domains of DNSForwarder (https://github.com/holmium/dnsforwarder) for users in China.

This program was tested on Cywin and should be fine with *nix and Mac OS.

# Usage
$./gfw_whitelist2domains >domains<commit_msg>Update inforamtion about this project<commit_after>gfw_whitelist2domains
=====================

# Introduction
Extract domains from pac file of gfw_whitelist project (https://github.com/n0wa11/gfw_whitelist).

The domains extracted by this program can be used as excluded domains of DNSForwarder (https://github.com/holmium/dnsforwarder) for users in China.

This program was tested on Cywin and should be working fine on Unix, Linux and Mac OS.

# Usage
`$ ./gfw_whitelist2domains >domains`
{'fraction_non_alphanumeric': 0.10828025477707007, 'fraction_numerical': 0.010615711252653927, 'mean_word_length': 5.458904109589041, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 5, 'https://': 4, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5462765', 'n_tokens_mistral': 290, 'n_tokens_neox': 273, 'n_words': 101}