<commit_before>The time has come to deactivate my OkCupid account, but I was slightly unhappy about leaving all my messages in a locked silo, as they contained a nontrivial amount of emotionally significant correspondence. I googled around a bit for scripts that other people had written to do download them, and found one "written for Greasemonkey":http://mkay.saverpigeeks.com/FetchOK.xhtml and another "written in Java":http://mkay.saverpigeeks.com/FetchOK.xhtml, but neither seemed to be recent enough to be able to handle the current OkC HTML. I _strongly_ prefer the "BeautifulSoup":http://www.crummy.com/software/BeautifulSoup/ Python library for dealing with HTML, so decided to write my own instead of modifying either of those.

*Find it here! Use it quickly* to download and archive your own messages! Because I probably won't update it as the site updates. Patches accepted though :)

To use it, run it from the command line like this: 

    @python okc_arrow_fetcher.py -u your_username -p your_password -f 'the_full_path_to_some_empty_file'@<commit_msg>Specify the BeautifulSoup version, since Santiago Angel reported that it didn't work with 4.x.<commit_after>The time has come to deactivate my OkCupid account, but I was slightly unhappy about leaving all my messages in a locked silo, as they contained a nontrivial amount of emotionally significant correspondence. I googled around a bit for scripts that other people had written to do download them, and found one "written for Greasemonkey":http://mkay.saverpigeeks.com/FetchOK.xhtml and another "written in Java":http://mkay.saverpigeeks.com/FetchOK.xhtml, but neither seemed to be recent enough to be able to handle the current OkC HTML. I _strongly_ prefer the "BeautifulSoup":http://www.crummy.com/software/BeautifulSoup/ Python library for dealing with HTML, so decided to write my own instead of modifying either of those.

*Find it here! Use it quickly* to download and archive your own messages! Because I probably won't update it as the site updates. Patches accepted though :)

To use it, run it from the command line like this: 

    @python okc_arrow_fetcher.py -u your_username -p your_password -f 'the_full_path_to_some_empty_file'@

Note: It only works with BeautifulSoup v3.x, and not the newer v4.x.
{'fraction_non_alphanumeric': 0.05645514223194748, 'fraction_numerical': 0.001312910284463895, 'mean_word_length': 4.861538461538461, 'pattern_counts': {'":': 6, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 2, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 4, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '2917387', 'n_tokens_mistral': 626, 'n_tokens_neox': 607, 'n_words': 312}