<commit_before>## Scribe ##

[Scribe](https://github.com/facebookarchive/scribe) is a server for aggregating log data streamed in real time from a large number of servers.

1. git clone <EMAIL>:traviscrawford/scribe.git
2. sudo apt-get -y install autoconf
3. sudo apt-get -y install ruby ruby-dev
4. sudo apt-get -y install python python-dev
5. sudo apt-get -y install libevent-dev
6. sudo apt-get -y install libboost-all-dev
7. Thrift
  * **pre-install requirements** > sudo apt-get -y install libboost-dev libboost-test-dev libboost-program-options-dev libevent-dev automake libtool flex bison pkg-config g++ libssl-dev
  * Download thrift from [http://www.apache.org/dyn/closer.cgi?path=/thrift/0.9.2/thrift-0.9.2.tar.gz](http://www.apache.org/dyn/closer.cgi?path=/thrift/0.9.2/thrift-0.9.2.tar.gz)
  * > cd /usr
  * > su
   * > Enter your password
 * > mkdir thrift
 * > cd thrift
 * > mv /home/debian/Downloads/thrift-0.9.2.tar.gz .
 * > tar zxvf thrift-0.9.2.tar.gz
 * > cd thrift-0.9.2
 * <commit_msg>Update Scribe.md<commit_after>## Scribe ##

[Scribe](https://github.com/facebookarchive/scribe) is a server for aggregating log data streamed in real time from a large number of servers.

1. git clone <EMAIL>:traviscrawford/scribe.git
2. sudo apt-get -y install autoconf
3. sudo apt-get -y install ruby ruby-dev
4. sudo apt-get -y install python python-dev
5. sudo apt-get -y install libevent-dev
6. sudo apt-get -y install libboost-all-dev
7. Thrift
  * **pre-install requirements** 
  * > sudo apt-get -y install libboost-dev libboost-test-dev libboost-program-options-dev libevent-dev automake libtool flex bison pkg-config g++ libssl-dev
  * Download thrift from [http://www.apache.org/dyn/closer.cgi?path=/thrift/0.9.2/thrift-0.9.2.tar.gz](http://www.apache.org/dyn/closer.cgi?path=/thrift/0.9.2/thrift-0.9.2.tar.gz)
  * > cd /usr
  * > su
   * > Enter your password
 * > mkdir thrift
 * > cd thrift
 * > mv /home/debian/Downloads/thrift-0.9.2.tar.gz .
 * > tar zxvf thrift-0.9.2.tar.gz
 * > cd thrift-0.9.2
 * 
{'fraction_non_alphanumeric': 0.14525691699604742, 'fraction_numerical': 0.02766798418972332, 'mean_word_length': 3.299363057324841, 'pattern_counts': {'":': 0, '<': 5, '<?xml version=': 0, '>': 23, 'https://': 2, 'lorem ipsum': 0, 'www.': 4, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 4, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5953594', 'n_tokens_mistral': 780, 'n_tokens_neox': 760, 'n_words': 193}