<commit_before># SystemsBible
my systems bible

## Cracking System Design Interviews
[Consistent Hashing](https://youtu.be/aj1mXvHNcbQ)

[Consistent Hashing 一致性哈希中文版](https://youtu.be/mdR5VIeStcQ)

[Design a Web Crawler](https://youtu.be/vxqjjB3b-Zg)

[Design a Web Crawler 设计网络爬虫中文版](https://youtu.be/P8LFhmC2efc)

[Message Queue & RabbitMQ & Kafka](https://youtu.be/jeMbHH6PJIA)

[消息队列 & RabbitMQ & Kafka 中文版](https://youtu.be/5BdGCANeV2o)

## Background Enhancement

[文件系统](./basic/fs.md)

## Distributed Systems & Big Data
[Hadoop Intro](./bigdata/hadoop/intro.md) | [Hadoop YARN](http://www.zhihu.com/question/23167837) 介绍yarn的工作流 | [HDFS Performance](./bigdata/hadoop/hdfs_optimization.md) Improve the performance of HDFS

[Spark example](./bigdata/spark/sparktest)

[zookeeper](./bigdata/zookeeper/intro.md) 理解zookeeper

[Field Guide To Hadoop](http://www.allitebooks.com/field-guide-to-hadoop/) 介绍Hadoop生态系统
<commit_msg>Facebook News Feed System Design<commit_after># SystemsBible
my systems bible

## Cracking System Design Interviews
[Consistent Hashing](https://youtu.be/aj1mXvHNcbQ)

[Consistent Hashing 一致性哈希中文版](https://youtu.be/mdR5VIeStcQ)

[Design a Web Crawler](https://youtu.be/vxqjjB3b-Zg)

[Design a Web Crawler 设计网络爬虫中文版](https://youtu.be/P8LFhmC2efc)

[Message Queue & RabbitMQ & Kafka](https://youtu.be/jeMbHH6PJIA)

[消息队列 & RabbitMQ & Kafka 中文版](https://youtu.be/5BdGCANeV2o)

[Facebook News Feed System Design](https://youtu.be/UueOT1Ymo9Q)

[Facebook News Feed System Design 脸书新鲜事系统设计中文版](https://youtu.be/o-pdje2wmOY)

## Background Enhancement

[文件系统](./basic/fs.md)

## Distributed Systems & Big Data
[Hadoop Intro](./bigdata/hadoop/intro.md) | [Hadoop YARN](http://www.zhihu.com/question/23167837) 介绍yarn的工作流 | [HDFS Performance](./bigdata/hadoop/hdfs_optimization.md) Improve the performance of HDFS

[Spark example](./bigdata/spark/sparktest)

[zookeeper](./bigdata/zookeeper/intro.md) 理解zookeeper

[Field Guide To Hadoop](http://www.allitebooks.com/field-guide-to-hadoop/) 介绍Hadoop生态系统

{'fraction_non_alphanumeric': 0.148019801980198, 'fraction_numerical': 0.017326732673267328, 'mean_word_length': 5.415873015873016, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 14, 'lorem ipsum': 0, 'www.': 4, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 3, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '2691856', 'n_tokens_mistral': 920, 'n_tokens_neox': 901, 'n_words': 133}