<commit_before>## Data Science Research Architecture, Data Center OS

### Overview

The newest version of the DSRA migrates the system to a Mesos-centric architecture. It provides 
significant distributed processing capabilities out of the box, supporting in the number of 
disparate frameworks. The distributed processing architecture is abstracted for Engineers to 
write their own frameworks in different languages: Java, Python, Ruby, C, and Go. 

![](./docs/architecture-201509160755.png)

### Future Releases

Mesos also supports deploying applications as Docker containers. Long running processes are
managed by Marathon, which can run containers deployed on DockerHub use their own private Docker registry.

Distributed storage supported in the first software release is HDFS. 

Future releases and updates will focus on adding more software capabilities, to include, but not limited too, the following:

* ElasticSearch
* Kafka
* HBase<commit_msg>Latest documentation changes<commit_after>## Data Science Research Architecture, Data Center OS

### Overview

The newest version of the DSRA migrates the system to a Mesos-centric architecture. It provides 
significant distributed processing capabilities out of the box, supporting in the number of 
disparate frameworks. The distributed processing architecture is abstracted for Engineers to 
write their own frameworks in different languages: Java, Python, Ruby, C, and Go. 

![](./docs/architecture-201509160755.png)

### Future Releases

Mesos also supports deploying applications as Docker containers. Long running processes are
managed by Marathon, which can run containers deployed on DockerHub or use their own private Docker registry.

Distributed storage is supported in the first software release, utilizing HDFS. 

Future releases and updates will focus on adding more software capabilities, to include, but not limited too, the following:

* ElasticSearch
* Kafka
* HBase
{'fraction_non_alphanumeric': 0.04482225656877898, 'fraction_numerical': 0.012364760432766615, 'mean_word_length': 5.244372990353698, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '3557896', 'n_tokens_mistral': 485, 'n_tokens_neox': 428, 'n_words': 251}