<commit_before>[![Join the chat at https://gitter.im/madcore-ai/core](https://badges.gitter.im/madcore-ai/core.svg)](https://gitter.im/madcore-ai/core?utm_source=badge&utm_medium=badge&utm_campaign=pr-badge&utm_content=badge)

Welcome to Madcore repo
| PORT TABLES
----------------------------------------------
   SERVICE      |           PORT
----------------|-----------------------------
docker registry |           5000
etcd            |        7001, 4001
haproxy         |           443
letsencrypt     |           80
kubeapi         |        8080, 6443
influxdb        |     8083, 8086, 8088
grafana         |          3000
redis           |          6379
habitat         |9632. 8000, 8001, 9000, 9001
jenkins         |          8880


cluster/setup.sh - basic setup of cluster (no job for that) this is automatic on launch of cluster cloud formation

spark/setup.sh - master setup of spark - madcore.spark.setup job in jenkins

spark/cluster.sh - cluster setup of spark - madcore.spark.cluster job in jenkins<commit_msg>Readme Format Fix<commit_after>[![Join the chat at https://gitter.im/madcore-ai/core](https://badges.gitter.im/madcore-ai/core.svg)](https://gitter.im/madcore-ai/core?utm_source=badge&utm_medium=badge&utm_campaign=pr-badge&utm_content=badge)


# Welcome to Madcore Core repo
https://wiki.madcore.ai


----------------------------------------------
   SERVICE      |           PORT
----------------|-----------------------------
docker registry |           5000
etcd            |        7001, 4001
haproxy         |           443
letsencrypt     |           80
kubeapi         |        8080, 6443
influxdb        |     8083, 8086, 8088
grafana         |          3000
redis           |          6379
habitat         |9632. 8000, 8001, 9000, 9001
jenkins         |          8880


cluster/setup.sh - basic setup of cluster (no job for that) this is automatic on launch of cluster cloud formation
spark/setup.sh - master setup of spark - madcore.spark.setup job in jenkins
spark/cluster.sh - cluster setup of spark - madcore.spark.cluster job in jenkins
{'fraction_non_alphanumeric': 0.16891241578440808, 'fraction_numerical': 0.06641000962463908, 'mean_word_length': 1.6183879093198992, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 7, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '6899801', 'n_tokens_mistral': 718, 'n_tokens_neox': 600, 'n_words': 157}