<commit_before># zfire_survey
<<<<<<< HEAD
There are two python notebooks. 
1. **figures.ipynb** Contains figures from ZFIRE survey paper: Nanayakkara et al. 2016
http://adsabs.harvard.edu/abs/2016arXiv160700013N
 
2. **catalogue_analysis.ipynb** Only for tests. Loads in ZFIRE catalogues with additional ZFOURGE catalogues. 
Data will be available after ZFOURGE public data release. 

More information on the survey can be found in http://zfire.swinburne.edu.au

Any questions or problems with the codes please email <EMAIL>

-Themiya 25/08/2016
=======
Codes for zfire survey data analysis and figures are being updated here. 
More information on the survey can be found in http://zfire.swinburne.edu.au

Codes will be fully updated after the zfourge public data release. 
>>>>>>> origin/master<commit_msg>fix README<commit_after># zfire_survey

There are two python notebooks. 

1. **figures.ipynb** Contains figures from ZFIRE survey paper: Nanayakkara et al. 2016
http://adsabs.harvard.edu/abs/2016arXiv160700013N
 
2. **catalogue_analysis.ipynb** Only for tests. Loads in ZFIRE catalogues with additional ZFOURGE catalogues. 
Data will be available after ZFOURGE public data release. 

More information on the survey can be found in http://zfire.swinburne.edu.au

Any questions or problems with the codes please email <EMAIL>

-Themiya 25/08/2016
=======

Codes for zfire survey data analysis and figures are being updated here. 
More information on the survey can be found in http://zfire.swinburne.edu.au

Codes will be fully updated after the zfourge public data release. 
>>>>>>> origin/master
{'fraction_non_alphanumeric': 0.08296943231441048, 'fraction_numerical': 0.03368683718028696, 'mean_word_length': 4.550173010380623, 'pattern_counts': {'":': 0, '<': 12, '<?xml version=': 0, '>': 19, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '4241448', 'n_tokens_mistral': 536, 'n_tokens_neox': 484, 'n_words': 197}