<commit_before>![AstroNN Logo](astroNN_icon_withname.png)

## Getting Started

astroNN is a  python package to do neural network with APOGEE stellar spectra DR14 and Gaia DR1 with Tensorflow and Keras.
The idea is feeding spectra into neural network and train it with ASPCAP stellar parameter or feeding spectra into neural
network and train it with Gaia DR1 parallax.

This is a python package developing for an undergraduate research project by `<NAME> (Toronto)` under the 
supervision of Professor `<NAME>, Unviersity of Toronto Department of Astronomy and Astrophysics.`
#### !!!Still in Active Development!!!!

## Updates History
`13 Oct 2017` - `astroNN was created`\
`19 Oct 2017` - `astroNN 0.1 - includes basic function of downloading and compiling data, training and 
testing neural network`\
`21 Oct 2017` - `astroNN_tutorial was creacted to include tutorial jupyter notebook`\
`24 Oct 2017` - `Updated the folder structure, update the code to remove unnessary I/O access, update plot`\
`26 Oct 2017` - `Performance and high RAM usage issue fix`\
`27 Oct 2017` - `The Cannon 2 comparison module and critical bug fix!!`\
`28 Oct 2017` - `Initial generative neural network for spectra noise reduction`\
`31 Oct 2017` - `Bug fix, more diagnostic info, performance fix`\
`1 Nov 2017` - `Platform independent path fix`\
`2 Nov 2017` - `More disgnostic info and save hyperparameter`\
`2 Nov 2017` - `New visualizing module`\
`3 Nov 2017` - `Visualizing module fix and including in apogee_train`\
`7 Nov 2017` - `Update apogee_cnn_model_1`\
`8 Nov 2017` - `Gaia DR1 downloading function and gaia h5 compiler` \
`9 Nov 2017` - `Gaia DR1 models`\
`10 Nov 2017` - `Refractored some the code`\
`13 Nov 2017` - `Add APOKASC surface gravity checking (golden)`\
`15 Nov 2017` - `Add APOKASC surface gravity checking (all catalog)`\
`16 Nov 2017` - `Add Red Clumps Catalog checking`\
`17 Nov 2017` - `Add Experimental channel`\
`18 Nov 2017` - `Add blackbox module for NN attention checking`\
`19 Nov 2017` - `Add NNgalaxy module for plotting milkyway via NN`\
`20 Nov 2017` - `Add Jacobia of NN`\
`23 Nov 2017` - `Add model uncertainty calculation`\
`24 Nov 2017` - `Add uncertainty propagation`\
`25 Nov 2017` - `Better CPU/GPU management`\
`26 Nov 2017` - `Circular import loop fix and code refractoring`


## Prerequisites

This package must be using with Tensorflow 1.4.0 or above

Only Keras with Tensorflow backend is supported

Multi-gpu training is not supported.<commit_msg>CPU fallback option and GPU memory management<commit_after>![AstroNN Logo](astroNN_icon_withname.png)

## Getting Started

astroNN is a  python package to do neural network with APOGEE stellar spectra DR14 and Gaia DR1 with Tensorflow and Keras.
The idea is feeding spectra into neural network and train it with ASPCAP stellar parameter or feeding spectra into neural
network and train it with Gaia DR1 parallax.

This is a python package developing for an undergraduate research project by `<NAME> (Toronto)` under the 
supervision of Professor `<NAME>, Unviersity of Toronto Department of Astronomy and Astrophysics.`
#### !!!Still in Active Development!!!!

## Updates History
`13 Oct 2017` - `astroNN was created`\
`19 Oct 2017` - `astroNN 0.1 - includes basic function of downloading and compiling data, training and 
testing neural network`\
`21 Oct 2017` - `astroNN_tutorial was creacted to include tutorial jupyter notebook`\
`24 Oct 2017` - `Updated the folder structure, update the code to remove unnessary I/O access, update plot`\
`26 Oct 2017` - `Performance and high RAM usage issue fix`\
`27 Oct 2017` - `The Cannon 2 comparison module and critical bug fix!!`\
`28 Oct 2017` - `Initial generative neural network for spectra noise reduction`\
`31 Oct 2017` - `Bug fix, more diagnostic info, performance fix`\
`1 Nov 2017` - `Platform independent path fix`\
`2 Nov 2017` - `More disgnostic info and save hyperparameter`\
`2 Nov 2017` - `New visualizing module`\
`3 Nov 2017` - `Visualizing module fix and including in apogee_train`\
`7 Nov 2017` - `Update apogee_cnn_model_1`\
`8 Nov 2017` - `Gaia DR1 downloading function and gaia h5 compiler` \
`9 Nov 2017` - `Gaia DR1 models`\
`10 Nov 2017` - `Refractored some the code`\
`13 Nov 2017` - `Add APOKASC surface gravity checking (golden)`\
`15 Nov 2017` - `Add APOKASC surface gravity checking (all catalog)`\
`16 Nov 2017` - `Add Red Clumps Catalog checking`\
`17 Nov 2017` - `Add Experimental channel`\
`18 Nov 2017` - `Add blackbox module for NN attention checking`\
`19 Nov 2017` - `Add NNgalaxy module for plotting milkyway via NN`\
`20 Nov 2017` - `Add Jacobia of NN`\
`23 Nov 2017` - `Add model uncertainty calculation`\
`24 Nov 2017` - `Add uncertainty propagation`\
`25 Nov 2017` - `Better CPU/GPU management`\
`26 Nov 2017` - `Circular import loop fix and code refractoring`\
`27 Nov 2017` - `CPU fallback option and GPU memory management`\


## Prerequisites

This package must be using with Tensorflow 1.4.0 or above

Only Keras with Tensorflow backend is supported

Multi-gpu training is not supported.
{'fraction_non_alphanumeric': 0.0883399209486166, 'fraction_numerical': 0.06798418972332015, 'mean_word_length': 4.321766561514195, 'pattern_counts': {'":': 0, '<': 7, '<?xml version=': 0, '>': 7, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 6, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5639284', 'n_tokens_mistral': 1787, 'n_tokens_neox': 1453, 'n_words': 727}