<commit_before># Change Log

## [Unreleased]
### Removed
- Removed biology abstract test script and data

## [0.2.0] - 2015-07-20
### Added
- Initial (alpha) implementation HDP-LDA _Posterior sampling in the Chinese restaurant franchise_ (Section 5.1 in Teh, et al) based on [derivations](https://shuyo.wordpress.com/2012/08/15/hdp-lda-updates/) [done](https://github.com/shuyo/iir/blob/a6203a7523970a4807beba1ce3b9048a16013246/lda/hdplda2.py) by [<NAME>](https://twitter.com/shuyo).

### Changed
- Currently uses vector of vector of integers to represent documents (instead of [variadic dataview](https://github.com/datamicroscopes/common/blob/master/include/microscopes/common/variadic/dataview.hpp)).
- Several changes to initialization API including hyperparameter setting.


## [0.1.0] - 2014-11012
### Added
- Initial attempt at HDP-LDA. Sampler does not work, however provides much of the code infrastructure for model.<commit_msg>Update changelog for document type<commit_after># Change Log

## [Unreleased]
### Added
- Documents can now be any list-of-list of hashable objects

### Removed
- Removed biology abstract test script and data

## [0.2.0] - 2015-07-20
### Added
- Initial (alpha) implementation HDP-LDA _Posterior sampling in the Chinese restaurant franchise_ (Section 5.1 in Teh, et al) based on [derivations](https://shuyo.wordpress.com/2012/08/15/hdp-lda-updates/) [done](https://github.com/shuyo/iir/blob/a6203a7523970a4807beba1ce3b9048a16013246/lda/hdplda2.py) by [<NAME>](https://twitter.com/shuyo).

### Changed
- Currently uses vector of vector of integers to represent documents (instead of [variadic dataview](https://github.com/datamicroscopes/common/blob/master/include/microscopes/common/variadic/dataview.hpp)).
- Several changes to initialization API including hyperparameter setting.


## [0.1.0] - 2014-11012
### Added
- Initial attempt at HDP-LDA. Sampler does not work, however provides much of the code infrastructure for model.
{'fraction_non_alphanumeric': 0.12296747967479675, 'fraction_numerical': 0.06402439024390244, 'mean_word_length': 4.808259587020649, 'pattern_counts': {'":': 0, '<': 5, '<?xml version=': 0, '>': 5, 'https://': 8, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '3974868', 'n_tokens_mistral': 728, 'n_tokens_neox': 631, 'n_words': 175}