<commit_before># TODO list

# Release v0.3

- Working LZMA2 implementation

# Release 1.0

1. Add godoc URL to README.md. (godoc.org)

# Package xz

- Provide user the capability to get uncompressed size before unpacking.

# Subpackage lzma2

## LZMA2 support

1. Create a package lzma2 that supports classic LZMA as well as LZMA2.

   a) Implement baseReader allowing the reuse of readerDict and opCodec.
   b) Implement NewClassicReader and NewClassicWriter based on baseReader
      and baseWriter and test it.
   c) Implement NewReader and NewWriter using basedReader and baseWriter
      supporting LZMA2.

2. Remove lzma package.

## Optimizations

- Use radix trees (crit-bit trees) instead of the hash.

# lzmago binary

1. Put the functions in the xz/pack package to prevent reinventing the
   wheel. Those commands can then be used for optimization.
2. Add -c  flag

# Log

## 2015-04-03

The opCodec has been copied yesterday to lzma2. opCodec has a high<commit_msg>TODO.md: updated plan<commit_after># TODO list

# Release v0.3

- Working LZMA2 implementation

# Release 1.0

1. Add godoc URL to README.md. (godoc.org)

# Package xz

- Provide user the capability to get uncompressed size before unpacking.

# Subpackage lzma2

## LZMA2 support

1. Create a package lzma2 that supports classic LZMA as well as LZMA2.

   a) Implement baseReader allowing the reuse of readerDict and opCodec.
   b) Implement baseWriter allowing the reuse of writerDict and opCodec.
   c) Implement NewClassicReader and NewClassicWriter based on baseReader
      and baseWriter and test it.
   d) Implement NewReader and NewWriter using basedReader and baseWriter
      supporting LZMA2.

2. Remove lzma package.

## Optimizations

- Use radix trees (crit-bit trees) instead of the hash.

# lzmago binary

1. Put the functions in the xz/pack package to prevent reinventing the
   wheel. Those commands can then be used for optimization.
2. Add -c  flag

# Log

## 2015-04-03

The opCodec has been copied yesterday to lzma2. opCodec has a high
{'fraction_non_alphanumeric': 0.052088452088452086, 'fraction_numerical': 0.023587223587223587, 'mean_word_length': 3.504424778761062, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5942680', 'n_tokens_mistral': 649, 'n_tokens_neox': 641, 'n_words': 281}