region:us
A subset of [CommitPack](https://huggingface.co/datasets/bigcode/commitpack) used for pretraining [SantaCoderPack](https://huggingface.co/bigcode/santacoderpack) from the OctoPack paper. 

It focuses on data where the code before + special token + code after fits into 8192 tokens and on 6 languages. The data is in commit format (cf): `<commit_before>code_before<commit_message>commit_message<commit_after>code_after`.