task_categories:question-answering task_categories:text-generation task_categories:text2text-generation size_categories:10M<n<100M language:en license:llama2 code python instruct llama flytech region:us
---
author: FlyTech
license: llama2
task_categories:
- question-answering
- text-generation
- text2text-generation
language:
- en
tags:
- code
- python
- instruct
- llama
- flytech
pretty_name: Llama1/2 Python Codes 30k Tokenized
size_categories:
- 10M<n<100M
---
# Llama1/2 Python Codes 30k Tokenized Dataset

![License](https://img.shields.io/badge/License-llama2-brightgreen)
![Language](https://img.shields.io/badge/Language-English-blue)
![Size](https://img.shields.io/badge/Size-10M<n<100M-orange)

## Author

**FlyTech**

## Overview

This dataset serves as a rich resource for various Natural Language Processing tasks such as:

- Question Answering
- Text Generation
- Text-to-Text Generation


It primarily focuses on instructional tasks in Python, tokenized specifically for the Llama architecture. 
The dataset is a blend of GPT-4 generated content, custom codes, and tasks extending beyond Python.

## Dataset Metrics

**Token Count (via LlamaTokenizer)**

- **Maximum**: 508
- **Average**: 158.06
- **Total**: 13,993,984

**Word Count**: 1,890,810  
**Number of Examples**: 27,331

## License

This dataset is under the `llama2` license.

## Tags

- `code`

---

For more details, issues, or contributions, please refer to the [contribution guidelines](CONTRIBUTING.md).