task_categories:text-generation language:en license:mit region:us
---
language:
- en
license: mit
task_categories:
- text-generation
pretty_name: py_code_doc
configs:
- config_name: default
  data_files:
  - split: train
    path: data/train-*
  - split: validation
    path: data/validation-*
  - split: test
    path: data/test-*
dataset_info:
  features:
  - name: docstring
    dtype: string
  - name: function
    dtype: string
  - name: __index_level_0__
    dtype: int64
  splits:
  - name: train
    num_bytes: 525428666
    num_examples: 502378
  - name: validation
    num_bytes: 624971
    num_examples: 459
  - name: test
    num_bytes: 673898
    num_examples: 666
  download_size: 198280913
  dataset_size: 526727535
---

# Code documentation dataset
This dataset aims leverage usage of lm to automatically generate documenation to undocumented python code. Dataset consists of pairs code and its documenation

Content of dataset is created from CodeSearchNet dataset.