license:mit region:us
---
license: mit
dataset_info:
  features:
  - name: text
    dtype: string
  - name: is_correct
    dtype: bool
  - name: is_clean
    dtype: bool
  - name: measurements
    sequence: bool
  splits:
  - name: train
    num_bytes: 207414627
    num_examples: 113560
  - name: validation
    num_bytes: 20942445
    num_examples: 11706
  download_size: 67167173
  dataset_size: 228357072
---
Dataset built using [MBPP](https://github.com/google-research/google-research/tree/master/mbpp) and [APPS](https://github.com/hendrycks/apps).

Most problems are inspired by MBPP and generated by gpt-3.5-turbo. Most functions are generated by gpt-3.5-turbo and gpt-4.

A small fraction of functions labelled "correct" might be incorrect, as those were automatically graded either using gpt-4 or through test cases provided by MBPP and APPS.