task_categories:text-generation task_categories:fill-mask language:en license:apache-2.0 language-modeling masked-language-modeling region:us
---
dataset_info:
  features:
  - name: text
    dtype: string
  splits:
  - name: train
    num_bytes: 24635440616
    num_examples: 146707688
  download_size: 14651841592
  dataset_size: 24635440616
license: apache-2.0
task_categories:
- text-generation
- fill-mask
language:
- en
tags:
- language-modeling
- masked-language-modeling
pretty_name: BERT Dataset (BookCorpus + Wikipedia 03/2022)
---
# Dataset Card for "bert_dataset_202203"

[More Information needed](https://github.com/huggingface/datasets/blob/main/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)