language:hi license:cc-by-nc-sa-4.0 region:us
---
language: hi
license: cc-by-nc-sa-4.0
extra_gated_prompt: 'By accessing this dataset, you agree to abide by the BigScience
  Ethical Charter. The charter can be found at:

  https://hf.co/spaces/bigscience/ethical-charter'
extra_gated_fields:
  I have read and agree to abide by the BigScience Ethical Charter: checkbox
---
ROOTS Subset: roots_indic-hi_iitb_english_hindi_corpus

# IITB English-Hindi Corpus

- Dataset uid: `iitb_english_hindi_corpus`

### Description

The IIT Bombay English-Hindi corpus contains parallel corpus for English-Hindi as well as monolingual Hindi corpus collected from a variety of existing sources and corpora developed at the Center for Indian Language Technology, IIT Bombay over the years. This corpus has been used at the Workshop on Asian Language Translation Shared Task since 2016 the Hindi-to-English and English-to-Hindi languages pairs and as a pivot language pair for the Hindi-to-Japanese and Japanese-to-Hindi language pairs.


### Homepage

https://www.cfilt.iitb.ac.in/iitb_parallel/

### Licensing

- non-commercial use
- cc-by-nc-nd-4.0: Creative Commons Attribution Non Commercial No Derivatives 4.0 International


### Speaker Locations

- Southern Asia
- India
- Pakistan


### Sizes

- 0.6512 % of total
- 28.5802 % of indic-hi

### BigScience processing steps

#### Filters applied to: indic-hi

- dedup_document
- dedup_template_soft
- filter_remove_empty_docs
- filter_small_docs_bytes_300

