<commit_before>---
title: Datasets Tags documentation
---

<h1 class="no-top-margin">Datasets Tags documentation</h1>


## Tasks

- `conditional-text-generation`: data-to-text and text transduction tasks such as translation or summarization
	- [`machine-translation`](/datasets?filter=task_ids:machine-translation)
	- [`sentence-splitting-fusion`](/datasets?filter=task_ids:sentence-splitting-fusion)
	- [`summarization`](/datasets?filter=task_ids:summarization)
	- [`table-to-text`](/datasets?filter=task_ids:table-to-text)
	- [`text-simplification`](/datasets?filter=task_ids:text-simplification)
	- [`explanation-generation`](/datasets?filter=task_ids:explanation-generation)
	- [`other-stuctured-to-text`](/datasets?filter=task_ids:other-stuctured-to-text)
	- [`other`](/datasets?filter=task_ids:other)
- `question-answering`: question answering tasks
	- [`open-domain-qa`](/datasets?filter=task_ids:open-domain)
	- [`closed-domain-qa`](/datasets?filter=task_ids:closed-domain)
	- [`multiple-choice-qa`](/datasets?filter=task_ids:multiple-choice)
	- [`extractive-qa`](/datasets?filter=task_ids:extractive-qa)
	- [`abstractive-qa`](/datasets?filter=task_ids:abstractive-qa)
	- [`other`](/datasets?filter=task_ids:other)
- `sequence-modeling`: such as language modeling or dialogue
	- [`dialogue-modeling`](/datasets?filter=task_ids:dialogue-modeling)
	- [`language-modeling`](/datasets?filter=task_ids:language-modeling)
	- [`other-multi-turn`](/datasets?filter=task_ids:other-multi-turn)
	- [`slot-filling`](/datasets?filter=task_ids:slot-filling)
	- [`other`](/datasets?filter=task_ids:other)
- `structure-prediction`: predicting structural properties of the text, such as syntax
	- [`coreference-resolution`](/datasets?filter=task_ids:coreference-resolution)
	- [`named-entity-recognition`](/datasets?filter=task_ids:named-entity-recognition)
	- [`parsing`](/datasets?filter=task_ids:parsing)
	- [`other`](/datasets?filter=task_ids:other)
- `text-classification`: predicting a class index or boolean value
	- [`acceptability-classification`](/datasets?filter=task_ids:acceptability-classification)<commit_msg>Add part-of-speech-tagging in datasets task ids (#275)<commit_after>---
title: Datasets Tags documentation
---

<h1 class="no-top-margin">Datasets Tags documentation</h1>


## Tasks

- `conditional-text-generation`: data-to-text and text transduction tasks such as translation or summarization
	- [`machine-translation`](/datasets?filter=task_ids:machine-translation)
	- [`sentence-splitting-fusion`](/datasets?filter=task_ids:sentence-splitting-fusion)
	- [`summarization`](/datasets?filter=task_ids:summarization)
	- [`table-to-text`](/datasets?filter=task_ids:table-to-text)
	- [`text-simplification`](/datasets?filter=task_ids:text-simplification)
	- [`explanation-generation`](/datasets?filter=task_ids:explanation-generation)
	- [`other-stuctured-to-text`](/datasets?filter=task_ids:other-stuctured-to-text)
	- [`other`](/datasets?filter=task_ids:other)
- `question-answering`: question answering tasks
	- [`open-domain-qa`](/datasets?filter=task_ids:open-domain)
	- [`closed-domain-qa`](/datasets?filter=task_ids:closed-domain)
	- [`multiple-choice-qa`](/datasets?filter=task_ids:multiple-choice)
	- [`extractive-qa`](/datasets?filter=task_ids:extractive-qa)
	- [`abstractive-qa`](/datasets?filter=task_ids:abstractive-qa)
	- [`other`](/datasets?filter=task_ids:other)
- `sequence-modeling`: such as language modeling or dialogue
	- [`dialogue-modeling`](/datasets?filter=task_ids:dialogue-modeling)
	- [`language-modeling`](/datasets?filter=task_ids:language-modeling)
	- [`other-multi-turn`](/datasets?filter=task_ids:other-multi-turn)
	- [`slot-filling`](/datasets?filter=task_ids:slot-filling)
	- [`other`](/datasets?filter=task_ids:other)
- `structure-prediction`: predicting structural properties of the text, such as syntax
	- [`coreference-resolution`](/datasets?filter=task_ids:coreference-resolution)
	- [`named-entity-recognition`](/datasets?filter=task_ids:named-entity-recognition)
	- [`part-of-speech-tagging`](/datasets?filter=task_ids:part-of-speech-tagging)
	- [`parsing`](/datasets?filter=task_ids:parsing)
	- [`other`](/datasets?filter=task_ids:other)
- `text-classification`: predicting a class index or boolean value
	- [`acceptability-classification`](/datasets?filter=task_ids:acceptability-classification)
{'fraction_non_alphanumeric': 0.17352332797058148, 'fraction_numerical': 0.0016088255573431394, 'mean_word_length': 7.258064516129032, 'pattern_counts': {'":': 0, '<': 7, '<?xml version=': 0, '>': 7, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '7280882', 'n_tokens_mistral': 1551, 'n_tokens_neox': 1488, 'n_words': 154}