task_categories:text-classification task_categories:token-classification task_categories:text-generation size_categories:10K<n<100K language:en license:cc-by-4.0 NLP Entailment NLI google-research-datasets arxiv:2212.10750 region:us
This is a reproduced (i.e. after web-crawling) and processed version of the "PropSegment" dataset from Google Research.

Since the News portion of the dataset is released only via urls, we reconstruct the dataset by crawling. Overall, ~96% 
of the dataset can be reproduced, and the rest ~4% either have url no longer valid, or sentences that have been edited 
(i.e. cannot be aligned with the orignial dataset).

PropSegment (Proposition-level Segmentation and Entailment) is a large-scale, human annotated dataset for segmenting 
English text into propositions, and recognizing proposition-level entailment relations --- whether a different, related 
document entails each proposition, contradicts it, or neither.

The original dataset features >45k human annotated propositions, i.e. individual semantic units within sentences, as 
well as >45k entailment labels between propositions and documents.
@inproceedings{chen2023propsegment,
    title = "{PropSegmEnt}: A Large-Scale Corpus for Proposition-Level Segmentation and Entailment Recognition",
    author = "Chen, Sihao and Buthpitiya, Senaka and Fabrikant, Alex and Roth, Dan  and Schuster, Tal",
    booktitle = "Findings of the Association for Computational Linguistics: ACL 2023",
    year = "2023",
}
---
license: cc-by-4.0
task_categories:
- text-classification
- token-classification
- text-generation
language:
- en
tags:
- NLP
- Entailment
- NLI
- google-research-datasets
pretty_name: PropSegment
size_categories:
- 10K<n<100K
---
# PropSegmEnt: A Large-Scale Corpus for Proposition-Level Segmentation and Entailment Recognition

## Dataset Description

- **Homepage:** https://github.com/google-research-datasets/PropSegmEnt
- **Repository:** https://github.com/google-research-datasets/PropSegmEnt
- **Paper:** https://arxiv.org/abs/2212.10750
- **Point of Contact:** sihaoc@seas.upenn.edu

### Dataset Summary

This is a reproduced (i.e. after web-crawling) and processed version of [the "PropSegment" dataset](https://github.com/google-research-datasets/PropSegmEnt) from Google Research.   

Since the [`News`](https://github.com/google-research-datasets/NewSHead) portion of the dataset is released only via urls, we reconstruct the dataset by crawling. 
Overall, ~96% of the dataset can be reproduced, and the rest ~4% either have url no longer valid, or sentences that have been edited (i.e. cannot be aligned with the orignial dataset).  

PropSegment (Proposition-level Segmentation and Entailment) is a large-scale, human annotated dataset for segmenting English text into propositions, and recognizing proposition-level entailment relations --- whether a different, related document entails each proposition, contradicts it, or neither.

The original dataset features >45k human annotated propositions, i.e. individual semantic units within sentences, as well as >35k entailment labels between propositions and documents. 

Check out more details in the [dataset paper](https://arxiv.org/abs/2212.10750).


## Dataset Structure

Here we provide processed versions of the dataset for seq2seq model inputs/outputs.

`proposition_segmentation.*.jsonl` contains data for the text segmentation task, i.e. split a sentence into propositions. 
The output propositions are concatenated as one string (with no particular order between them) by a special token `[SEP]`. 
Each proposition is annotated as spans enclosed by `[M]` and `[/M]`.

```
{
  "sentence": "This film marks the directorial debut for production designer Robert Stromberg.",
  "propositions": "This film marks the directorial debut for [M]production designer Robert Stromberg.[/M][SEP]This [M]film marks the directorial debut for[/M] production designer [M]Robert Stromberg[/M]."
}
```

`propnli.*.jsonl` contains examples for the proposition-to-document entailment task, i.e. Given a proposition and a document, predict whether the proposition can be entailed/contradicted, or neutral with respect to the document.


```
{
  "hypothesis": "[M]The Departed is[/M] a 2006 feature film [M]directed by Martin Scorsese.[/M]",
  "premise": "The Departed is a 2006 American crime thriller film directed by Martin Scorsese and written by William Monahan. It starred Leonardo DiCaprio, Matt Damon, Jack Nicholson, and Mark Wahlberg, with Martin Sheen, Ray Winstone, Vera Farmiga, and Alec Baldwin in supporting roles. It is a remake of the Hong Kong film Infernal Affairs (2002).\nThe Departed won the Oscar for Best Picture at the 79th Academy Awards. Scorsese received the Oscar for Best Director, Thelma Schoonmaker the Oscar for Best Editing and William Monahan the Oscar for Best Adapted Screenplay.",
  "label": "e"
}
```

### Citation

```
@inproceedings{chen2023propsegment,
    title = "{PropSegmEnt}: A Large-Scale Corpus for Proposition-Level Segmentation and Entailment Recognition",
    author = "Chen, Sihao and Buthpitiya, Senaka and Fabrikant, Alex and Roth, Dan  and Schuster, Tal",
    booktitle = "Findings of the Association for Computational Linguistics: ACL 2023",
    year = "2023",
}
```

