[no-conn] absolutely, accordingly actually, additionally admittedly, afterward again, already, also, alternately, alternatively although, altogether, amazingly, and anyway, apparently, arguably, as_a_result, basically, because_of_that because_of_this besides, but by_comparison, by_contrast, by_doing_this, by_then certainly, clearly, coincidentally, collectively, consequently conversely curiously, currently, elsewhere, especially, essentially, eventually, evidently, finally, first, firstly, for_example for_instance fortunately, frankly, frequently, further, furthermore generally, gradually, happily, hence, here, historically, honestly, hopefully, however ideally, immediately, importantly, in_contrast, in_fact, in_other_words in_particular, in_short, in_sum, in_the_end, in_the_meantime, in_turn, incidentally, increasingly, indeed, inevitably, initially, instead, interestingly, ironically, lastly, lately, later, likewise, locally, luckily, maybe, meaning, meantime, meanwhile, moreover mostly, namely, nationally, naturally, nevertheless next, nonetheless normally, notably, now, obviously, occasionally, oddly, often, on_the_contrary, on_the_other_hand once, only, optionally, or, originally, otherwise, overall, particularly, perhaps, personally, plus, preferably, presently, presumably, previously, probably, rather, realistically, really, recently, regardless, remarkably, sadly, second, secondly, separately, seriously, significantly, similarly, simultaneously slowly, so, sometimes, soon, specifically, still, strangely, subsequently, suddenly, supposedly, surely, surprisingly, technically, thankfully, then, theoretically, thereafter, thereby, therefore third, thirdly, this, though, thus, together, traditionally, truly, truthfully, typically, ultimately, undoubtedly, unfortunately, unsurprisingly, usually, well, yet,
---
language:
- en
tags:
- discourse-marker-prediction
- discourse-connective-prediction
- discourse-connective
- discourse-marker
- discourse-relation-prediction
- pragmatics
- discourse
license: apache-2.0
datasets:
- discovery
metrics:
- accuracy
widget:
- text: "But no, Amazon selling 3D printers is not new.</s></s>The promise of 3D printing is very great."
---

# Discourse marker prediction / discourse connective prediction pretrained model

`roberta-base` pretrained on discourse marker prediction on the Discovery dataset with a validation accuracy of 30.93% (majority class is 0.57%)

https://github.com/sileod/discovery

https://huggingface.co/datasets/discovery

This model can also be used as a pretrained model for NLU, pragmatics and discourse tasks

## Citing & Authors

```bibtex 
@inproceedings{sileo-etal-2019-mining,
    title = "Mining Discourse Markers for Unsupervised Sentence Representation Learning",
    author = "Sileo, Damien  and
      Van De Cruys, Tim  and
      Pradel, Camille  and
      Muller, Philippe",
    booktitle = "Proceedings of the 2019 Conference of the North {A}merican Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)",
    month = jun,
    year = "2019",
    address = "Minneapolis, Minnesota",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/N19-1351",
    doi = "10.18653/v1/N19-1351",
    pages = "3477--3486",
}
```