<jupyter_start><jupyter_text>Explore a dataset of argumentative and dialog texts> <NAME> and <NAME> (2014) Annotating Argument Components and Relations in Persuasive Essays. In: Proceedings of the the 25th International Conference on Computational Linguistics (COLING 2014), p.1501-1510, Ireland, Dublin.<jupyter_code>import numpy as np
import pandas as pd
from tqdm.notebook import tqdm
import spacy
import os
nlp = spacy.load("en_core_web_sm")
dataset_folder = 'data/brat-project/'
docs = []
for f in tqdm(os.listdir(dataset_folder)):
    if f.endswith('.txt'):
        with open(os.path.join(dataset_folder, f), 'r') as data:
            text = data.read()
            docs += [s for s in nlp(text).sents]<jupyter_output><empty_output><jupyter_text>Surveys<jupyter_code>c = 'but'
for z, doc in enumerate(docs):
    i = [j for j, w in enumerate(doc) if w.lemma_ == c]
    if len(i) > 0:
        pos = i[0]
        if len(doc[:pos]) > 0:
            print(doc[:pos])
            print(c)
            print(doc[pos+1:], '\n')
        else:
            print(docs[z-1])
            print(c)
            print(doc[pos+1:], '\n')<jupyter_output>However, on the other side of the coin are voices in the opposition, saying that universities provide not only skills for careers,
but
also academic knowledge for the human race, such as bio science, politics, and medicine. 

Nowadays, the popularity of mobile phones has brought about a lot of convenience
but
at the meanwhile a variety of problems as well, such as social, medical and technical problems. 

This possibility exists all the time.
but
a more efficient and reliable system can also be invented to guarantee the private information of users.
 

Not only used for communication,
but
it also functions as an Internet browser, a music player , a personal organiser and so forth.
 

It's done nothing
but
waste tax payer dollars, fill prisons with non violent criminals, and create a black market. 

and that's why it's illegal.
but
then you'd have to explain why alcohol and tobacco are legal because those substances are way more harmful than cannabis. 

Most of the time, it is not about[...]<jupyter_text>Dialogues<jupyter_code>dataset = '/Users/alfio/Dati/cornell movie-dialogs corpus/data/movie_lines.txt'
with open(dataset, 'r', encoding='latin-1') as gf:
    lines = gf.readlines()
raw = [nlp(l.split(' +++$+++ ')[-1].rstrip()) for l in lines[:200]]
for z, doc in enumerate(raw):
    i = [j for j, w in enumerate(doc) if w.lemma_ == c]
    if len(i) > 0:
        pos = i[0]
        print(raw[z-1])
        print(doc, '\n')<jupyter_output>You always been this selfish?
But 

I was?
I looked for you back at the party, but you always seemed to be "occupied". 

She's not a...
I'm workin' on it. But she doesn't seem to be goin' for him. 

I'm workin' on it. But she doesn't seem to be goin' for him.
I really, really, really wanna go, but I can't.  Not unless my sister goes. 

Is he oily or dry?
He practically proposed when he found out we had the same dermatologist. I mean. Dr. Bonchowski is great an all, but he's not exactly relevant party conversation. 

Neat...
It's a gay cruise line, but I'll be, like, wearing a uniform and stuff. 

After that, I swore I'd never do anything just because "everyone else" was doing it.  And I haven't since. Except for Bogey's party, and my stunning gastro-intestinal display --
But 

Now I do.  Back then, was a different story.
But you hate Joey 

I wish I had that luxury. I'm the only sophomore that got asked to the prom and I can't go, because you won ' t.
I do care. But I'm a firm believer[...]
{'fraction_non_alphanumeric': 0.09492089925062448, 'fraction_numerical': 0.008881487649181239, 'mean_word_length': 3.4438964241676944, 'pattern_counts': {'":': 0, '<': 13, '<?xml version=': 0, '>': 17, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'chain_length': '3', 'dir': 'jupyter-structured-clean-dedup', 'id': '667461', 'license': 'MIT', 'n_tokens_mistral': 1178, 'n_tokens_neox': 1091, 'n_words': 502, 'path': 'implicit/explore.ipynb', 'repo_name': 'ranieri-unimi/notes-ferrara-2022', 'size': '3619'}