model update

README.md

@@ -0,0 +1,144 @@
+
+---
+license: cc-by-4.0
+metrics:
+- bleu4
+- meteor
+- rouge-l
+- bertscore
+- moverscore
+language: en
+datasets:
+- lmqg/qg_tweetqa
+pipeline_tag: text2text-generation
+tags:
+- question answering
+widget:
+- text: "question: What is a person called is practicing heresy?, context: Heresy is any provocative belief or theory that is strongly at variance with established beliefs or customs. A heretic is a proponent of such claims or beliefs. Heresy is distinct from both apostasy, which is the explicit renunciation of one's religion, principles or cause, and blasphemy, which is an impious utterance or action concerning God or sacred things."
+  example_title: "Question Answering Example 1" 
+- text: "question: who created the post as we know it today?, context: 'So much of The Post is Ben,' Mrs. Graham said in 1994, three years after Bradlee retired as editor. 'He created it as we know it today.'— Ed O'Keefe (@edatpost) October 21, 2014"
+  example_title: "Question Answering Example 2" 
+model-index:
+- name: lmqg/bart-large-tweetqa-qa
+  results:
+  - task:
+      name: Text2text Generation
+      type: text2text-generation
+    dataset:
+      name: lmqg/qg_tweetqa
+      type: default
+      args: default
+    metrics:
+    - name: BLEU4 (Question Answering)
+      type: bleu4_question_answering
+      value: 35.95
+    - name: ROUGE-L (Question Answering)
+      type: rouge_l_question_answering
+      value: 61.82
+    - name: METEOR (Question Answering)
+      type: meteor_question_answering
+      value: 34.86
+    - name: BERTScore (Question Answering)
+      type: bertscore_question_answering
+      value: 94.37
+    - name: MoverScore (Question Answering)
+      type: moverscore_question_answering
+      value: 79.66
+    - name: AnswerF1Score (Question Answering)
+      type: answer_f1_score__question_answering
+      value: 68.58
+    - name: AnswerExactMatch (Question Answering)
+      type: answer_exact_match_question_answering
+      value: 50.54
+---
+
+# Model Card of `lmqg/bart-large-tweetqa-qa`
+This model is fine-tuned version of [facebook/bart-large](https://huggingface.co/facebook/bart-large) for question answering task on the [lmqg/qg_tweetqa](https://huggingface.co/datasets/lmqg/qg_tweetqa) (dataset_name: default) via [`lmqg`](https://github.com/asahi417/lm-question-generation).
+
+
+### Overview
+- **Language model:** [facebook/bart-large](https://huggingface.co/facebook/bart-large)   
+- **Language:** en  
+- **Training data:** [lmqg/qg_tweetqa](https://huggingface.co/datasets/lmqg/qg_tweetqa) (default)
+- **Online Demo:** [https://autoqg.net/](https://autoqg.net/)
+- **Repository:** [https://github.com/asahi417/lm-question-generation](https://github.com/asahi417/lm-question-generation)
+- **Paper:** [https://arxiv.org/abs/2210.03992](https://arxiv.org/abs/2210.03992)
+
+### Usage
+- With [`lmqg`](https://github.com/asahi417/lm-question-generation#lmqg-language-model-for-question-generation-)
+```python
+from lmqg import TransformersQG
+
+# initialize model
+model = TransformersQG(language="en", model="lmqg/bart-large-tweetqa-qa")
+
+# model prediction
+answers = model.answer_q(list_question="What is a person called is practicing heresy?", list_context=" Heresy is any provocative belief or theory that is strongly at variance with established beliefs or customs. A heretic is a proponent of such claims or beliefs. Heresy is distinct from both apostasy, which is the explicit renunciation of one's religion, principles or cause, and blasphemy, which is an impious utterance or action concerning God or sacred things.")
+
+```
+
+- With `transformers`
+```python
+from transformers import pipeline
+
+pipe = pipeline("text2text-generation", "lmqg/bart-large-tweetqa-qa")
+output = pipe("question: What is a person called is practicing heresy?, context: Heresy is any provocative belief or theory that is strongly at variance with established beliefs or customs. A heretic is a proponent of such claims or beliefs. Heresy is distinct from both apostasy, which is the explicit renunciation of one's religion, principles or cause, and blasphemy, which is an impious utterance or action concerning God or sacred things.")
+
+```
+
+## Evaluation
+
+
+- ***Metric (Question Answering)***: [raw metric file](https://huggingface.co/lmqg/bart-large-tweetqa-qa/raw/main/eval/metric.first.answer.paragraph_question.answer.lmqg_qg_tweetqa.default.json) 
+
+|                  |   Score | Type    | Dataset                                                            |
+|:-----------------|--------:|:--------|:-------------------------------------------------------------------|
+| AnswerExactMatch |   50.54 | default | [lmqg/qg_tweetqa](https://huggingface.co/datasets/lmqg/qg_tweetqa) |
+| AnswerF1Score    |   68.58 | default | [lmqg/qg_tweetqa](https://huggingface.co/datasets/lmqg/qg_tweetqa) |
+| BERTScore        |   94.37 | default | [lmqg/qg_tweetqa](https://huggingface.co/datasets/lmqg/qg_tweetqa) |
+| Bleu_1           |   59.01 | default | [lmqg/qg_tweetqa](https://huggingface.co/datasets/lmqg/qg_tweetqa) |
+| Bleu_2           |   49.88 | default | [lmqg/qg_tweetqa](https://huggingface.co/datasets/lmqg/qg_tweetqa) |
+| Bleu_3           |   41.7  | default | [lmqg/qg_tweetqa](https://huggingface.co/datasets/lmqg/qg_tweetqa) |
+| Bleu_4           |   35.95 | default | [lmqg/qg_tweetqa](https://huggingface.co/datasets/lmqg/qg_tweetqa) |
+| METEOR           |   34.86 | default | [lmqg/qg_tweetqa](https://huggingface.co/datasets/lmqg/qg_tweetqa) |
+| MoverScore       |   79.66 | default | [lmqg/qg_tweetqa](https://huggingface.co/datasets/lmqg/qg_tweetqa) |
+| ROUGE_L          |   61.82 | default | [lmqg/qg_tweetqa](https://huggingface.co/datasets/lmqg/qg_tweetqa) |
+
+
+
+## Training hyperparameters
+
+The following hyperparameters were used during fine-tuning:
+ - dataset_path: lmqg/qg_tweetqa
+ - dataset_name: default
+ - input_types: ['paragraph_question']
+ - output_types: ['answer']
+ - prefix_types: None
+ - model: facebook/bart-large
+ - max_length: 512
+ - max_length_output: 32
+ - epoch: 6
+ - batch: 32
+ - lr: 1e-05
+ - fp16: False
+ - random_seed: 1
+ - gradient_accumulation_steps: 2
+ - label_smoothing: 0.15
+
+The full configuration can be found at [fine-tuning config file](https://huggingface.co/lmqg/bart-large-tweetqa-qa/raw/main/trainer_config.json).
+
+## Citation
+```
+@inproceedings{ushio-etal-2022-generative,
+    title = "{G}enerative {L}anguage {M}odels for {P}aragraph-{L}evel {Q}uestion {G}eneration",
+    author = "Ushio, Asahi  and
+        Alva-Manchego, Fernando  and
+        Camacho-Collados, Jose",
+    booktitle = "Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing",
+    month = dec,
+    year = "2022",
+    address = "Abu Dhabi, U.A.E.",
+    publisher = "Association for Computational Linguistics",
+}
+
+```

config.json

@@ -1,5 +1,5 @@
 {
-  "_name_or_path": "lmqg_output/bart-large-tweetqa-qa/best_model",
+  "_name_or_path": "lmqg_output/bart-large-tweetqa-qa/model_cmzqsx/epoch_2",
   "activation_dropout": 0.1,
   "activation_function": "gelu",
   "add_bias_logits": false,

eval/metric.first.answer.paragraph_question.answer.lmqg_qg_tweetqa.default.json

@@ -0,0 +1 @@
+{"validation": {"Bleu_1": 0.6017699115041932, "Bleu_2": 0.5146747771942256, "Bleu_3": 0.43079249665719227, "Bleu_4": 0.35886762158071245, "METEOR": 0.36146446611102423, "ROUGE_L": 0.6287626833120893, "BERTScore": 0.9414005632448811, "MoverScore": 0.8003894814325069, "AnswerF1Score": 69.71718122270593, "AnswerExactMatch": 53.95948434622468}, "test": {"Bleu_1": 0.5901366211260946, "Bleu_2": 0.49878805221333594, "Bleu_3": 0.41699456611290897, "Bleu_4": 0.35948740368160575, "METEOR": 0.3485675293591241, "ROUGE_L": 0.6182130879232641, "BERTScore": 0.9436713169736854, "MoverScore": 0.7966395228512606, "AnswerF1Score": 68.57645920870208, "AnswerExactMatch": 50.54031587697423}}

eval/samples.test.hyp.paragraph_question.answer.lmqg_qg_tweetqa.default.txt

@@ -0,0 +1,1203 @@
+@darbooth
+5 years
+5
+5 years in 5 seconds
+southwest air
+a select number of aircraft have been removed for maintenance checks
+crying
+why is she crying
+blank space
+taylor
+tomorrow
+37500
+zach lowe
+a straight face
+ebola
+after the flight
+5%
+25%
+ Portland
+ Portland
+the washington post
+poll numbers
+jeff gordon
+sideburns, a mullet & a taxi cab
+tweet is not visible
+tweet is not visible
+saturday night live
+donald trump
+south carolina
+picking cotton
+china
+the winners room
+at the top of a stair case
+southampton
+ticket refunds
+ Entertainment Weekly
+16
+an adult day care center
+the white house
+migrants and refugees
+serbia-croatia
+lauren hill
+kdemoff
+expression of regret
+not being able to do something
+the dumb media
+dumb
+consistency
+atletico
+durbanites
+immigrants
+scotland
+panmure golf club
+willow seeds
+snow
+west boca
+u.s. marshals
+going to the white house
+the white house
+one year
+one year later
+chris rock
+the oscars
+jharrison9292
+steelers
+demanding answers
+paul walkers
+he died
+talent
+a bad tragedy
+a good person
+the police don't know
+their stressful jobs
+a sandwich
+a broomstick
+megyn kelly
+@foxnews
+roger rees
+brilliant actor and colleague
+it will happen here
+the internet
+kkk jokes
+@khloekardashian
+kellyanne conway
+britney ever after
+stop
+kanyewest
+donald trump
+russian
+the prime minister
+the duke and duchess of cambridge
+it is disgusting
+nytimes
+bOOYAH
+zero guns, zero knives and 2 hands
+pOTUS
+he led and served our country
+she is dead
+eric the actor
+eric the actor
+the democrats
+that so many obama democrats voted for him
+years
+michigan,ohio, penn and a second term
+the daily show
+UEFA
+group b
+june 20, 2016
+group b
+another spider-man movie reboot
+josh peck and drake bell
+josh peck got married
+philly
+1,000
+jacob lescenskii
+a huge impact
+beyonce
+beyonce
+0
+90 percent
+mosul
+idp camps
+haradh hospital
+15
+every moment I exist is agony
+katy
+his son
+a couple of presents
+a couple of presents
+new owners and management team
+read all about it here
+caterham
+he is questioning himself.
+dummy reporter john heilemann
+yvette clarke
+rep john lewis
+potus
+for statement on nukes
+spend less time voting
+to spend less time voting in the senate
+they said what so many of us want to say
+khan's
+presidential bling
+campus
+steve bannon
+drafts
+sacramento kings
+marcus cousins
+iran
+the nuclear deal
+counts
+switzerland
+honduras
+two more
+two more nations
+wilmariel and jason
+orlando's Pulse nightclub vigil
+chester bennington
+chester bennington
+ proper eyewear
+solar eclipse
+making the u.s. a. rich
+inauguration
+cleveland
+tara the hero cat and family
+bOGO offer
+lebron james
+colombian game
+2018
+democrats
+a Muslim
+mosques
+women
+for perspective
+3 feet
+the fcc
+a loss
+senzo meyiwa
+james gunn
+guardians of the galaxy
+the city
+donald trump
+and then what
+good
+iowa
+winter
+miss cleo
+my mom
+zazie beetz
+ Deadpool
+there is going to be a toy story
+there is going to be a toy story
+the school district
+to get a diplomatic resolution
+sanctions
+beyonce
+solar lanterns
+climate action
+at COP22
+solar lanterns
+the iraqi command
+reclaim their territory from ISIL
+kanye
+lawyer, staFFmpeg and lawyer
+beyonce
+beyonce even falls on beat
+basic human decency
+ratings
+basic human decency
+work harder
+four
+the red state gathering
+ben bradlee
+jennifer aniston
+justin theroux
+beyonce
+emmys
+nytimes critic
+shonda rhimes
+#fantasticfour
+charlotte
+a flower
+because he feels that we are all one
+jesse williams
+jonathan bennett
+jonathan bennett
+tomorrow morning
+history
+pioneers
+2015
+boston
+hillary clinton
+philly
+david burtka
+in iran
+over the weekend
+in iran
+from reds to braves
+$14 million
+Arkansas
+August 4, 2014
+two
+the real Camelot
+obama
+holy cow
+youtube
+it felt like night
+crickets
+democrat congresswoman
+zachary hammond
+in the light
+having the opportunity to meet him
+gordie howe
+peas in guac
+the nyt
+my country
+bed
+this morning
+bexley rd
+the uk
+mcdonald's uk
+uk
+july 21, 2015
+mcdonalds uk
+the secret menu
+mcdonald's uk
+the culture
+tucker carlson and steve hiltonx
+blue
+nicolespag
+true blood
+museum modern art
+big bird and baby bear
+dylan
+her face
+gwen stefani
+leSean mccoy
+the restaurant receipt thing
+fidel castro
+3 minutes to midnight
+executive director and publisher of thebulletin
+20 week abortion bans
+unconstitutional
+she kept her baby
+her divine right to live
+william
+dolores
+cheese dust
+michelle obama
+apples and oranges
+orange
+pistons
+reggie jackson
+millions march
+in union square
+silenced
+to take nisa home
+surabaya
+a little creeped out
+faceID
+atlanta
+home
+atlanta
+a stair master in hell
+hell
+a stair master in hell
+backup QBs
+patriots
+black protester
+4
+parents
+many years
+a significant milestone
+beam
+andre iguodala
+kurt helin
+facebook and twitter
+russell crowe
+prime minister nawaz Sharif
+emotional things
+never showed up for class
+mariah carey
+brazil
+brazil
+the golf course
+jimmy
+donald trump
+hillary clinton
+hillary clinton
+text dunham to 47246
+dem convention
+a farmer
+loading this beast
+emma watson
+marchers
+scared af
+a tweet does not exist
+a tweet does not exist
+natural gas
+we could see them
+an elephant
+john d. sutter
+a nap
+a pillow and blanket
+julia louis-dreyfus
+julia louis-dreyfus
+everyone here in vegas
+everyone here in vegas
+bloody republican lefties
+on our money
+eng
+his organization
+a league apology
+the ballon d'or
+second
+syria
+syria
+rest in peace
+ Porto alegre
+full house
+slanderous
+senator john mccain and all our veterans
+kobani
+kobani
+the cops
+wish him luck
+wish him luck
+the cops
+nazis and hate
+the swastika
+uninvited guests
+restaurants
+dr pepper
+RIP phIFE
+coke
+ immigrants
+sitting with family
+a month and a day
+the show
+too busy pulling out pages on evolution
+ autographed it
+his stick
+young canucks fan
+so he could be in front of nato group
+ Montenegro PM
+romney
+two
+romney
+romney
+romney
+romney
+something back
+luís figo
+the tony awards
+patti lupone
+mourning
+america
+the president
+prince
+prince
+the patriots
+the nfl
+rachel nichols
+an apology
+wind gusts
+kenting
+israel
+warm friendship
+the wall
+ negotiators can continue working on outstanding issues
+thanksgiving
+his father
+two
+start our holiday
+a cat is out of a bag
+very very happy
+Andrew garfield
+asian
+a warm wind
+42 degrees celsius
+yorktown
+hamilton
+danny granger/josh mRoberts
+lebron james
+why is it being retooled
+it is being retooled
+cesare prandelli
+american horror story
+to kill me
+trying to kill me
+liverpool
+on sunday
+anliverpool
+liverpool
+Sunday
+ shoreham
+ shoreham air show
+liberty island
+emergency personnel
+solange
+upload the audio to that elevator fight
+fergie
+milf money
+annie and john glenn
+john glenn
+ariannahuff
+because she is a dog
+there was tremendous pressure.
+durant
+promoting an ad
+shameful
+tweet promoting an ad
+t THC
+2.71 inches
+almost 3 inches
+as soon as tuesday
+vegas
+2 hours
+trafalgar square bookstore
+mars
+a man with no legs
+legs
+pac
+I love him
+he was gay.
+lukas-podolski
+the mets
+confident
+jdeezal
+new tattoo
+the trailer
+a big screen
+$125
+their family's initials
+a veterinarian
+germany
+barf bag
+kim kardashian
+the OG crew
+some things
+in your honor
+scientists and engineers
+nhl contract
+the flapanthers
+her heart
+mixed
+the weather is cold.
+half brother
+the evacuated passengers
+travelers beach hotel
+travelers beach hotel
+the evacuated passengers
+unpredictable
+being unpredictable
+anaconda
+choreo and vid of the year
+to express support
+we appreciate it
+jeb bush
+special interest
+us embassy in france
+#je suischarlie
+cpd
+ 970
+hillary clinton
+April 12, 2015
+the oscars
+2015
+mtv
+you never monkey with the truth
+ben bradlee
+the truth
+ben bradlee
+he feels misunderstood
+ responded to a specific tweet
+74
+muhammad ali
+the cowards
+he passed
+susan pictures
+steve iris
+a new type
+the 787
+the bachelor finale
+last night's bachelor finale
+amazon and iTunes
+our fans
+beyonce
+twins
+20 years ago
+the notorious b.I.G
+always have been
+pretty private
+the democrats
+shutdown
+at a time we need it most
+june 30, 2014
+#homesweethome
+bullying
+lavernecox
+jeff flake
+stan freberg
+stan freberg
+269
+fcbarcelona
+kris jenner
+kris jenner
+@apple
+the biggest, coolest, sexiest, funnest
+gwen stefani
+ whoever did her face
+lost contact of mh17
+over ukrainian airspace
+us presidents
+three
+go black
+dean
+posting extra hard
+posting extra hard
+shooting
+charlotte
+giving cars away
+cars
+a family to feed
+their privilege
+barbie
+buy her daughter a barbie
+kat graham and dshippjr
+to code
+STEM
+he will be treated like a king
+justin
+check the forecast
+i-24 in kentucky
+rakim kane kRS
+all the people that have inspired him
+buzzfeed team
+buzzfeed team
+buzzfeed
+on an amazing November
+ delusion
+ted cruz
+ passive aggressiveness
+her daughter
+in vegas
+dwyane wade
+vfwmane event
+#vfwmane event
+before
+#vfwmaneevent
+disappointed
+rickie fowler
+cannot conclude
+cannot conclude
+the tony awards press room
+she is thanking people
+ twice as good
+half as much
+Simply beautiful
+george
+super bowl47
+47
+ acoustic
+lady gaga
+to its core mission
+today
+the SEC championship game
+jim m elwain
+wash mystics
+chicago
+ Bulls fans
+st louis blues camp
+a Stanley cup
+he passed away
+all
+to win the arc
+francegalop
+yuichi fukuunaga
+kuzma
+vote your conscience
+hillary clinton
+a pep talk
+a pep talk from the Hanson brothers
+hanson brothers
+johnstown, pittsburgh
+tsarnaev
+rolling stone
+nepal
+reach out to those affected
+marcus morris
+aaron gordon
+kaley cuoco
+long ago
+president of ukraine
+scenes in kiev
+bringing a son into this world
+bringing a son into this world
+hulk earrings
+hulk
+bill murray
+x's victory
+x's victory
+bill murray
+trump's jock
+mccain's or kasich's socks
+chiraq
+sexualizing and making a comedy out of gun violence
+leslie jones
+arrest and prosecuted
+all
+a young man's death
+40 pounds
+207
+chris martin
+getting divorced
+insufferable similarities
+10 minutes
+the bachelorette finale
+tomorrow
+ midnight
+as president
+russia
+russia
+raiseyourpencilforfreedom
+andre lesnie
+ humor and love
+coaches
+geno auriemma
+dunkin donuts
+starbucks
+hassan Rouhani
+second term
+extratv
+a cheese baby
+pregnancy
+iowa
+a van
+heat
+model
+california
+change
+that it would benefit the wealthy over the middle class
+hawaii
+the law will take effect on January 3, 2016
+reporting them
+rape
+the best designer
+the best designer
+4-3-3
+4-3-3
+j_klinsmann
+j_klinsmann
+congressman john lewis
+john lewis
+mike munchak
+5 hours
+copper breaks state park
+ grasshoppers and beetles
+justin kirkland
+ Raven gates
+from subway rides to bowling alley
+footseps
+political
+in the upcoming weeks
+a sniper, brave, and a neighbor
+7k miles
+in homage
+super bowl and halftime show
+prince william and harry
+their father
+the prince of wales
+william and harry
+police
+the police were saving you
+himself and obama
+racial animus
+"Hijacking"
+ Ethiopian Airlines
+josh gad
+rance hHoward
+your support
+lunch time
+the skin
+under my fingernails
+crying
+tear gas and water canons
+Nazem kadri
+cross-check
+ Hungarian
+tom & jerry
+charlottesville
+unite the country
+good sex
+everything works out in the end
+she's sorry about that
+pittsburg
+new york slough
+goalless
+fc bayern
+on the phone
+july
+the wall was not properly funded
+daca
+the wall
+pregnant
+where are the pics?
+movie going experience
+AMC
+as much as poss.
+ meaningful things
+emotional
+hectoring and yelling at me
+hectoring and yelling
+syrian envoy to the UNSC
+fallujah, iran
+indian PMU
+fallujah, iran
+ramsey
+in a movie
+unpaid
+paternity leave
+mamaJune
+ introducing the new me
+raise your hand
+because academia
+sandra bernhard
+sands hotel in vegas
+be there
+3 republicans and 48 democrats
+joe biden
+paul ryan
+adidas
+#bringbackourchildhood
+1.5m
+obesity
+ addicts to drugs and alcohol
+the beatles
+the sing premiere
+the portraits/art, headline and intro
+janet mock
+grace lewis whitney
+paul cornell
+the new george michael single
+george michael
+after the fantasy draft
+honda
+he smiled
+the hollywood bowl
+the browns
+colin kaepernick
+ruby rose
+social media
+new york rangers
+tbay
+a gym
+motion
+senator john mccain
+meghan mccain
+gaby amarantos
+@gabyamarantos @tottustu
+ciara
+baby future
+loss of life
+attack this morning on the UN
+zordon
+power rangers
+julie
+for his and many others safety
+nigerians and people around the world
+#bringbackourgirls
+@senrand paul
+tweet
+fake news
+assad
+great
+a beautiful picture
+mohammed bin zayed
+ Ministers
+with a spirit of change and progress
+new ministers
+lakers
+2018 free agency
+louis
+nba
+ Pacers and clippers
+lorde
+snl
+she has never/will never
+alan rickman
+a funny and engaging person
+dana harper music
+season 11
+greg schiano
+three
+death row records
+beats by dre
+beats by dre
+michael jackson
+james bond
+this is where the trump budget belongs.
+the house of representatives
+66-57
+flint
+political statements and finger pointing
+long shirts
+find her
+mama
+tapping
+tapping
+arthur schwarzenegger
+swamped
+6 months
+ legalize DACA
+beyonce
+the super bowl
+black
+american
+how to sit like a lady
+miss america
+south korean president moon jae-in
+pyeongchang2018
+to the # emma
+bringing a flask to the
+sad
+exclamation points
+strong
+twitter
+heaven
+little jimmy Dickens
+pickin & grinnin
+heaven
+hillary clinton
+coal country
+oliver sacks
+beautiful minerals
+it's bear cam time
+all year for this
+exploreorg
+music
+the voice
+cavs
+the website
+pharrell
+nasa and/or fort meade public affairs
+donald trump
+the confidence
+beliebers
+van Gaal
+united
+ arsene wenger
+this summer
+voter fraud
+voter fraud
+incredible progress
+kevin hart
+google maps
+pacman
+cnn
+louis
+her/him
+5 minutes
+minion soccer
+minion soccer
+5 minutes
+ed sheeran
+game of thrones
+the shark
+ed sheeran
+ hats
+pharrell's hat
+alex gavan
+search and rescued victims
+he said he was effortlessly golden
+rippaulwalker
+being effortlessly golden
+ effortlessly golden
+rippaulwalker
+golden
+florida gators
+niece and nephew
+measured and inclusive
+michael chertoff
+measured and inclusive
+michael chertoff
+2:30 am EDT
+jFK
+every article
+10:10 am
+being shocked he won
+every article said it was surprising
+6
+a boulder
+philae
+chester bennington's passing
+chester bennington
+cousin
+4 boys
+gaza beach
+loving the pictures
+@si_swimsuit
+ Messiah
+ Messiah
+agree to an interview and a major photo shoot
+cross dressing
+gop
+luis figo
+fifa president
+joseph fiennes
+justin bieber
+selena gomez
+laVar ball
+charles Barkley
+religion
+yaya toure
+death
+selling cigs by the single
+men
+julienblanc
+ Scenes from the book
+50 shades
+earthquake
+october 30, 2016
+rockefeller center
+ PACMAN
+the highway
+bonnieville & etown
+when he started to run for president
+cruz
+section 5 public order act
+ Brighton magistrates court
+colin kazim-richards
+section 5 public order act
+marche republicaine
+charlie
+houston
+$500,000
+the brain
+human rights issues
+christina aguilera's face
+christina aguilera
+will smith
+new orleans
+those pesky products on high shelves
+bouncy aisles
+superior Ct
+for removing pane of slaves picking cotton
+germany and ghania
+rand paul
+for the good of the party
+14,000
+late-November/late-December
+late-November/late-December
+late-November/late-December
+late-November/late-December
+late-November/late-December
+97
+you don't drink
+the cops
+the cops
+fabricate
+his humor, his talent, and his capacity to love
+a brother
+streamlining of the annulment process
+the annulment process
+francis
+made his own
+it's okay
+a bowling alley
+the angle she is taking
+mel Tillis
+good luck with this guys
+cantor
+the knicks
+center
+germany
+underpants
+her hair
+university of washington
+gay people
+people
+weather
+a pizza party
+anti-racist with humour
+mario balotelli
+ethnic and religious groups
+a movie
+she had an abortion
+being openly heterosexual
+matt damon
+pence
+it isn't feasible
+push her head down
+james franco
+they have to be aware
+classy
+#rupertsfault
+christian
+10pm
+the fake news with ted nelms
+pressing the wrong button
+man
+march 15, 2015
+mike porcaro
+he said it was funny.
+that power
+meryl
+take her seat any time
+his spouse or anyone's kids
+ted cruz
+it's not acceptable to attack anyone's spouse or anyone's kids
+2007
+letterman
+the dial
+take over
+the twizzler challenge
+2 black holes merging into 1
+cyberchallenge
+orange
+white supremacists
+the president
+before they die
+reporters
+some memes
+lady gaga's oscars look
+my children
+ venomous
+fia16
+a380
+do exactly what they say
+terrorists
+empire
+one of the episodes
+stay safe and stay warm
+tomorrow
+everybody
+never consciously think of your swing
+rory
+senate maj ldr mcconnell
+7 years
+cindymannings
+rahman suspects
+facebook
+facebook down
+a great healthcare plan
+a great healthcare plan
+get together and piece together
+toffs
+transparency
+there is not a tweet here
+new york police department
+officer brian moore
+Nearly 200
+phasing down hFCs
+leonard
+chris hadfield
+lebron james
+chris broussard
+english and spanish
+sophie cruz
+a dog
+betty willis
+las vegas' visual fabric
+ promoting
+media attention
+jessica lang
+bruce jenner
+the globe
+the power of laughter
+get out and vote
+jon ossoff doesn't even live in the district
+facebook
+how to survive
+sorority
+looking like a grandmother
+ted cruz
+donald trump
+too busy worrying about the controllers strike
+the airport
+netanyahu
+his speech to congress
+baking
+狸始め
+baking
+september 24, 2014
+nine matches
+four months
+bETAwards
+during jay z and beyonce clip
+pk
+navy seals
+15 years
+the u.s.
+Anna kendrick47 andkellanlutz
+she ship them
+sam tageson
+what you have
+his loved ones
+the strength that his loved ones give
+pratt
+spielberg
+a partisan
+grand slam
+netflix
+how to get away with murder
+dallas
+obama
+katie holmes' golden pants
+katie holmes
+corey menafee
+corey menafee
+the u.s chamber
+better and stronger trade deals
+flint
+flint
+january 24, 2016
+a shark
+the bachelor producers
+dem
+a jackass
+rape
+hollywood/media
+tomi lahren
+obamacare
+gender
+gendered
+cup holders
+movie theater and airplane
+impeachment of trump
+plays racist calls
+defending champ murray
+dimitrov
+paul walkerfdn
+paul walkerfdn
+ebola
+winnipeg
+ Kampala Serena
+that it is solar
+kampala Serena
+all humanity
+the wheel of fortune
+a plane
+a plane has vanished
+it's crazy
+people
+a hard but liberating day
+watch the evening news
+south africa
+every praise
+mike brown
+to the movement house
+some farmers
+plowing up dirt
+creme eggs
+kim kardashian pierced her daughters ears
+kim kardashian
+justin bieber
+my myspace
+margot
+he is doing something
+the national weather service map
+serving something more important than himself
+john mccain
+a bit player

eval/samples.validation.hyp.paragraph_question.answer.lmqg_qg_tweetqa.default.txt

@@ -0,0 +1,1086 @@
+megyn kelly
+what is her hidden agenda
+a lot of people
+coachella
+a very good role model
+a very good golfer
+natalie portman
+saturday night live
+self
+trump
+full of spice and a great rack
+shower
+saturday night live
+3 years
+who she is
+trump
+he doesn't care about black people
+freedom
+5 years ago
+the bachelor
+basketball
+we win
+ thoughtful, committed
+a small group
+to love
+to hate
+ryan
+jazz
+stay in your seat, kanye
+stay in your seat, kanye
+his dad
+his first celtics jersey
+the children
+ heteronormative
+barack obama
+#obamaday
+the candle
+having a peach candle
+neil portnow
+women
+abuse of power
+baton rouge
+black panther
+a deep bench of memorable characters
+hidden figures
+michael keaton
+$1
+smosh
+spider mable
+black cat
+nate
+14
+blue wonderful
+sunset strip
+keeganallen
+verizon strike
+downtown boston
+martin luther king
+the play
+very excited
+two
+bodega
+a no-move clause
+three
+a magazine
+his shirt
+time
+ apology
+zero
+@cnn
+the dog
+the right thing
+cnn
+a panel
+every poll of the debate
+jacoby ellsbury
+1st
+michelle obama
+women in film
+mr drew scott
+watch and vote
+simone biles
+bar
+@alessiacara
+the crowd
+@dove
+@espnw #1 in 2017
+@espnw #1 in 2017
+Erdogan
+abuse
+a copy
+donald trump
+lisa kudrow
+smelly cat
+it takes a village
+1997
+the arena
+vancouver
+the moon.
+a reaction to a star
+61 years
+europe
+the word
+the movie
+@davidlevitz
+ stick together
+@ellingyelling
+stunts
+until we are old enough to vote
+mayor mark
+the white house
+@nscpress
+6,000
+black
+chicago
+white
+ex-military
+deprogram
+to protect the american people
+america first
+congress
+a great start
+massive expansion of retraining and counseling
+police force
+@usatopinion
+no surprise
+cellphones
+ patrols
+chrisrock
+chrisrock
+iroquois high school
+grace aroune
+kevloria discovery
+kevloria discovery
+chris hemsworth
+a sweet viennese waltz
+golden ticket
+james comey
+the press
+billie jean king
+a little girl
+kerry washington
+red
+a jury
+murder
+krypton
+krypton
+paul george
+@tmobile custs
+golden globes
+cathy lanier
+26 years
+paris
+u2
+buckingham palace
+the royal air force
+the fbi
+an amazing video
+class of 2017
+9
+tinder
+meet people and have dates
+a president
+down the road
+the economy and AHCA
+he is making things better.
+the media
+dccomics
+2 years
+anthony mackie
+bright, brilliant talent and a truly kind person
+he died
+anton yelchin
+charlie bartlett and house of d
+10,000
+buffalo Sabres
+president
+1000s
+his home rink
+ferrari
+apple watch
+dunkirk
+are u going to die in the dunkirk
+senator gillibrand
+senator gillibrand
+a sad story
+arie
+17 hours
+power
+Oprah
+juggling
+7 and 48 wounded
+the mayor of london
+WMU football
+bb
+a thousand notes
+breaking bad
+2008-13
+mcnugga
+mcnugga
+five
+coldplay
+this secret
+better and better
+32 miles
+ helicopter pilot
+best day of our lives
+kind words
+ purple
+kate gosselin
+rock the casbah
+bill murray
+impassioned
+texas
+billboard
+break free
+everybody must vote
+alabama
+build the wall
+summer
+zendaya
+miranda
+a pretty pink ring
+more shootings and more death
+more
+sundance
+switzerland
+thinkpieces from fyre festival attendees
+fyre festival
+governor jay nixon
+why are the appearances canceled?
+steve bannon
+casting zoe saldana
+zoe saldana
+gold
+charlie coyle
+charlie coyle
+during the first intermission
+the new addition to the zamboni
+donald trump
+pizza rat
+bylsma
+malkin and crosby
+beyonce get here
+landondonovan
+@lagalaxy
+dershowitz
+cassell
+living his best super bowl ever
+dancing
+martin luther king jr
+love
+ Planned Parenthood and ocare
+d.c
+the 4th of July
+taylor swift
+muslim
+trump supporters
+sam bee
+conan obrien
+bb-8
+starwars cast
+obamas
+the nicest
+ undermining democracies all over the world
+ Sherlock Holmes
+doris roberts
+death
+london
+no frauds
+lebron 9
+ Carlton
+hotline bling
+657
+k
+westgate
+westgate
+duchess of cambridge
+they love it
+ed sheeran
+the riverlands
+ed sheeran
+gossip girl
+anxiety
+faith
+ 1903
+1883
+@isaac_h_wright
+australia
+the best
+being his number one cheerleader
+a tickle
+manilla
+biden
+everything she wants to say
+it is a lie.
+brangelina
+iowa flag
+at midfield
+senator rand paul
+4/25
+two more years
+sharks
+the national anthem
+houston
+excitement
+bio
+y'all
+corinne foxx
+miss golden globes 2016
+a meme
+driving students around
+pCL
+michael phelps
+@kDTrey5 and @deandrejordan6
+james harden
+the Browns win or the end of the season
+for clarification
+nail polish
+theshoe
+they are just wrapped in a circle of paranoia
+a cafe
+local
+rogers
+pat quinn way and griffiths way
+tick "white British"
+from now on
+ciara and russell
+his kids
+the 15th
+174 yards
+good morning RUPAUL's DRAG race
+gaga
+floored me
+flats
+gala gadot
+martin
+on the goals
+the rink
+1032 am
+obama
+just how good we had it
+women's uk hockey
+gordon hayward
+l.a.
+preacher lawson
+@tyrabanks
+greg cosell
+football
+sacramento
+lindsay ell
+drama
+julie party
+he is risen
+a candy egg delivering plushy bunny
+thanksgiving
+the ones who have eggs as their profile pics
+a daughter
+liam payne
+artist
+hate speech
+king hall
+canucks
+pat quinn
+mlk
+ MLK day
+through hard times in his life
+his place in tennessee
+the maks
+maksim c
+section 104
+hemsworth
+ruffalo
+being an auctioneer
+halloween
+harden
+two offensive fouls
+@galgadot
+chris hemsworth
+nick kroll and stephen at home
+david letterman
+ Fred armisen
+difficult people
+160 characters
+200
+jimmy kimmel
+for the effort
+grace vanderwaal
+made her famous
+mr. alcohol
+emilia clair
+eyes to see
+a dream
+a police man
+right now
+hurricane harvey
+mike nichols
+his comedy albums
+two scarves and a jacket
+june
+shia la beouf
+ manipulated and orchestrated
+she is absolutely beside herself
+ hopeful
+kermit the frog
+a song
+violence
+short skirt
+chrissy teigen
+kim kardashian
+doloresoriordan
+a love for music
+dylan
+rumors
+paul mccartney
+a career
+ contempt
+billionaire
+donald glover
+hans solon
+ed sheeran
+ask sheev
+olympics
+usa
+nola
+Joel embiid
+the covfefe of strangers
+covfefe
+@anncoulter
+right now
+dave mustaine
+star trek
+in the middle of the night
+alabama
+everyone
+all
+a bow
+she does things on her own time
+low
+honor two more legends of our sport
+sport
+george r. martin
+a heart attack
+larry
+make it about larry
+trump
+mr burns
+megyn kelly
+a lightweight reporter
+to speak in vague but bombastic generalities
+vague but bombastic
+patricia arquette
+half
+celo
+an MK purse
+sdcc 2
+starwars
+eagles fans
+80
+ mesh & booty shorts
+ivy park
+logic301
+blake lively
+he is feeling sad.
+chrissy teigen
+150
+henry cavill's mustache
+henry cavill
+trevor story
+rockies
+donna the elephant
+nervous
+luke donald
+wine
+she can't wait
+writing raps
+la
+john boyega
+in an airport
+ listen to beyonce
+larry
+harry
+tweet did not show
+tweet did not show
+a rematch
+matthew perry
+a year and a half
+making a record
+warren and faye
+warren and faye
+beauty and the beast
+gay
+space jam
+kentucky
+the upper hand
+beyhive
+ Paramount and Warners execs
+imagining Paramount and Warners execs screaming at each other
+luke Skywalker
+the character work
+1997
+hiv/AIDS
+nhl management
+'st. Thomas','santa Claus' and cheese pasta
+introducing their newest custom-painted aircraft
+Disney's frozen
+do ya think I'm sexy
+republic records
+trump burger
+trump burger
+donald trump
+five
+istanbul
+turkey and greece
+sanders
+94 crime bill
+the halftime show
+lady gaga
+south carolina, south dakota and u Utah
+president
+paul feig
+all-female
+alice oswalt
+the universe
+timberlake
+a country album
+hBO is done with the nhl
+24/7 series
+in a wheelchair
+james harrison
+16
+vegas
+jeff sessions
+who's been naughty or nice
+jeff varner
+habitat int'l
+joe biden
+john
+chrissy teigen
+jonathan drouin
+will play on the trip
+joss whedon
+batgirl
+bryzgalov
+nhl allstar
+the words
+their future VPOTUS
+johnlegend
+london
+ Ariana
+gay men
+aIM broke up
+amanda berry
+cleveland
+ann coulter
+delta
+johnny depp
+he is wearing an outfit he found in jenny depp's goodwill donation bag
+kellyanne conway
+the warriors
+jim buss
+kobe bryant
+john williams
+short film 'come swim'
+kristen steward
+madison square garden
+lacey holsworth and her family
+cavs
+cavs
+lebron james
+lebron james and michael jordan
+lebron
+sad
+to spend more time with his pets
+left wing
+a culture of violence
+beyonce
+lemonade
+leslie jones
+2 weeks
+introduce you to Harry, Ginny and albus Potter
+harry, ginny and albus potter
+houston and brown
+tom hiddleston
+seven minutes
+the pens locker room
+live look in
+their mouths
+prayers & hymns
+Hanzal
+boedker
+louis
+katebolduan
+m Ming Xi
+leslie odom, jr
+ liberation station
+wiggins
+106-106
+106-106
+kemba
+macedonian
+for taking a photo
+madonna
+malia obama
+malia obama
+malkin
+ MRI
+facebook
+u.s.
+marc jacobs
+hillary
+mary j blige
+rian johnson
+gryffindor and ravenclaw
+ Gryffindor and ravenclaw
+mad black thot
+she has an album.
+ harlots
+romphim
+ Raven and nick
+donald gets things done
+melania trump
+the Canadian anthem
+held a card up
+anyone a winner
+she's messing with me
+michael dal colle
+sonny milano
+trump
+possession of controlled substance while entering Canada
+canada
+250k
+nashville
+taylor
+white
+because of race
+kukkatori
+kukkatori
+residente's verse on immigrants
+wrote my way out
+david cassidy
+proud and honored
+maya angelou
+caged bird
+Less than one year old
+slow it down
+sweden
+the new agency
+gilmore girls
+gilmore girls
+nope
+everyday heroes
+strong and full of everyday heroes
+the internet
+net neutrality
+kanye west
+2015
+new york
+devastating
+the cops
+he told him he was in wrong skin
+she got beat up
+outside
+say anything negative about curry
+shutup and enjoy the show
+golden globes
+black
+abc
+arie
+justin bieber
+nae nae
+jeff gorton
+11
+the final five
+the floor
+office workers
+san Bernardino
+r-word
+paper towns
+a waterbottle
+downton abbey
+paul walkers
+paul walkers death
+criticsChoice
+9460 wilshire boulevard
+screenshot
+the bachelor
+livia from the bachelor
+ steal people's boyfriends
+you ruined her morals
+a blister
+kotex
+his family
+he spent yesterday with his family
+casino boat
+50 people
+our troops
+the red carpet
+big
+kim kardashian's ass
+patriots
+paul, noma and cherrelle
+harry potter play
+hugh jackman
+ gap toothed
+a hole cut in the wall
+a hole cut in the wall
+every word said
+the pro-am
+tim tebow
+empathy
+chrissy teigen
+his PR team
+zayn
+Canadian PM trudeau
+canada
+jules
+pray for his friend jules
+prince doing "baltimore"
+for those who lost loved ones
+selena and abel
+release music together
+lebron james tattoo
+lebron james
+chester bennington
+linkinpark
+eastern michigan university
+racist graffiti
+california
+sad
+texans
+moving out of the 1st pick
+cardinal and gold
+the USC Trojans
+rain and storms
+central & eastern u.s.
+benetton
+governor haley
+a kia
+8 straight
+rihanna fans
+rihanna fans
+john lewis
+martin luther king jr
+russian officials
+negative
+this is what the truth feels like
+dates & RSVP
+elliegoulding
+3/15
+justinbieber is here
+his set
+this nonsense
+dallas
+kim kardashian
+gq
+black panther purple
+black panther
+IGGY AZALEA
+exhausting
+call
+in heaven
+an official statement
+shocked and heartbroken
+show us your best office mug shot
+a sweet coffee prize pack
+donald trump
+a great speech
+alabama
+20
+beauty and the beast
+emma watson
+the show friends
+black cast
+malcolm young
+AC/DC
+kane
+kane showed up
+tom hanks
+june 2017
+a dear friend
+anne hathaway
+women at the march syncing periods
+beat him to it
+a rant
+violence
+jeremy
+3 today
+lester and lackey
+AL east clubs
+kentucky
+the wall star
+speeches like this
+american
+chara
+2014
+in the unlikely event
+2009
+emergency room nurse demographic
+steph curry and under Armour
+steph
+god
+stephen a.
+after shoot-around
+four
+the last
+a conservative
+the russians
+right
+black panther
+a wealthy nation
+August
+daily
+russell wilson
+mark rodgers
+TCU's punter
+shawn oakman
+team united states
+team USA lockerroom
+rihanna
+the met gala
+VP biden and mariska
+that beautiful scene
+mindy kaling
+mindy kaling
+colon cancer
+2
+all of your warm thoughts and well wishes
+getting back to work
+jSU bus
+NRJAwards2015
+a great time
+be in the rock hall
+all of our fans
+a kiss
+a 10
+money23 green
+3
+ Disney
+a little gay
+it
+#endangeredriver
+3
+2:19
+grandmother
+twenty dollars
+the duchess of cambridge
+kensington palace
+the duchess
+flight simulator training
+the mayor of san juan
+the democrats
+for his resignation
+preet Bharara
+mike green
+the redwings
+their emotions
+like you have multiple offers
+regina george
+election day
+colonel Sanders
+timesup rose
+free and open to all
+net neutrality
+grease
+on her scalp
+the area
+black
+the president's motorcade
+a Las vegas girl
+ Portia and ellen
+ ellentube
+the way they run to each other
+the way they run to each other
+hero
+a movie that DELIVERS
+running up to people's homes
+dangerous
+a free pair of limited-edition gw bush socks
+george hw bush
+her ID
+the white house
+hamburg
+hamburg
+ Gilmore Girls
+new life
+russian
+jim harbaugh
+the national anthem
+w nj
+this forecast
+black
+work
+dl champlin
+after everything I've done for you
+@realDonaldTrump
+a discussion
+the right decision
+the right coach
+starwars concert
+making our way to the show
+hockey
+gordie howe hat trick
+police
+mjolnir
+steve
+take a dreamer in2 their home and protect them
+the family of seth thomas
+seth thomas
+gig harbor
+narrows airport
+tina fey
+felicity jones
+today
+the prince of wales
+@usher, @jimmyfallon, & @hamiltonmusical cast
+NYPD hats
+officer moore
+tom hiddleston
+red
+gold
+katieledecky
+tsonga
+ahead of his first match
+greece
+turkey
+a pitch
+birmingham area
+birmingham
+@haileybaldwin
+v magazine
+half time
+ar
+the tig
+very sad
+he was a character
+skydance
+diane keaton
+nyc
+tom hiddleston
+to personalize shopping
+cher
+the hospital
+ethan
+global
+grandchildren
+christmas
+america
+ amber waves of grain
+to report incidents of bias
+because this state celebrates our differences
+ Ariana grande
+the uk
+15 penguin avenue, antarctica
+penguin
+they put these down
+3 legs
+Oprah
+terling k brown
+proud
+the indians
+22
+don graham's farewell party
+an honor
+donald trump
+he would get very mad about it
+@jjwatt
+an amazing gift
+@stephencurry30
+grow up
+quiara
+sia weaponized vowels
+a movie
+surewalk
+elizabeth
+the bachelor
+the thugs
+white
+jennifer aniston
+faith
+the mountain of despair
+she has a headache
+the oscar nom
+mets
+get a mets tattoo
+jemmye carroll
+the connection they shared
+that trophy
+this Sunday
+the light
+kim kardashian west
+chris stapleton
+chris stapleton
+writing a bill
+martin heinrich
+cattie hallway
+bathroom counter
+the oscars
+about 1am
+revenge porn
+leaked nudes
+17's
+yogi ferrell
+@thecauldron
+wayne's world
+juggalo march
+america
+the most anti-LGBTQ+ presidential ticket
+nothing to us
+lee
+he looks familiar
+zazie
+domino
+the beach
+aim
+the app
+the glory of the lord
+all flesh
+sarah jessica parker
+sarah jessica parker and george malkemus
+kanye
+dark
+kyle chandler
+comey
+zac efron
+on the cheek
+nudes
+bette midler
+kanye
+50 minutes
+ Slaughter the competition each year
+met gala
+america is trash
+20 minutes
+new isles
+fast
+champagne
+ autotune
+it only sounds like autotune
+a free pass
+someone's horrible musfortune
+kissed her
+2016
+security guy
+losing it
+brunch
+the means of production
+selena gomez
+the third rule
+shia la beouf
+singapore
+hope
+someone give her hope
+kim kardashian west
+cashing her video game check
+spotify
+she is releasing her album tonight
+benedict cumberbatch and a nice chap who plays tennis
+tennis
+alarming
+the amount of people
+david wiftlin
+new and level
+michelle rodriguez
+ matt bomer
+bmarshall
+the tone of the tweet
+a podium
+melissa mccarthy/sean spicer
+lowkey
+boogieman
+alexander pettyton
+opening a convo
+beautiful
+alabama
+black women
+the day we become silent about things that matter
+mlk
+red cross
+the people
+restaurant menu print business
+the world
+the airwaves
+write a book or start a podcast
+young pope
+the time of day

pytorch_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b48c3a0f2b9314706f2f50dcc4ec8d9af11ada09b362c4c700990a653b8e24d4
-size 1625534721
+oid sha256:5501f0155767549e378f9c27f8feafd5f9d42535b140e0c5d79966786d82e491
+size 1625541889

tokenizer_config.json

@@ -6,7 +6,7 @@
   "errors": "replace",
   "mask_token": "<mask>",
   "model_max_length": 1024,
-  "name_or_path": "lmqg_output/bart-large-tweetqa-qa/best_model",
+  "name_or_path": "lmqg_output/bart-large-tweetqa-qa/model_cmzqsx/epoch_2",
   "pad_token": "<pad>",
   "sep_token": "</s>",
   "special_tokens_map_file": null,

trainer_config.json

@@ -0,0 +1 @@
+{"dataset_path": "lmqg/qg_tweetqa", "dataset_name": "default", "input_types": ["paragraph_question"], "output_types": ["answer"], "prefix_types": null, "model": "facebook/bart-large", "max_length": 512, "max_length_output": 32, "epoch": 6, "batch": 32, "lr": 1e-05, "fp16": false, "random_seed": 1, "gradient_accumulation_steps": 2, "label_smoothing": 0.15}