metadata
tags:
- generated_from_trainer
model-index:
- name: pegasus-sports-titles
widget:
- text: >-
Coutinho was just about to be introduced by Villa boss Gerrard midway
through the second half when Bruno Fernandes slammed home his second goal
of the game off the underside of the bar. But the Brazilian proved the
catalyst for a memorable response. First he drove at the United defence,
helping to create the space which Jacob Ramsey exploited to halve the
deficit. Then Ramsey slid over an excellent cross from the left which
Raphael Varane was unable to intercept as he slid back, leaving Coutinho
to finish into an empty net. The goal brought celebrations at both ends of
the pitch as Emiliano Martinez also went into the crowd in relief - it was
the Argentine's horrible sixth-minute error that had gifted Fernandes the
visitors' opener. Given his background - with Liverpool, Barcelona and
Bayern Munich - Coutinho is a bold loan signing by Villa, and underlines
the pedigree of the man they appointed as manager in November. Gerrard is
not at Villa to learn how to avoid relegation. His demands remain as high
as they were as a player and Coutinho's arrival is an example of that.
Villa are a better team since Gerrard's arrival and, after a sluggish
start against opponents they dominated but lost to in the FA Cup five days
ago, they grew into the game. The club's other newboy, Lucas Digne, was
among those denied by United keeper David de Gea at the end of the first
half - in unorthodox fashion, with his knees. Ollie Watkins did not really
test the Spain keeper when Villa broke after Edinson Cavani lost
possession in his own half. However, Emi Buendia certainly did with a
near-post header. Rooted to his line, De Gea's reactions were up to the
job as he beat Buendia's effort away. When De Gea produced more saves
after half-time to deny Ramsey and Digne again, it appeared the image of
the night for Villa would be midfielder Morgan Sanson kicking a drinks
bottle in fury after his error in gifting Fred possession to set up
Fernandes for the visitors' second had been followed immediately by his
substitution. However, as it was the prelude to Coutinho's arrival, it was
the moment that changed the course of the game - and the acclaim for the
Brazilian at the final whistle indicated Villa's fans are already firmly
behind him.
language: en
pegasus-sports-titles
This model is a fine-tuned pegasus on some sports news articles scraped from the internet. (For educational purposes only). The model can generate titles for sports articles. Try it out using the inference API.
Model description
A Pegasus model tuned on generating scientific titles has been further fine-tuned to generate titles for sports articles. While training articles on Tennis, Football (Soccer), Cricket , Athletics and Rugby were used to generate titles. I experimented training the Tokenizer from scratch but it did not give good results compared to the pre-trained tokenizer.
Usage
from transformers import pipeline
#Feel free to play around with the generation parameters.
#Reduce the beam width for faster inference
#Note that the maximum length for the generated titles is 64
gen_kwargs = {"length_penalty": 0.6, "num_beams":4, "num_return_sequences": 4,"num_beam_groups":4,"diversity_penalty":2.0}
pipe = pipeline("summarization", model="RajSang/pegasus-sports-titles")
#Change the article according to your wish
article="""
Coutinho was just about to be introduced by Villa boss Gerrard midway through the second half when Bruno Fernandes slammed home
his second goal of the game off the underside of the bar. But the Brazilian proved the catalyst for a memorable response.
First he drove at the United defence, helping to create the space which Jacob Ramsey exploited to halve the deficit. Then Ramsey slid over an excellent
cross from the left which Raphael Varane was unable to intercept as he slid back, leaving Coutinho to finish into an empty net.
The goal brought celebrations at both ends of the pitch as Emiliano Martinez also went into the crowd in relief - it was the Argentine's horrible sixth-minute error that had gifted Fernandes the visitors' opener.
Given his background - with Liverpool, Barcelona and Bayern Munich - Coutinho is a bold loan signing by Villa, and underlines the pedigree of the man they appointed as manager in November.
Gerrard is not at Villa to learn how to avoid relegation.
His demands remain as high as they were as a player and Coutinho's arrival is an example of that.
Villa are a better team since Gerrard's arrival and, after a sluggish start against opponents they dominated but lost to in the FA Cup five days ago, they grew into the game.
The club's other newboy, Lucas Digne, was among those denied by United keeper David de Gea at the end of the first half - in unorthodox fashion, with his knees.
Ollie Watkins did not really test the Spain keeper when Villa broke after Edinson Cavani lost possession in his own half. However, Emi Buendia certainly did with a near-post header. Rooted to his line, De Gea's reactions were up to the job as he beat Buendia's effort away.
When De Gea produced more saves after half-time to deny Ramsey and Digne again, it appeared the image of the night for Villa would be midfielder Morgan Sanson kicking a drinks bottle in fury after his error in gifting Fred possession to set up Fernandes for the visitors' second had been followed immediately by his substitution.
However, as it was the prelude to Coutinho's arrival, it was the moment that changed the course of the game - and the acclaim for the Brazilian at the final whistle indicated Villa's fans are already firmly behind him.
"""
result=pipe(article, **gen_kwargs)[0]["summary_text"]
print(result)
''' Output
Title 1 :
Coutinho's arrival sparks Villa comeback
Title 2 :
Philippe Coutinho marked his debut for Aston Villa with a goal and an assist as Steven Gerrard's side came from two goals down to draw with Manchester United.
Title 3 :
Steven Gerrard's first game in charge of Aston Villa ended in a dramatic draw against Manchester United - but it was the arrival of Philippe Coutinho that marked the night.
Title 4 :
Liverpool loanee Philippe Coutinho marked his first appearance for Aston Villa with two goals as Steven Gerrard's side came from two goals down to draw 2-2.'''
Training procedure
While training, short titles were combined with the subtitles for the articles to improve the quality of the generated titles and the subtitles were removed from the main body of the articles.
##Limitations
In rare cases, if the opening few lines of a passage/article are descriptive enough, the model often just copies these lines instead of looking for information further down the articles, which may not be conducive in some cases.
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 2
- eval_batch_size: 8
- seed: 42
- gradient_accumulation_steps: 8
- total_train_batch_size: 16
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_steps: 100
- num_epochs: 2
Training results
Rouge1:0.382315
Rouge2: 0.186598
RougueL: 0.317393
RougeLsum: 0.317086
Framework versions
- Transformers 4.15.0
- Pytorch 1.10.0+cu111
- Datasets 1.17.0
- Tokenizers 0.10.3