SetFit with sentence-transformers/paraphrase-mpnet-base-v2 on data/raw/15239678.jsonl

This is a SetFit model that can be used for Text Classification. This SetFit model uses sentence-transformers/paraphrase-mpnet-base-v2 as the Sentence Transformer embedding model. A LogisticRegression instance is used for classification.

The model has been trained using an efficient few-shot learning technique that involves:

Fine-tuning a Sentence Transformer with contrastive learning.
Training a classification head with features from the fine-tuned Sentence Transformer.

Model Details

Model Description

Model Type: SetFit
Sentence Transformer body: sentence-transformers/paraphrase-mpnet-base-v2
Classification head: a LogisticRegression instance
Maximum Sequence Length: 512 tokens
Number of Classes: 2 classes
Language: en
License: apache-2.0

Model Sources

Repository: SetFit on GitHub
Paper: Efficient Few-Shot Learning Without Prompts
Blogpost: SetFit: Efficient Few-Shot Learning Without Prompts

Model Labels

Label	Examples
negative	"it's like watching a cult and not really a good movie. sorry not for me. all the characters gave justice on their roles, well executed. the pace of the story is so slow that it made me so sleepy in the middle of the film. actually the film made me bored coz i expected more but a lousy story. i would like to mention rebecca ferguson, she's a great actress and really fit to be the lady jessica itself. in the middle of the film, me and three of my friends wanted to go home coz it feels like we're watching a cult movie. not a good one for children's to watch. in this movie, nothing much to expect, such a waste of time and it was a very boring film fighting for a spice. 19 out of 100 found this helpful. was this review helpful? sign in to vote. permalink" 'the avengers-era "cinema" for a call of duty generation i watched dune: part two on imax (as seems befitting that sort of big-budget picture), in pretty good seats considering the house was packed with a diverse crowd of young adults for the late-night showing.my review of the first of denis villeneuve's adaptations was that it was pretty to look at, but basically uninteresting in its plot, a major let-down considering how hyped the books have been, when on the screen they're no better than star wars. this second one exhibits those same features, but worse.this is basically an action movie--a genre which i'm fundamentally uninterested in--which seems at odds with all the talk of dune being characterized by complex political & economic maneuvering--of which this film does include some, albeit parenthetically. the scenes are impressionistic in their pacing and content, and expressionistic in that the photography & score are more about attempting to convey emotionality, or at least get the adrenaline pumping, than any sort of profound characterizations or themes. this is lawrence of arabia in space but with the cold war as the contemporary allegory. that sort of story would still have been resonant during the post-9/11 era, but we've moved on from those wars by now into an altogether different geopolitics and political economy.the monumentalism of the shots can be impressive, and certainly the design of the mechanical vehicles is (in addition to the still-eye candy costumes), but there are too many moments where it's like watching a video game cut-scene, or even a video game playing out (c.f. the entire opening sequence). cinema is going backwards when that's the case. and there are some egregious dissonances in the sound design, most of all in the various accents the actors were allowed to use, which takes us out of the suspension of disbelief, but also in the over-application of non-diegetic score, which treats the audience as dumb emotions-receptacles, during scenes that by-and-large do not earn such responses.(the only outstanding sequence of the film is when paul attempts his first worm-ride, which is almost as exhilirating as the roller coaster ride it attempts to be for us on screen.)there are also weird dissonances in this film attempting to be humorous, as the on-again off-again nature of those lines (and how they're delivered) feel like a wink to the audience that this allegory of abrahamic religions co-opting a people's revolution--albeit against a totalitarian capitalist empire, mixing all kinds of economic stages of history, much as the genres of swords & planets and sci-fi and fantasy are mixed--is not to be taken too seriously in our secular times. but then, what are we to take from this "epic"?' "try as hard as you like i left feeling bored, and that's a bad sign for an epic sci-fi. i watched dune i and loved it, the deep sonorous sounds of an alien nation were exciting, and the dialogue kept minimal and thick. dune ii blasts you with ott noise, over the top effects, and piss poor dialogue... 'for the duke, and my friends' i felt this movie was aimed at a pre-teen audience with spiderman fetish and a heavy hand of americanism... the emperor was not an emperor. recommend putting a human written storyline first and leave ai/cgi to a bare minimum. i watched dune 20 years ago and loved it. i read dune 30 years ago and loved it. the actors tried hard with what they got but it wasn't enough to make it a masterpiece, it's more like an aprenticepiece."
positive	"best movie in recent years. the movie is a more impressive, more exciting and deeper production than the first part. give it 9 out of 10.the acting, visual effects, music and atmosphere in the movie are amazing. paul's evolution is perfectly demonstrated by timothee chalamet.the visual effects deliver a breathtaking rendering of arrakis' desert landscapes, giant worms, and battle scenes. you can smell the scent of a spice behind curtain.music adds soul to the film with the mastery of hans zimmer. the atmosphere is to keep tension and emotion at a high level throughout the film.while the film's script remains faithful to the book, it also offers some differences. while some changes make the film better, others do not fit the spirit of the book. however, i can honestly say that the changes made do not harm the film at all.dune: part two is one of the masterpieces of science fiction cinema. it's the best movie i've seen in nearly 15 years. maybe oppenheimer.nah, this movie is better." "best movie ever what a movie!!!!!!!!!!the whole movie is so good! the setting is amazing. the story is so good. and the plot and the premise is amazing my favorite characters are paul and chani. this whole movie is seeking revenge from the darkness and the evil that was causing the world to collapse. and following that they decide just like on star wars to choose what side they're on the light side or the dark side. and man the cliffhanger of the movie was the most shocking thing ever. the whole movie is a very well done movie. i love this movie so much it gave me chills. this movie will get the best picture next year for the oscars. 0 out of 0 found this helpful. was this review helpful? sign in to vote. permalink" "very spicey! undoubtedly one of the greatest cinematic experiences i've ever had. most movies nowadays try to wow you with either visuals, action, character development, and seemingly less and less so everyday with a reasonable plot. this movie manages to check off every box. it is hard to pinpoint an actor in it that wasn't superb in their role. the visual effects, especially in imax , are stunning and are not simply artistic in nature, but actually work to advance the plot.the film is pieced together so brilliantly with each act seamlessly fitting in with the last. the score by zimmer is unsurprisingly absolute perfection as well.for the length of the movie it actually feels quite short which is a huge achievement and shows how immersed you become in villneuve's world.however, i would have liked to see more of feyd rautha. they had an epic scene of his in the harkonnen arena, but not too much else to develop him for his final battle against paul. i also would have liked to see the sardaukar put up a little better of a fight. they somehow went from the empires greatest fighters to pretty pathetic. perhaps this was to show how strong paul and his forces had become, but it just seemed a bit too easy. still these are just personal aspects i would have liked to see and are not issues in the movie itself.overall, an epic movie, and the trilogy is likely to be sitting right alongside the lord of the rings and the original star wars movies when all is said and done.this is a can't miss in imax."

Label

Examples

negative

"it's like watching a cult and not really a good movie. sorry not for me. all the characters gave justice on their roles, well executed. the pace of the story is so slow that it made me so sleepy in the middle of the film. actually the film made me bored coz i expected more but a lousy story. i would like to mention rebecca ferguson, she's a great actress and really fit to be the lady jessica itself. in the middle of the film, me and three of my friends wanted to go home coz it feels like we're watching a cult movie. not a good one for children's to watch. in this movie, nothing much to expect, such a waste of time and it was a very boring film fighting for a spice. 19 out of 100 found this helpful. was this review helpful? sign in to vote. permalink"
'the avengers-era "cinema" for a call of duty generation i watched dune: part two on imax (as seems befitting that sort of big-budget picture), in pretty good seats considering the house was packed with a diverse crowd of young adults for the late-night showing.my review of the first of denis villeneuve's adaptations was that it was pretty to look at, but basically uninteresting in its plot, a major let-down considering how hyped the books have been, when on the screen they're no better than star wars. this second one exhibits those same features, but worse.this is basically an action movie--a genre which i'm fundamentally uninterested in--which seems at odds with all the talk of dune being characterized by complex political & economic maneuvering--of which this film does include some, albeit parenthetically. the scenes are impressionistic in their pacing and content, and expressionistic in that the photography & score are more about attempting to convey emotionality, or at least get the adrenaline pumping, than any sort of profound characterizations or themes. this is lawrence of arabia in space but with the cold war as the contemporary allegory. that sort of story would still have been resonant during the post-9/11 era, but we've moved on from those wars by now into an altogether different geopolitics and political economy.the monumentalism of the shots can be impressive, and certainly the design of the mechanical vehicles is (in addition to the still-eye candy costumes), but there are too many moments where it's like watching a video game cut-scene, or even a video game playing out (c.f. the entire opening sequence). cinema is going backwards when that's the case. and there are some egregious dissonances in the sound design, most of all in the various accents the actors were allowed to use, which takes us out of the suspension of disbelief, but also in the over-application of non-diegetic score, which treats the audience as dumb emotions-receptacles, during scenes that by-and-large do not earn such responses.(the only outstanding sequence of the film is when paul attempts his first worm-ride, which is almost as exhilirating as the roller coaster ride it attempts to be for us on screen.)there are also weird dissonances in this film attempting to be humorous, as the on-again off-again nature of those lines (and how they're delivered) feel like a wink to the audience that this allegory of abrahamic religions co-opting a people's revolution--albeit against a totalitarian capitalist empire, mixing all kinds of economic stages of history, much as the genres of swords & planets and sci-fi and fantasy are mixed--is not to be taken too seriously in our secular times. but then, what are we to take from this "epic"?'
"try as hard as you like i left feeling bored, and that's a bad sign for an epic sci-fi. i watched dune i and loved it, the deep sonorous sounds of an alien nation were exciting, and the dialogue kept minimal and thick. dune ii blasts you with ott noise, over the top effects, and piss poor dialogue... 'for the duke, and my friends' i felt this movie was aimed at a pre-teen audience with spiderman fetish and a heavy hand of americanism... the emperor was not an emperor. recommend putting a human written storyline first and leave ai/cgi to a bare minimum. i watched dune 20 years ago and loved it. i read dune 30 years ago and loved it. the actors tried hard with what they got but it wasn't enough to make it a masterpiece, it's more like an aprenticepiece."

positive

"best movie in recent years. the movie is a more impressive, more exciting and deeper production than the first part. give it 9 out of 10.the acting, visual effects, music and atmosphere in the movie are amazing. paul's evolution is perfectly demonstrated by timothee chalamet.the visual effects deliver a breathtaking rendering of arrakis' desert landscapes, giant worms, and battle scenes. you can smell the scent of a spice behind curtain.music adds soul to the film with the mastery of hans zimmer. the atmosphere is to keep tension and emotion at a high level throughout the film.while the film's script remains faithful to the book, it also offers some differences. while some changes make the film better, others do not fit the spirit of the book. however, i can honestly say that the changes made do not harm the film at all.dune: part two is one of the masterpieces of science fiction cinema. it's the best movie i've seen in nearly 15 years. maybe oppenheimer.nah, this movie is better."
"best movie ever what a movie!!!!!!!!!!the whole movie is so good! the setting is amazing. the story is so good. and the plot and the premise is amazing my favorite characters are paul and chani. this whole movie is seeking revenge from the darkness and the evil that was causing the world to collapse. and following that they decide just like on star wars to choose what side they're on the light side or the dark side. and man the cliffhanger of the movie was the most shocking thing ever. the whole movie is a very well done movie. i love this movie so much it gave me chills. this movie will get the best picture next year for the oscars. 0 out of 0 found this helpful. was this review helpful? sign in to vote. permalink"
"very spicey! undoubtedly one of the greatest cinematic experiences i've ever had. most movies nowadays try to wow you with either visuals, action, character development, and seemingly less and less so everyday with a reasonable plot. this movie manages to check off every box. it is hard to pinpoint an actor in it that wasn't superb in their role. the visual effects, especially in imax , are stunning and are not simply artistic in nature, but actually work to advance the plot.the film is pieced together so brilliantly with each act seamlessly fitting in with the last. the score by zimmer is unsurprisingly absolute perfection as well.for the length of the movie it actually feels quite short which is a huge achievement and shows how immersed you become in villneuve's world.however, i would have liked to see more of feyd rautha. they had an epic scene of his in the harkonnen arena, but not too much else to develop him for his final battle against paul. i also would have liked to see the sardaukar put up a little better of a fight. they somehow went from the empires greatest fighters to pretty pathetic. perhaps this was to show how strong paul and his forces had become, but it just seemed a bit too easy. still these are just personal aspects i would have liked to see and are not issues in the movie itself.overall, an epic movie, and the trilogy is likely to be sitting right alongside the lord of the rings and the original star wars movies when all is said and done.this is a can't miss in imax."

Evaluation

Metrics

Label	Accuracy	Precision	Recall	F1
all	0.8247	0.9916	0.8188	0.8969

Uses

Direct Use for Inference

First install the SetFit library:

pip install setfit

Then you can load this model and run inference.

from setfit import SetFitModel

# Download from the 🤗 Hub
model = SetFitModel.from_pretrained("carlesoctav/SentimentClassifierDune-8shot")
# Run inference
preds = model("great movie with holes in the plot dune 2 is a great movie that can be enjoyed despite some holes in the plot and questionable story elements. the movie is great visually and serves as an example of how cgi doesn't have to make a movie seem sterile and fake, or like watching a video game like the new brand of marvel movies and aquaman do.the cast is great - christopher walken should have had more scenes and other than it being him, his performance was not unique in any way - and there is a non credited appearance that i'm not going to spoil that is a wow!the movie is long, but there's a difference between long and too long, and any movie that wants to be an epic. 2 out of 5 found this helpful. was this review helpful? sign in to vote. permalink")

Training Details

Training Set Metrics

Training set	Min	Median	Max
Word count	121	271.5	993

Label	Training Sample Count
negative	8
positive	8

Training Hyperparameters

batch_size: (16, 16)
num_epochs: (1, 1)
max_steps: -1
sampling_strategy: oversampling
body_learning_rate: (2e-05, 1e-05)
head_learning_rate: 0.01
loss: CosineSimilarityLoss
distance_metric: cosine_distance
margin: 0.25
end_to_end: False
use_amp: False
warmup_proportion: 0.1
seed: 42
eval_max_steps: -1
load_best_model_at_end: True

Training Results

Epoch	Step	Training Loss	Validation Loss
0.1111	1	0.2058	-
1.0	9	-	0.2368

The bold row denotes the saved checkpoint.

Framework Versions

Python: 3.10.11
SetFit: 1.0.3
Sentence Transformers: 2.5.1
Transformers: 4.38.2
PyTorch: 2.0.1
Datasets: 2.18.0
Tokenizers: 0.15.2

Citation

BibTeX

@article{https://doi.org/10.48550/arxiv.2209.11055,
    doi = {10.48550/ARXIV.2209.11055},
    url = {https://arxiv.org/abs/2209.11055},
    author = {Tunstall, Lewis and Reimers, Nils and Jo, Unso Eun Seo and Bates, Luke and Korat, Daniel and Wasserblat, Moshe and Pereg, Oren},
    keywords = {Computation and Language (cs.CL), FOS: Computer and information sciences, FOS: Computer and information sciences},
    title = {Efficient Few-Shot Learning Without Prompts},
    publisher = {arXiv},
    year = {2022},
    copyright = {Creative Commons Attribution 4.0 International}
}

carlesoctav
/

SentimentClassifierDune-8shot