Add SetFit model

README.md

@@ -10,33 +10,38 @@ tags:
 - text-classification
 - generated_from_setfit_trainer
 widget:
-- text: The US Securities and Exchange Commission (SEC) has announced a new set of
-    guidelines for cryptocurrency exchanges, aiming to improve transparency and investor
-    protection. The move is seen as a positive step towards regulating the industry,
-    but experts warn that it may also lead to increased compliance costs for smaller
-    players. Overall, the impact on the market is expected to be neutral, with some
-    analysts predicting a slight increase in trading volumes as investors adjust to
-    the new rules.
-- text: 'Market volatility is expected to continue in the coming weeks, but overall,
-    the trend remains stable. Investors are advised to remain cautious but not make
-    any drastic decisions. #marketanalysis #trading'
-- text: The US Federal Reserve's decision to keep interest rates unchanged is a major
-    boost for the stock market, signaling a strong economy and increased investor
-    confidence. This move is expected to fuel further growth in the tech sector, with
-    many analysts predicting a significant increase in stock prices over the next
-    quarter. The Fed's dovish stance on inflation is also seen as a positive sign
-    for the market, as it suggests that the central bank is willing to take a more
-    accommodative approach to monetary policy. Overall, this news is expected to have
-    a bullish impact on the market, with many experts predicting a significant rally
-    in the coming days.
-- text: Just heard that the Federal Reserve is going to raise interest rates by 50
-    basis points at their meeting next week. This is a huge blow to the stock market
-    and I'm expecting a major sell-off. I'm getting out of my long positions and going
-    short on the Dow. Anyone else seeing this as a bearish signal?
-- text: US inflation rate hits 3.2% in June, highest in 3 years. Experts warn of potential
-    recession as consumers face rising costs. The Federal Reserve is expected to raise
-    interest rates to combat inflation, but some economists say it may be too little,
-    too late. The S&P 500 fell 2.5% on the news, with tech stocks leading the decline.
+- text: I walked into this movie expecting a thrilling adventure, but what I got was
+    a jumbled mess of characters that made no sense. The main character's personality
+    changed from one scene to the next, it was like they had a different actor playing
+    them. The plot was predictable and the dialogue was cheesy. I left the theater
+    feeling disappointed and frustrated with the wasted potential. The only thing
+    that kept me engaged was the cinematography, but it wasn't enough to save this
+    trainwreck. Overall, I would not recommend this movie to anyone.
+- text: I recently visited this quaint little cafe and it was love at first sight.
+    The moment I stepped inside, I felt like I was wrapped in a warm hug. The decor
+    is so cozy and inviting, with plush armchairs and soft lighting that makes you
+    feel like you're in a different world. The staff is friendly and attentive, and
+    the coffee is top-notch. I had the most delicious cappuccino and a slice of lemon
+    pound cake that was to die for. I'll definitely be back for more of this cozy
+    ambiance.
+- text: I just watched the latest Marvel movie and I have to say, it was absolutely
+    phenomenal. The cinematography was breathtaking, the music was catchy and perfectly
+    complemented the on-screen action. The cast delivered outstanding performances,
+    and the storyline was engaging and well-paced. I thoroughly enjoyed every minute
+    of it and would highly recommend it to anyone who loves superhero movies. 10/10
+    would watch again.
+- text: The movie had so much potential, but the ending was a complete letdown. It
+    felt rushed and didn't provide any closure for the characters. I was expecting
+    a more satisfying conclusion, but what we got was a lazy attempt to tie everything
+    together. The final act was a mess, and it left me feeling frustrated and disappointed.
+    Overall, the movie was enjoyable, but the ending ruined it for me. I would have
+    given it a higher rating if the writers had put more effort into crafting a better
+    ending.
+- text: The acting in this movie was laughable. The lead actor's delivery was wooden
+    and unconvincing. He had all the charisma of a cardboard box. The supporting cast
+    fared no better, with most of them struggling to deliver even the simplest of
+    lines. The director's attempt to create tension was wasted on the subpar acting,
+    making the entire experience feel like a chore to sit through.
 inference: true
 model-index:
 - name: SetFit with sentence-transformers/paraphrase-mpnet-base-v2
@@ -50,7 +55,7 @@ model-index:
       split: test
     metrics:
     - type: accuracy
-      value: 0.6226968174204355
+      value: 0.88784
       name: Accuracy
 ---
 
@@ -70,7 +75,7 @@ The model has been trained using an efficient few-shot learning technique that i
 - **Sentence Transformer body:** [sentence-transformers/paraphrase-mpnet-base-v2](https://huggingface.co/sentence-transformers/paraphrase-mpnet-base-v2)
 - **Classification head:** a [LogisticRegression](https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html) instance
 - **Maximum Sequence Length:** 512 tokens
-- **Number of Classes:** 3 classes
+- **Number of Classes:** 2 classes
 <!-- - **Training Dataset:** [Unknown](https://huggingface.co/datasets/unknown) -->
 <!-- - **Language:** Unknown -->
 <!-- - **License:** Unknown -->
@@ -82,18 +87,17 @@ The model has been trained using an efficient few-shot learning technique that i
 - **Blogpost:** [SetFit: Efficient Few-Shot Learning Without Prompts](https://huggingface.co/blog/setfit)
 
 ### Model Labels
-| Label | Examples                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      |
-|:------|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
-| 1     | <ul><li>"The Federal Reserve's decision to keep interest rates steady is a major boost for the stock market, with the Dow Jones surging 200 points in response. The Fed's dovish stance on monetary policy is expected to continue, providing a tailwind for equities in the coming months."</li><li>"Shares of tech giant Apple Inc (AAPL) surged 5.3% in pre-market trading after the company reported a 27% jump in quarterly profits, exceeding analyst expectations. The strong earnings report has investors optimistic about the company's future prospects, with many expecting the stock to reach new highs in the coming months."</li><li>"Just saw the latest jobs report and I'm feeling super bullish on the market. The low unemployment rate is a clear sign that the economy is on the right track. With more people working, consumer spending is likely to increase, which should boost stocks. I'm buying into the rally and holding on tight. #lowunemployment #bullmarket"</li></ul>                                                                                                                                                                                                                                                                                                                                                                     |
-| 2     | <ul><li>'The US stock market experienced a slight dip in trading hours today, with the Dow Jones Industrial Average falling 0.2% to 32,400. Analysts point to a mix of factors, including a decline in consumer spending and a rise in interest rates. However, experts note that the decline is relatively minor and within expected ranges, suggesting a stable market environment.'</li><li>"I'm not sure what to make of the latest earnings report from Apple. On one hand, revenue was up 10% from last quarter, but net income was only $4.17 per share, which is a decline from $4.65 per share in the same quarter last year. The guidance for the next quarter also seems a bit conservative. Anyone else have thoughts on this?"</li><li>"I'm not seeing any major red flags in the latest earnings report from Apple. The company's revenue growth is still on track, and the guidance for the next quarter looks solid. Of course, the tech sector is always volatile, but I think Apple's fundamentals are strong enough to weather any storm. Overall, I'm feeling neutral on this stock for now."</li></ul>                                                                                                                                                                                                                                                   |
-| 0     | <ul><li>"Stocks plummeted after Intel Corp. (INTC) reported a disappointing earnings per share (EPS) of $0.85, missing the estimated $1.19, as the company cited weaker-than-expected demand for its chips. The news sent shockwaves through the tech sector, with Intel's shares tumbling 12% in after-hours trading."</li><li>"I'm getting increasingly concerned about the state of the economy. The latest GDP numbers are a clear indication that we're heading into a recession. The housing market is already showing signs of weakness and I'm starting to think that the Fed's interest rate hikes are going to have a much bigger impact than they're letting on. I'm bearish on the market and think we're in for a rough ride ahead."</li><li>'US inflation expectations surge to 3.4% as Fed officials warn of potential rate hikes. The Federal Reserve is expected to increase interest rates to combat rising prices, but economists warn that this could lead to a recession. The Bureau of Labor Statistics reported a 0.4% increase in consumer prices in January, with food and housing costs driving the gains. The inflation rate has been steadily rising over the past year, with the 12-month rate now at 2.5%. As a result, investors are bracing for a potential bear market, with the S&P 500 index already showing signs of weakness.'</li></ul> |
+| Label              | Examples                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          |
+|:-------------------|:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
+| negative sentiment | <ul><li>'I was really looking forward to this movie, but unfortunately, it was a complete disappointment. The plot was predictable and lacked any real tension. The characters were underdeveloped and their motivations were unclear. The pacing was slow and dragged on for far too long. Overall, I would not recommend this movie to anyone.'</li><li>"I'm extremely disappointed with the service I received at this restaurant. The hostess was unfriendly and unhelpful, and our server seemed completely overwhelmed. We had to ask multiple times for basic things like water and utensils. The food was overpriced and not even that good. Definitely will not be returning."</li><li>"I'm extremely disappointed with my recent purchase from this store. The quality of the product is subpar and the price is way too high. I paid $200 for a cheap-looking item that broke after just a week of use. Not worth the money at all. 1/10 would not recommend."</li></ul>               |
+| positive sentiment | <ul><li>"I just got tickets to see my favorite artist in concert and I'm beyond thrilled! The energy in the crowd is going to be electric! #concertseason #musiclover"</li><li>"I just had the most amazing experience at this restaurant! The service was lightning fast, and the food was prepared to perfection. Our server, Alex, was attentive and friendly, making sure we had everything we needed. The bill was reasonable, and we left feeling satisfied and eager to come back. 5 stars isn't enough, I'd give it 10 if I could!"</li><li>'The action scenes in this movie are absolutely mind-blowing! The stunts are incredibly well-choreographed and the special effects are top-notch. I was on the edge of my seat the entire time, cheering on the heroes as they fought to save the world. The cast is also excellent, with standout performances from the lead actors. Overall, I would highly recommend this movie to anyone who loves action-packed thrill rides.'</li></ul> |
 
 ## Evaluation
 
 ### Metrics
 | Label   | Accuracy |
 |:--------|:---------|
-| **all** | 0.6227   |
+| **all** | 0.8878   |
 
 ## Uses
 
@@ -113,7 +117,7 @@ from setfit import SetFitModel
 # Download from the 🤗 Hub
 model = SetFitModel.from_pretrained("setfit_model_id")
 # Run inference
-preds = model("Market volatility is expected to continue in the coming weeks, but overall, the trend remains stable. Investors are advised to remain cautious but not make any drastic decisions. #marketanalysis #trading")
+preds = model("The acting in this movie was laughable. The lead actor's delivery was wooden and unconvincing. He had all the charisma of a cardboard box. The supporting cast fared no better, with most of them struggling to deliver even the simplest of lines. The director's attempt to create tension was wasted on the subpar acting, making the entire experience feel like a chore to sit through.")
 ```
 
 <!--
@@ -145,13 +149,12 @@ preds = model("Market volatility is expected to continue in the coming weeks, bu
 ### Training Set Metrics
 | Training set | Min | Median  | Max |
 |:-------------|:----|:--------|:----|
-| Word count   | 27  | 55.4340 | 98  |
+| Word count   | 23  | 56.8571 | 79  |
 
-| Label | Training Sample Count |
-|:------|:----------------------|
-| 0     | 15                    |
-| 1     | 20                    |
-| 2     | 18                    |
+| Label              | Training Sample Count |
+|:-------------------|:----------------------|
+| negative sentiment | 14                    |
+| positive sentiment | 14                    |
 
 ### Training Hyperparameters
 - batch_size: (16, 16)
@@ -173,23 +176,14 @@ preds = model("Market volatility is expected to continue in the coming weeks, bu
 ### Training Results
 | Epoch   | Step    | Training Loss | Validation Loss |
 |:-------:|:-------:|:-------------:|:---------------:|
-| 0.0085  | 1       | 0.2096        | -               |
-| 0.4274  | 50      | 0.0335        | -               |
-| 0.8547  | 100     | 0.0007        | -               |
-| 1.0     | 117     | -             | 0.0071          |
-| 1.2821  | 150     | 0.0002        | -               |
-| 1.7094  | 200     | 0.0002        | -               |
-| 2.0     | 234     | -             | 0.005           |
-| 2.1368  | 250     | 0.0001        | -               |
-| 2.5641  | 300     | 0.0002        | -               |
-| 2.9915  | 350     | 0.0002        | -               |
-| 3.0     | 351     | -             | 0.0045          |
-| 3.4188  | 400     | 0.0001        | -               |
-| 3.8462  | 450     | 0.0001        | -               |
-| 4.0     | 468     | -             | 0.0038          |
-| 4.2735  | 500     | 0.0001        | -               |
-| 4.7009  | 550     | 0.0001        | -               |
-| **5.0** | **585** | **-**         | **0.0037**      |
+| 0.0370  | 1       | 0.2498        | -               |
+| 1.0     | 27      | -             | 0.0017          |
+| 1.8519  | 50      | 0.0003        | -               |
+| 2.0     | 54      | -             | 0.0004          |
+| 3.0     | 81      | -             | 0.0003          |
+| 3.7037  | 100     | 0.0002        | -               |
+| 4.0     | 108     | -             | 0.0004          |
+| **5.0** | **135** | **-**         | **0.0003**      |
 
 * The bold row denotes the saved checkpoint.
 ### Framework Versions

config.json

@@ -1,5 +1,5 @@
 {
-  "_name_or_path": "setfit/step_585",
+  "_name_or_path": "setfit/step_135",
   "architectures": [
     "MPNetModel"
   ],

config_setfit.json

@@ -1,8 +1,7 @@
 {
-  "normalize_embeddings": false,
   "labels": [
-    "0",
-    "1",
-    "2"
-  ]
+    "negative sentiment",
+    "positive sentiment"
+  ],
+  "normalize_embeddings": false
 }

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:7f0d905d2d7ef3da0b0858e85c48389565aaba79218c6afb2b6464052fa58d1e
+oid sha256:576c6f26fd3c8740346d1f93b2554525a58f9ffcacf607db5f230fd9af5ee25e
 size 437967672

model_head.pkl

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:3ae0bc7355dd2ba27882ddebd7cf1982e447d9c5f9e0d150f18eeb98a9e13f7f
-size 19295
+oid sha256:f6027d5e4448e72924441a8c7b794d205defe906dee648bb48cdf0f9cb10c36d
+size 7007