Hugging Face's logo

sultanaw
/
customer_reviews_setfit

Text Classification
setfit
Safetensors
sentence-transformers
mpnet
generated_from_setfit_trainer
Eval Results
Model card Files Community
sultanaw commited on
Commit
5fd2207
•
1 Parent(s): 336fbf6

Upload 12 files

Browse files
Files changed (12) hide show
  1. README.md +287 -3
  2. config.json +24 -0
  3. config_sentence_transformers.json +7 -0
  4. config_setfit.json +4 -0
  5. model.safetensors +3 -0
  6. model_head.pkl +3 -0
  7. modules.json +14 -0
  8. sentence_bert_config.json +4 -0
  9. special_tokens_map.json +51 -0
  10. tokenizer.json +0 -0
  11. tokenizer_config.json +59 -0
  12. vocab.txt +0 -0
README.md CHANGED
@@ -1,3 +1,287 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: setfit
3
+ tags:
4
+ - setfit
5
+ - sentence-transformers
6
+ - text-classification
7
+ - generated_from_setfit_trainer
8
+ metrics:
9
+ - accuracy
10
+ widget:
11
+ - text: 5 days before the flight, we were advised by BA that it had been cancelled
12
+ and asked us to rebook. There were flights 1 hour before and 1 hour after our
13
+ original flight but they made us take one 3 hours earlier. Our original ticket
14
+ (and the return flight a week later) included a checked bag. When we arrive at
15
+ Heathrow to check in we are told our ticket doesn't included a bag and we will
16
+ have to pay 75 pounds each to take them. We explained that the original ticket
17
+ had the bags and when they checked the system they confirmed that it did- but
18
+ not this one! They would make no effort to sort it out and just told us to pay
19
+ up or they would remove us from the flight. So we had no choice but to pay up,
20
+ thinking it should be pretty easy to get a refund. 15 months and 10 emails later
21
+ we have still not seen a penny. Every time I ask where my refund is and state
22
+ how long we have been waiting I get an inane email saying some departments take
23
+ longer than others to respond! Absolutely hopeless airline to stuff up the booking
24
+ in the first place and even worse customer service to not even attempt to solve
25
+ the problem at check in even when they could see the mistake THEY had made in
26
+ their system, compounded by being be unable to investigate a very simple claim,
27
+ and refund me 150 pounds in 15 months.
28
+ - text: They downgraded me from business to premium economy. They took three months
29
+ to get back to me and offered me 200 pounds or 400 AUD. The difference between
30
+ business class and premium economy (which I never fly) is $3000 AUD and the difference
31
+ between economy and business is $6500 AUD. They owe me at least 1500 pounds and
32
+ to be very fair 3250 pounds. The downgrade was insulting and incredibly painful
33
+ as I had a recent cancer operation and have a back injury which I have pointed
34
+ out to them - I need to lie down. The wait for them to get around to me has been
35
+ numbing. The insult of their offer has been the slap in the face to continue my
36
+ degradation. The people I have dealt with at the airport have been down to earth,
37
+ honest hard working people. The actual staff on the plane were warm and friendly
38
+ - and helpful. The systems under which BA operates are some sort of medieval torture.
39
+ - text: I flew from Istanbul to London in Business class. For more than half of the
40
+ flight a child was watching an iPad very loud with no phones plugged in - it was
41
+ three rows in front of me and disrupted my flight as I could hear it above my
42
+ headphones. Staff thought this was fine and refused to tell the mom to turn it
43
+ down. Why is this acceptable on a flight especially in business class? Has this
44
+ airline turned into a zoo? Are staff given no training in customer service? Why
45
+ is a child allowed to disrupt other passengers? When I told the staff she just
46
+ laughed at me. BA customer service is a disgrace. I've not even mentioned the
47
+ food but it was bad, really bad.
48
+ - text: 'Mexico City Airport is a zoo, but taking the late departure on BA to LHR
49
+ isn''t too bad. Club passengers can use the AA Admirals Lounge, which is surprisingly
50
+ good and not too busy as it seems to cater to BA''s club passengers only at this
51
+ time of day. Lovely staff, solid food & bar, really pleasant. We flew an older
52
+ 787 with the old style club seats. Seated in the front cabin (just 3 rows of club)
53
+ in the window and adjecant aisle seat is really good if you travel with your partner.
54
+ Come to think of it, I will really miss this old style -once cutting edge- lay-out.
55
+ There is no better way to fly when you are a couple. We were in that last row
56
+ of the front cabin so both window and aisle seat had unobstructed access to the
57
+ aisle. Still terrible you have to pay for these seats, but it obvioulsy works
58
+ and we were happy getting these seats. Flying BA when the crew is good is amazing.
59
+ Service was impecable on this flight. Just the right mix of humor, service and
60
+ attention. Food seemed to be good as well, but hardly touched it. I am fine sleeping
61
+ in these old club world seats although bedding could be better. On time departure,
62
+ smooth flight and early arrival at Heathrow. We went outside for a smoke and returned
63
+ to the terminal through fast track. Security at LHR has always been terrible,
64
+ but today security staff was too busy chatting among themselves so all bags went
65
+ through without ''secundary'' checks. We had a lovely shower at the ''spa'', what
66
+ a fabulous facility. The South Lounge was crazy busy and it is just a design disaster.
67
+ Who ever choose the bizarre combination of furniture: what a mess! Food on offer
68
+ was solid and so are the drinks. Our home stretch to Amsterdam was pretty straight
69
+ forward. Lousy welcome at the door but crew recovered well and made everyone feel
70
+ special with excellent bar-cart service. I love the ''double''-servings of drinks.
71
+ English tea is about the worst meal concepts in the world and I really don''t
72
+ understand BA stuck to it through the years. No-one like the cucumber white bread
73
+ things, but hey... On time landing in Amsterdam but the usual long taxi then clumsy
74
+ jet bridge connection ended up with a 20 minute late arrival, why is it so hard
75
+ to connect a jetbridge in Amsterdam? Flying club in BA is still wonderful. I Love
76
+ it!'
77
+ - text: We traveled to Lisbon for our dream vacation, a cruise to Portugal and Spain.
78
+ Our friends did not EVER get their luggage. It was a two week cruise. Two weeks
79
+ without a change of clothes or her CPAP machine. Contacting customer service was
80
+ a nightmare. We never talked to a real person. Very little effort was put into
81
+ getting them their bags. In one port we were on the ship and the bags were at
82
+ the airport. The airlines did not deliver the bags nor did they tell our friends
83
+ that they needed to go get them. The airline couldn’t be bothered to take the
84
+ bags from the airport to the ship. BA says it is their policy to get you your
85
+ bags within 72 hours. That is a joke! It’s been over two weeks and they still
86
+ don’t have them. They are back home in the US and last they heard the bags were
87
+ in Lisbon! If your have a choice, do not fly British Airways. Customer Service
88
+ is non existent!
89
+ pipeline_tag: text-classification
90
+ inference: true
91
+ base_model: sentence-transformers/paraphrase-mpnet-base-v2
92
+ model-index:
93
+ - name: SetFit with sentence-transformers/paraphrase-mpnet-base-v2
94
+ results:
95
+ - task:
96
+ type: text-classification
97
+ name: Text Classification
98
+ dataset:
99
+ name: Unknown
100
+ type: unknown
101
+ split: test
102
+ metrics:
103
+ - type: accuracy
104
+ value: 0.8333333333333334
105
+ name: Accuracy
106
+ ---
107
+
108
+ # SetFit with sentence-transformers/paraphrase-mpnet-base-v2
109
+
110
+ This is a [SetFit](https://github.com/huggingface/setfit) model that can be used for Text Classification. This SetFit model uses [sentence-transformers/paraphrase-mpnet-base-v2](https://huggingface.co/sentence-transformers/paraphrase-mpnet-base-v2) as the Sentence Transformer embedding model. A [LogisticRegression](https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html) instance is used for classification.
111
+
112
+ The model has been trained using an efficient few-shot learning technique that involves:
113
+
114
+ 1. Fine-tuning a [Sentence Transformer](https://www.sbert.net) with contrastive learning.
115
+ 2. Training a classification head with features from the fine-tuned Sentence Transformer.
116
+
117
+ ## Model Details
118
+
119
+ ### Model Description
120
+ - **Model Type:** SetFit
121
+ - **Sentence Transformer body:** [sentence-transformers/paraphrase-mpnet-base-v2](https://huggingface.co/sentence-transformers/paraphrase-mpnet-base-v2)
122
+ - **Classification head:** a [LogisticRegression](https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html) instance
123
+ - **Maximum Sequence Length:** 512 tokens
124
+ - **Number of Classes:** 6 classes
125
+ <!-- - **Training Dataset:** [Unknown](https://huggingface.co/datasets/unknown) -->
126
+ <!-- - **Language:** Unknown -->
127
+ <!-- - **License:** Unknown -->
128
+
129
+ ### Model Sources
130
+
131
+ - **Repository:** [SetFit on GitHub](https://github.com/huggingface/setfit)
132
+ - **Paper:** [Efficient Few-Shot Learning Without Prompts](https://arxiv.org/abs/2209.11055)
133
+ - **Blogpost:** [SetFit: Efficient Few-Shot Learning Without Prompts](https://huggingface.co/blog/setfit)
134
+
135
+ ### Model Labels
136
+ | Label | Examples |
137
+ |:------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
138
+ | 1 | <ul><li>'4 Hours before takeoff we received a Mail stating a cryptic message that there are disruptions to be expected as there is a limit on how many planes can leave at the same time. So did the capacity of the Heathrow Airport really hit British Airways by surprise, 4h before departure? Anyhow - we took the one hour delay so what - but then we have been forced to check in our Hand luggage. I travel only with hand luggage to avoid waiting for the ultra slow processing of the checked in luggage. Overall 2h later at home than planed, with really no reason, just due to incompetent people. Service level far worse then Ryanair and triple the price. Really never again. Thanks for nothing.'</li><li>'Our connecting flight from London to Glasgow was canceled and we were forced to wait 12 hours in the airport for a new flight. When we received our luggage at Glasgow we discovered that our luggage was soaking wet. My wife’s luggage contents were wet and had to be air dried.'</li><li>"Absolutely the worst experience ever. Flew into Heathrow, no problem. Waited for 5 hours, three extra hours, for our connection to Porto then the cancelled the flight. Scrambled for a hotel and a new flight the next day. They routed us through Madrid the next morning. That flight was 1.5 hours late so we missed our connection to Porto. Because we missed the connection (their fault), they cancelled our return flights. After two hours on the phone with customer service from the Madrid airport, they booked us a new return flight, then they made is pay $ 1300 to fly from Madrid to Porto. Then, for no reason they cancelled our return flight again! After hours, and hours and hours with customer service, we finally got a return flight five days after our original return flight. Meanwhile, they lost my wife's luggage. We finally got 15 DAYS after they lost it. Return flight? More problems with our reservations. At no point was British Airways helpful. They left the onus on us to fix their mistakes at every turn. They completely ruined a three week vacation and they don't care. They wouldn't even let us speak to a supervisor or manager. Awful, bordering on passenger abuse."</li></ul> |
139
+ | 4 | <ul><li>'I\'m sure that BA have gradually made their economy experience (BA Euroflyer out of Gatwick) so miserable that passengers are tempted to upgrade to the lacklustre and overpriced business class. Long wait at the biz checkin ( due to status ) and dealt with by a bored agent - OK third party, but still representing BA - who hardly spoke and avoided eye contact and was more focussed on her fingernails. Lounge was crowded and grubby but at least the staff there are pleasant and helpful On board the seats are cramped and uncomfortable and it took over two hours before crew appeared with food sales and the "free water" which on Gatwick services consists of a half full plastic cup rather than the luxury of a small bottle.. A fellow passenger mentioned the delay and the fact that they had no sandwiches for sale which prompted the flight attendant to say that the service was much better on Easyjet who do two service runs etc.'</li><li>'BA standards continue to decline every time I fly with them. This time, a 45 min late departure, which seems the norm for BA, and no information from the rude and clueless boarding gate staff. The Club lounge was overcrowded, dirty and grubby and cleaning staff could not cope. How many more cutbacks is BA going to apply before they become truly low cost. As a 35 year veteran user of BA, while people complained of Alex Cruz cutting costs, the past 3 years has seen them decline very quickly under their latest CEO. One reads the occasional article about BA improving things, but I have yet to see anything substantive. There seem to be few British staff left amongst the cabin crew, so maybe time for a name change and give the flag carrier status to a proper low-cost - and sadly the staff service has declined year on year. Onboard, the catering remains poor and surprised that Do&Co can produce such rubbish meals when I have sampled their Turkish Airlines equivalent in August that was superb - guessing BA are too tight with their budget. Onboard WiFi service is a joke and should be avoided.'</li><li>'Good lounge at Cape Town. On time departure. Drinks high quality. Sound dinner service. Breakfast reasonable. Arrival lounge was good but showers cold.'</li></ul> |
140
+ | 5 | <ul><li>"Despite boarding being the usual free for all at LHR with groups 1-3 being called to board all at once. Whilst those passengers who had agreed to check in a bag in at the gate, getting to board before anyone else! However, the service on board was impeccable. Superb crew, friendly, attentive, interacting with passengers and generally appearing to be enjoying their job. Like BA in the old days and at its best. Food choice and quality seems to have improved too (no beef cheeks thankfully) and even the Club kitchen appears to have returned. Old style Club seating, but is at least better, and feels less cramped, on the 787's."</li><li>"Flew back from Malta after scattering our son's ashes at his favourite spots. When we boarded the aircraft for our return flight my wife became upset. A member of the cabin crew noticed this and immediately spoke to my wife and tried to reassure her. Her name is Tracey, an exceptional crew member. I noticed she spoke to other travellers in a courteous manner and was friendly. Each time she passed my wife she asked how she was and would she like anything. This kindness made a difficult time easier for us both. Aircraft seats were comfortable and service good for a 2hrs. 45mins. flight. Thank you B.A."</li><li>'Excellent service levels, proactive crew and superb food and beverages. I found all aspects of the service to be superior to BA business class, even the new BA Club Suites. First Class felt exclusive, the dedicated crew were clearly used to working the premium cabin, enjoying their work, were proactive, friendly, very respectful and the food and beverage offering a considerable step up from business class. The seat, with sliding double doors was spacious, well designed and very comfortable. British Airways offered a solid First Class service, from Concorde Lounge to boarding (which was actually by group number for a change) to the very warm and genuine welcome on boarding. A consistent, solid, comfortable service from start to finish and if the price was right, I would not hesitate to book First Class with British Airways again.'</li></ul> |
141
+ | 2 | <ul><li>"I take comfort in reading the last ten or so reviews to see I'm not the only traveller to put in words, how absolutely abysmal British Airways are! The only reason we are stuck using this awful airline is to use up points. We booked Club Europe months ago. London to Athens, sat in row 3 and told they had run out of food options, only choice was lentil pie or green curry. Returning Athens to London Club Europe. Couldn't check in online as promised so arrived at the airport 3hrs early. To be told they had overbooked the flight and basically we were being 'bumped' to economy. This airline fails to deliver time and time again. It is a national disgrace and I implore everyone to choose an alternative. "</li><li>"You can buy sandwiches and crisps but don't expect a hot meal. Because the plane is a narrow body , there are no screens. Not helping matters is the fact that the BA prebooking shop for food didn't recognise the flight number, and the onboard WiFi didn't work. "</li><li>'The airplanes and the lounges are worn out, old and broken. From Dallas to Heathrow, multiple first class seating and electronics were non functional and poorly designed. The first class seating from Heathrow to Dubrovnik was nothing more than a tray blocking the middle seat of a standard coach ticket. Very disappointed.'</li></ul> |
142
+ | 3 | <ul><li>'We traveled to Lisbon for our dream vacation, a cruise to Portugal and Spain. Our friends did not EVER get their luggage. It was a two week cruise. Two weeks without a change of clothes or her CPAP machine. Contacting customer service was a nightmare. We never talked to a real person. Very little effort was put into getting them their bags. In one port we were on the ship and the bags were at the airport. The airlines did not deliver the bags nor did they tell our friends that they needed to go get them. The airline couldn’t be bothered to take the bags from the airport to the ship. BA says it is their policy to get you your bags within 72 hours. That is a joke! It’s been over two weeks and they still don’t have them. They are back home in the US and last they heard the bags were in Lisbon! If your have a choice, do not fly British Airways. Customer Service is non existent!'</li><li>"I have flow on BA several times since the airline started non-stop service between Austin, TX and London Heathrow. Every year the service gets worse. I brought a tape measure with me to see how far apart the seats are in the economy section. 25½ inches. BA has removed bathrooms in order to squeeze a few more rows of seats onto the aircraft. Thankfully I'm not a big person and was able to squeeze into my seat without being too uncomfortable. When BA first started flying out of Austin, the food was great. Now, when I arrive at Heathrow, I get real food and take it on the plane with me. I don't know where or who makes BA's food, but it is not eatable. If BA did not have a direct flight from my hometown to London, I would fly with a different airline. When we checked into Heathrow, the line was extremely long and only one person was checking people in. It took nearly an hour to get to the counter. I understand airlines are making record profits and need to make up lost revenue from the pandemic, but I think BA has gone too far and has little concern for customer service in pursuit of profits."</li><li>'Angry, disappointed, and unsatisfied. My route was from London to Atlanta. My suitcase was not boarded, therefore not landed with me. For both comfort and safety reason, a bag always fly with its passenger and that did not happen. Claims and few phone calls were made by desk assistants who answered my questions unprofessionally and miserably. Certainly, I was left with nothing but my backpack which contained not more than few snacks. Neither clothes nor anything else was ever provided as an apology. Meanwhile, I was also told that my bag would have been delivered through the next 24 hours which also did not happen. British Airways is a great airline to fly with but its organization, when it comes to customer service, is poor and uncertain. Still waiting for my bag.'</li></ul> |
143
+ | 6 | <ul><li>'They downgraded me from business to premium economy. They took three months to get back to me and offered me 200 pounds or 400 AUD. The difference between business class and premium economy (which I never fly) is $3000 AUD and the difference between economy and business is $6500 AUD. They owe me at least 1500 pounds and to be very fair 3250 pounds. The downgrade was insulting and incredibly painful as I had a recent cancer operation and have a back injury which I have pointed out to them - I need to lie down. The wait for them to get around to me has been numbing. The insult of their offer has been the slap in the face to continue my degradation. The people I have dealt with at the airport have been down to earth, honest hard working people. The actual staff on the plane were warm and friendly - and helpful. The systems under which BA operates are some sort of medieval torture.'</li><li>'BA cancelled our flight and could not book us onto any flight for the next 4 days. I had to spend £5k in expenses to get us back with another airline. 2 months later I am still waiting for reimbursement and have had no response to my 3 written complaints. Even the call centre staff tell me that head office have taken down the telephone number and email for the department who deal with this, so even they cannot escalate or inquire. Utterly useless.\n'</li><li>"This is the worst experience I have ever had with any airline. I flew with British Airline on August 21st 2022. I had one checked bag that was lost at Heathrow Airport. I am aware that at that time there was a system error with the baggage belt and many travelers were affected. I filed a report for my missing bag on the same day I arrived at LAX airport, and that was on August 21st. I waited patiently for three weeks (which is the time frame to either find the bag or be eligible for a compensation). When I did not receive any update on my lost bag, I filed a claim for compensation, and that was on September 11th. Since then, I have been waiting for a response from the customer relation with no good signs of resolving the issue. I emailed them and tried to update the claim but still no response until today. I contacted the baggage team and they were not helpful and did not ease my prolonged waiting. The only way to contact customer relations is via the website and they're not even getting back to me. Every time I talk to a customer service agent, they tell me to wait some more. I have been waiting for almost three months now and my issue is not resolved yet. This whole experience was a hassle. Very unprofessional for a renowned airline like BA."</li></ul> |
144
+
145
+ ## Evaluation
146
+
147
+ ### Metrics
148
+ | Label | Accuracy |
149
+ |:--------|:---------|
150
+ | **all** | 0.8333 |
151
+
152
+ ## Uses
153
+
154
+ ### Direct Use for Inference
155
+
156
+ First install the SetFit library:
157
+
158
+ ```bash
159
+ pip install setfit
160
+ ```
161
+
162
+ Then you can load this model and run inference.
163
+
164
+ ```python
165
+ from setfit import SetFitModel
166
+
167
+ # Download from the 🤗 Hub
168
+ model = SetFitModel.from_pretrained("setfit_model_id")
169
+ # Run inference
170
+ preds = model("I flew from Istanbul to London in Business class. For more than half of the flight a child was watching an iPad very loud with no phones plugged in - it was three rows in front of me and disrupted my flight as I could hear it above my headphones. Staff thought this was fine and refused to tell the mom to turn it down. Why is this acceptable on a flight especially in business class? Has this airline turned into a zoo? Are staff given no training in customer service? Why is a child allowed to disrupt other passengers? When I told the staff she just laughed at me. BA customer service is a disgrace. I've not even mentioned the food but it was bad, really bad.")
171
+ ```
172
+
173
+ <!--
174
+ ### Downstream Use
175
+
176
+ *List how someone could finetune this model on their own dataset.*
177
+ -->
178
+
179
+ <!--
180
+ ### Out-of-Scope Use
181
+
182
+ *List how the model may foreseeably be misused and address what users ought not to do with the model.*
183
+ -->
184
+
185
+ <!--
186
+ ## Bias, Risks and Limitations
187
+
188
+ *What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
189
+ -->
190
+
191
+ <!--
192
+ ### Recommendations
193
+
194
+ *What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
195
+ -->
196
+
197
+ ## Training Details
198
+
199
+ ### Training Set Metrics
200
+ | Training set | Min | Median | Max |
201
+ |:-------------|:----|:---------|:----|
202
+ | Word count | 23 | 144.6667 | 418 |
203
+
204
+ | Label | Training Sample Count |
205
+ |:------|:----------------------|
206
+ | 1 | 7 |
207
+ | 2 | 7 |
208
+ | 3 | 7 |
209
+ | 4 | 7 |
210
+ | 5 | 7 |
211
+ | 6 | 7 |
212
+
213
+ ### Training Hyperparameters
214
+ - batch_size: (8, 8)
215
+ - num_epochs: (3, 3)
216
+ - max_steps: -1
217
+ - sampling_strategy: oversampling
218
+ - body_learning_rate: (2e-05, 1e-05)
219
+ - head_learning_rate: 0.01
220
+ - loss: CosineSimilarityLoss
221
+ - distance_metric: cosine_distance
222
+ - margin: 0.25
223
+ - end_to_end: False
224
+ - use_amp: False
225
+ - warmup_proportion: 0.1
226
+ - seed: 123
227
+ - eval_max_steps: -1
228
+ - load_best_model_at_end: False
229
+
230
+ ### Training Results
231
+ | Epoch | Step | Training Loss | Validation Loss |
232
+ |:------:|:----:|:-------------:|:---------------:|
233
+ | 0.0054 | 1 | 0.1708 | - |
234
+ | 0.2717 | 50 | 0.0981 | - |
235
+ | 0.5435 | 100 | 0.0739 | - |
236
+ | 0.8152 | 150 | 0.0039 | - |
237
+ | 1.0870 | 200 | 0.0005 | - |
238
+ | 1.3587 | 250 | 0.0007 | - |
239
+ | 1.6304 | 300 | 0.0002 | - |
240
+ | 1.9022 | 350 | 0.0005 | - |
241
+ | 2.1739 | 400 | 0.0004 | - |
242
+ | 2.4457 | 450 | 0.0003 | - |
243
+ | 2.7174 | 500 | 0.0005 | - |
244
+ | 2.9891 | 550 | 0.0004 | - |
245
+
246
+ ### Framework Versions
247
+ - Python: 3.8.10
248
+ - SetFit: 1.0.3
249
+ - Sentence Transformers: 2.3.1
250
+ - Transformers: 4.37.2
251
+ - PyTorch: 2.2.0
252
+ - Datasets: 2.17.1
253
+ - Tokenizers: 0.15.2
254
+
255
+ ## Citation
256
+
257
+ ### BibTeX
258
+ ```bibtex
259
+ @article{https://doi.org/10.48550/arxiv.2209.11055,
260
+ doi = {10.48550/ARXIV.2209.11055},
261
+ url = {https://arxiv.org/abs/2209.11055},
262
+ author = {Tunstall, Lewis and Reimers, Nils and Jo, Unso Eun Seo and Bates, Luke and Korat, Daniel and Wasserblat, Moshe and Pereg, Oren},
263
+ keywords = {Computation and Language (cs.CL), FOS: Computer and information sciences, FOS: Computer and information sciences},
264
+ title = {Efficient Few-Shot Learning Without Prompts},
265
+ publisher = {arXiv},
266
+ year = {2022},
267
+ copyright = {Creative Commons Attribution 4.0 International}
268
+ }
269
+ ```
270
+
271
+ <!--
272
+ ## Glossary
273
+
274
+ *Clearly define terms in order to be accessible across audiences.*
275
+ -->
276
+
277
+ <!--
278
+ ## Model Card Authors
279
+
280
+ *Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
281
+ -->
282
+
283
+ <!--
284
+ ## Model Card Contact
285
+
286
+ *Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
287
+ -->
config.json ADDED
@@ -0,0 +1,24 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "sentence-transformers/paraphrase-mpnet-base-v2",
3
+ "architectures": [
4
+ "MPNetModel"
5
+ ],
6
+ "attention_probs_dropout_prob": 0.1,
7
+ "bos_token_id": 0,
8
+ "eos_token_id": 2,
9
+ "hidden_act": "gelu",
10
+ "hidden_dropout_prob": 0.1,
11
+ "hidden_size": 768,
12
+ "initializer_range": 0.02,
13
+ "intermediate_size": 3072,
14
+ "layer_norm_eps": 1e-05,
15
+ "max_position_embeddings": 514,
16
+ "model_type": "mpnet",
17
+ "num_attention_heads": 12,
18
+ "num_hidden_layers": 12,
19
+ "pad_token_id": 1,
20
+ "relative_attention_num_buckets": 32,
21
+ "torch_dtype": "float32",
22
+ "transformers_version": "4.37.2",
23
+ "vocab_size": 30527
24
+ }
config_sentence_transformers.json ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ {
2
+ "__version__": {
3
+ "sentence_transformers": "2.0.0",
4
+ "transformers": "4.7.0",
5
+ "pytorch": "1.9.0+cu102"
6
+ }
7
+ }
config_setfit.json ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ {
2
+ "normalize_embeddings": false,
3
+ "labels": null
4
+ }
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:473ad179b5dea75723d98f196a15304fa0b51b6a8ac163cf43ad9dff98b70312
3
+ size 437967672
model_head.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1432402839f48a92d15ff023065244ef464facef045ad30be6d37f624734204b
3
+ size 37783
modules.json ADDED
@@ -0,0 +1,14 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [
2
+ {
3
+ "idx": 0,
4
+ "name": "0",
5
+ "path": "",
6
+ "type": "sentence_transformers.models.Transformer"
7
+ },
8
+ {
9
+ "idx": 1,
10
+ "name": "1",
11
+ "path": "1_Pooling",
12
+ "type": "sentence_transformers.models.Pooling"
13
+ }
14
+ ]
sentence_bert_config.json ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ {
2
+ "max_seq_length": 512,
3
+ "do_lower_case": false
4
+ }
special_tokens_map.json ADDED
@@ -0,0 +1,51 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token": {
3
+ "content": "<s>",
4
+ "lstrip": false,
5
+ "normalized": false,
6
+ "rstrip": false,
7
+ "single_word": false
8
+ },
9
+ "cls_token": {
10
+ "content": "<s>",
11
+ "lstrip": false,
12
+ "normalized": false,
13
+ "rstrip": false,
14
+ "single_word": false
15
+ },
16
+ "eos_token": {
17
+ "content": "</s>",
18
+ "lstrip": false,
19
+ "normalized": false,
20
+ "rstrip": false,
21
+ "single_word": false
22
+ },
23
+ "mask_token": {
24
+ "content": "<mask>",
25
+ "lstrip": true,
26
+ "normalized": false,
27
+ "rstrip": false,
28
+ "single_word": false
29
+ },
30
+ "pad_token": {
31
+ "content": "<pad>",
32
+ "lstrip": false,
33
+ "normalized": false,
34
+ "rstrip": false,
35
+ "single_word": false
36
+ },
37
+ "sep_token": {
38
+ "content": "</s>",
39
+ "lstrip": false,
40
+ "normalized": false,
41
+ "rstrip": false,
42
+ "single_word": false
43
+ },
44
+ "unk_token": {
45
+ "content": "[UNK]",
46
+ "lstrip": false,
47
+ "normalized": false,
48
+ "rstrip": false,
49
+ "single_word": false
50
+ }
51
+ }
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer_config.json ADDED
@@ -0,0 +1,59 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "added_tokens_decoder": {
3
+ "0": {
4
+ "content": "<s>",
5
+ "lstrip": false,
6
+ "normalized": false,
7
+ "rstrip": false,
8
+ "single_word": false,
9
+ "special": true
10
+ },
11
+ "1": {
12
+ "content": "<pad>",
13
+ "lstrip": false,
14
+ "normalized": false,
15
+ "rstrip": false,
16
+ "single_word": false,
17
+ "special": true
18
+ },
19
+ "2": {
20
+ "content": "</s>",
21
+ "lstrip": false,
22
+ "normalized": false,
23
+ "rstrip": false,
24
+ "single_word": false,
25
+ "special": true
26
+ },
27
+ "104": {
28
+ "content": "[UNK]",
29
+ "lstrip": false,
30
+ "normalized": false,
31
+ "rstrip": false,
32
+ "single_word": false,
33
+ "special": true
34
+ },
35
+ "30526": {
36
+ "content": "<mask>",
37
+ "lstrip": true,
38
+ "normalized": false,
39
+ "rstrip": false,
40
+ "single_word": false,
41
+ "special": true
42
+ }
43
+ },
44
+ "bos_token": "<s>",
45
+ "clean_up_tokenization_spaces": true,
46
+ "cls_token": "<s>",
47
+ "do_basic_tokenize": true,
48
+ "do_lower_case": true,
49
+ "eos_token": "</s>",
50
+ "mask_token": "<mask>",
51
+ "model_max_length": 512,
52
+ "never_split": null,
53
+ "pad_token": "<pad>",
54
+ "sep_token": "</s>",
55
+ "strip_accents": null,
56
+ "tokenize_chinese_chars": true,
57
+ "tokenizer_class": "MPNetTokenizer",
58
+ "unk_token": "[UNK]"
59
+ }
vocab.txt ADDED
The diff for this file is too large to render. See raw diff