Add SetFit model

README.md

@@ -20,6 +20,20 @@ widget:
 pipeline_tag: text-classification
 inference: true
 base_model: intfloat/multilingual-e5-large
+model-index:
+- name: SetFit with intfloat/multilingual-e5-large
+  results:
+  - task:
+      type: text-classification
+      name: Text Classification
+    dataset:
+      name: Unknown
+      type: unknown
+      split: test
+    metrics:
+    - type: accuracy
+      value: 0.9130434782608695
+      name: Accuracy
 ---
 
 # SetFit with intfloat/multilingual-e5-large
@@ -56,6 +70,13 @@ The model has been trained using an efficient few-shot learning technique that i
 | 1     | <ul><li>'Are there plans to enhance promotional activities specific to the MT to mitigate the ROI decline in 2023?'</li><li>'What are the main reasons for ROI decline in 2022 in MT compared to 2021?'</li><li>'Are there changes in consumer preferences or trends that have impacted the Lift of Zucaritas, and how does this compare to other brands like Pringles or Frutela?'</li></ul> |
 | 0     | <ul><li>'What type of promotions worked best for MT Walmart in 2022?'</li><li>'Which channel has the max ROI and Vol Lift when we run the Promotion for RTEC category?'</li><li>'Which sub_catg_nm have the highest ROI in 2022?'</li></ul>                                                                                                                                                   |
 
+## Evaluation
+
+### Metrics
+| Label   | Accuracy |
+|:--------|:---------|
+| **all** | 0.9130   |
+
 ## Uses
 
 ### Direct Use for Inference
@@ -132,6 +153,15 @@ preds = model("Which Sku cannibalizes higher margin Skus the most for CHEDRAUI c
 - eval_max_steps: -1
 - load_best_model_at_end: False
 
+### Training Results
+| Epoch  | Step | Training Loss | Validation Loss |
+|:------:|:----:|:-------------:|:---------------:|
+| 0.0133 | 1    | 0.3582        | -               |
+| 0.6667 | 50   | 0.0024        | -               |
+| 1.3333 | 100  | 0.0005        | -               |
+| 2.0    | 150  | 0.0004        | -               |
+| 2.6667 | 200  | 0.0002        | -               |
+
 ### Framework Versions
 - Python: 3.10.12
 - SetFit: 1.0.3

config_setfit.json

@@ -1,4 +1,4 @@
 {
-  "normalize_embeddings": false,
-  "labels": null
+  "labels": null,
+  "normalize_embeddings": false
 }

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b97ef8b3fe70ff51008184da99b70a0df37ed377bb538a224f3951f2ed388234
+oid sha256:4d3bd170d8e549c5774c6f3418871cd2ccc3a6eaa23b3dab96e77e9caae2fc49
 size 2239607176

model_head.pkl

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:95a2349eb3f96eb70d9185b2f02af4ffabe28566b0bbeda0ad56312e9e6879cb
-size 324
+oid sha256:fa6f2ed167397fe8d3aa5ae40d7062ea545aba8dfb06e3495023680b2d88ab99
+size 25471