shrijayan's picture
Upload folder using huggingface_hub
6f8f57f verified
|
raw
history blame
39.7 kB
---
language:
- en
license: apache-2.0
tags:
- sentence-transformers
- sentence-similarity
- feature-extraction
- generated_from_trainer
- dataset_size:378558
- loss:MultipleNegativesRankingLoss
base_model: intfloat/e5-base-v2
widget:
- source_sentence: Is intraoperative ketorolac an effective substitute for fentanyl
in children undergoing outpatient adenotonsillectomy?
sentences:
- Ketorolac showed no advantage over fentanyl in reducing the incidence of PONV
in children undergoing ADLAT.
- The patients with IgAN and their first relatives showed significant higher Gal
deficient IgA1 level than healthy controls, whereas patients spouses were the
same as healthy controls. It can be suggested that the Gal deficient IgA1 might
be inherited in Chinese patients with IgAN.
- Our results indicated that triptolide enhanced and enriched the stemness in the
PDAC cell lines at a low dose of 12.5 nM, but also resulted in the regression
of tumors derived from these cells.
- source_sentence: Is task specific fall prevention training effective for warfighters
with transtibial amputations?
sentences:
- These results indicate that task specific fall prevention training is an effective
rehabilitation method to reduce falls in persons with lower extremity transtibial
amputations.
- Don t press on the eye. For pain, give acetaminophen Tylenol . Don t give aspirin
or ibuprofen Advil, Motrin , because they can increase bleeding.
- Dermatophytes Trichophyton skin ,hair, ,nail Tri all Three Microsporum skin, hair
My head on head we have skin and hair Epidermophyton skin, nails
- source_sentence: Left horn of sinus venosus forms
sentences:
- Ki 67 expression is predictive of prognosis, and our prognostic model may become
a useful tool for predicting prognosis in patients with stage I II extranodal
NK T cell lymphoma, nasal type.
- Evidence described here suggests that IFN λ is a good candidate inhibitor of viral
replication in dengue infection. Mechanisms for the cellular and organismal interplay
between DENV and IFN λ need to be further studied as they could provide insights
into strategies to treat this disease. Furthermore, we report a novel epithelial
model to study dengue infection in vitro.
- Ans. A Coronary sinusRef Netter s Atlas of Human Embryology 2012 ed. pg. 96Heart
tube embryonic derivativesembryonic structureGives rise to Proximal 1 3rd of bulbus
cordisPrimitive trabeculated left ventricle Middle 1 3rd of bulbus cordisRight
and left ventricular outflow tract Distal 1 3rd of bulbus cordis truncus arteriosus
Ascending aorta and pulmonary trunk Left horn of sinus venosusCoronary sinus Right
horn of sinus venosusSmooth part of right atrium Right common cardinal nerve and
right anterior cardinal nerveSVC superior vena cava
- source_sentence: Is implementation of national diabetes retinal screening programme
associated with a lower proportion of patients referred to ophthalmology?
sentences:
- Introduction of a systematic retinal screening programme can reduce the proportion
of patients referred to the ophthalmology clinic, and use ophthalmology services
more efficiently.
- A Obesity Medications for the treatment of obesity can be classified as catecholaminergic
or serotonergic. Catecholaminergic medications include Amphetamines with high
abuse potential The Non Amphetamine schedule IV appetite suppressants Phentermine,
Diethyl propion Mazindol. The September 1997 withdrawal from the market of Flenfluramine
Defenfluramine has made true serotonergic appetite medications unavailable. The
SSRI antidepressants, E.g.., Fluoxetine Setraline, also have serotonergic activity
but are not approved by the FDA for weight loss.
- A i.e. Protein linked with glycosidic bond
- source_sentence: Does amyloid peptide regulate calcium homoeostasis and arrhythmogenesis
in pulmonary vein cardiomyocytes?
sentences:
- Hydroxy ethyl methaacrylate is a soft, flexible, water absorbing, plastic used
to make soft contact lenses. It is a polymer of 2 hydroxyethyl methacrylate HEMA
, a clear liquid component. Hard contact lenses are made from polymethyl methacrylate
PMMA and Silicon.
- Beta carotene has become popular in part because it s an antioxidant a substance
that may protect cells from damage. A number of studies show that people who eat
lots of fruits and vegetables that are rich in beta carotene and other vitamins
and minerals have a lower risk of some cancers and heart disease. However, so
far studies have not found that beta carotene supplements have the same health
benefits as foods.
- 25 35 has direct electrophysiological effects on PV cardiomyocytes.
pipeline_tag: sentence-similarity
library_name: sentence-transformers
metrics:
- cosine_accuracy
model-index:
- name: MPNet base trained on AllNLI triplets
results:
- task:
type: triplet
name: Triplet
dataset:
name: eval dataset
type: eval-dataset
metrics:
- type: cosine_accuracy
value: 0.9937447168216399
name: Cosine Accuracy
- task:
type: triplet
name: Triplet
dataset:
name: test dataset
type: test-dataset
metrics:
- type: cosine_accuracy
value: 0.9964285714285714
name: Cosine Accuracy
---
# MPNet base trained on AllNLI triplets
This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [intfloat/e5-base-v2](https://huggingface.co/intfloat/e5-base-v2). It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
## Model Details
### Model Description
- **Model Type:** Sentence Transformer
- **Base model:** [intfloat/e5-base-v2](https://huggingface.co/intfloat/e5-base-v2) <!-- at revision 1c644c92ad3ba1efdad3f1451a637716616a20e8 -->
- **Maximum Sequence Length:** 512 tokens
- **Output Dimensionality:** 768 dimensions
- **Similarity Function:** Cosine Similarity
<!-- - **Training Dataset:** Unknown -->
- **Language:** en
- **License:** apache-2.0
### Model Sources
- **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
- **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers)
- **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers)
### Full Model Architecture
```
SentenceTransformer(
(0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel
(1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
(2): Normalize()
)
```
## Usage
### Direct Usage (Sentence Transformers)
First install the Sentence Transformers library:
```bash
pip install -U sentence-transformers
```
Then you can load this model and run inference.
```python
from sentence_transformers import SentenceTransformer
# Download from the 🤗 Hub
model = SentenceTransformer("sentence_transformers_model_id")
# Run inference
sentences = [
'Does amyloid peptide regulate calcium homoeostasis and arrhythmogenesis in pulmonary vein cardiomyocytes?',
'Aβ 25 35 has direct electrophysiological effects on PV cardiomyocytes.',
'Beta carotene has become popular in part because it s an antioxidant a substance that may protect cells from damage. A number of studies show that people who eat lots of fruits and vegetables that are rich in beta carotene and other vitamins and minerals have a lower risk of some cancers and heart disease. However, so far studies have not found that beta carotene supplements have the same health benefits as foods.',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 768]
# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]
```
<!--
### Direct Usage (Transformers)
<details><summary>Click to see the direct usage in Transformers</summary>
</details>
-->
<!--
### Downstream Usage (Sentence Transformers)
You can finetune this model on your own dataset.
<details><summary>Click to expand</summary>
</details>
-->
<!--
### Out-of-Scope Use
*List how the model may foreseeably be misused and address what users ought not to do with the model.*
-->
## Evaluation
### Metrics
#### Triplet
* Datasets: `eval-dataset` and `test-dataset`
* Evaluated with [<code>TripletEvaluator</code>](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#sentence_transformers.evaluation.TripletEvaluator)
| Metric | eval-dataset | test-dataset |
|:--------------------|:-------------|:-------------|
| **cosine_accuracy** | **0.9937** | **0.9964** |
<!--
## Bias, Risks and Limitations
*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
-->
<!--
### Recommendations
*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
-->
## Training Details
### Training Dataset
#### Unnamed Dataset
* Size: 378,558 training samples
* Columns: <code>sentence1</code>, <code>sentence2</code>, and <code>label</code>
* Approximate statistics based on the first 1000 samples:
| | sentence1 | sentence2 | label |
|:--------|:-----------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------|:--------------------------------------------------------------|
| type | string | string | float |
| details | <ul><li>min: 6 tokens</li><li>mean: 24.72 tokens</li><li>max: 147 tokens</li></ul> | <ul><li>min: 5 tokens</li><li>mean: 88.11 tokens</li><li>max: 512 tokens</li></ul> | <ul><li>min: 1.0</li><li>mean: 1.0</li><li>max: 1.0</li></ul> |
* Samples:
| sentence1 | sentence2 | label |
|:--------------------------------------------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:-----------------|
| <code>Does tolbutamide alter glucose transport and metabolism in the embryonic mouse heart?</code> | <code>Tolbutamide stimulates glucose uptake and metabolism in the embryonic heart, as occurs in adult extra pancreatic tissues. Glut 1 and HKI, but not GRP78, are likely involved in tolbutamide induced cardiac dysmorphogenesis.</code> | <code>1.0</code> |
| <code>Do flk1 cells derived from mouse embryonic stem cells reconstitute hematopoiesis in vivo in SCID mice?</code> | <code>The Flk1 hematopoietic cells derived from ES cells reconstitute hematopoiesis in vivo and may become an alternative donor source for bone marrow transplantation.</code> | <code>1.0</code> |
| <code>Does systematic aging of degradable nanosuspension ameliorate vibrating mesh nebulizer performance?</code> | <code>Nebulization of purified nanosuspensions resulted in droplet diameters of 7.0 µm. However, electrolyte supplementation and storage, which led to an increase in sample conductivity 10 20 µS cm , were capable of providing smaller droplet diameters during vibrating mesh nebulization 5.0 µm . No relevant change of NP properties i.e. size, morphology, remaining mass and molecular weight of the employed polymer was observed when incubated at 22 C for two weeks.</code> | <code>1.0</code> |
* Loss: [<code>MultipleNegativesRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
```json
{
"scale": 20.0,
"similarity_fct": "cos_sim"
}
```
### Evaluation Dataset
#### Unnamed Dataset
* Size: 47,320 evaluation samples
* Columns: <code>sentence1</code>, <code>sentence2</code>, and <code>label</code>
* Approximate statistics based on the first 1000 samples:
| | sentence1 | sentence2 | label |
|:--------|:-----------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------|:--------------------------------------------------------------|
| type | string | string | float |
| details | <ul><li>min: 5 tokens</li><li>mean: 24.45 tokens</li><li>max: 253 tokens</li></ul> | <ul><li>min: 7 tokens</li><li>mean: 87.68 tokens</li><li>max: 512 tokens</li></ul> | <ul><li>min: 1.0</li><li>mean: 1.0</li><li>max: 1.0</li></ul> |
* Samples:
| sentence1 | sentence2 | label |
|:-------------------------------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:-----------------|
| <code>Does thrombospondin 2 gene silencing in human aortic smooth muscle cells improve cell attachment?</code> | <code>siRNA mediated TSP 2 silencing of human aortic HAoSMCs improved cell attachment but had no effect on cell migration or proliferation. The effect on cell attachment was unrelated to changes in MMP activity.</code> | <code>1.0</code> |
| <code>What can you do to manage polycythemia vera?</code> | <code>Most people with polycythemia vera take low dose aspirin. There are a lot of ways you can keep yourself comfortable and as healthy as possible Don t smoke or chew tobacco. Tobacco makes blood vessels narrow, which can make blood clots more likely. Get some light exercise, such as walking, to help your circulation and keep your heart healthy. Do leg and ankle exercises to stop clots from forming in the veins of your legs. Your doctor or a physical therapist can show you how. Bathe or shower in cool water if warm water makes you itch. Keep your skin moist with lotion, and try not to scratch.</code> | <code>1.0</code> |
| <code>Is weekly nab paclitaxel safe and effective in 65 years old patients with metastatic breast cancer a post hoc analysis?</code> | <code>Weekly nab paclitaxel was safe and more efficacious compared with the q3w schedule and with solvent based taxanes in older patients with MBC.</code> | <code>1.0</code> |
* Loss: [<code>MultipleNegativesRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
```json
{
"scale": 20.0,
"similarity_fct": "cos_sim"
}
```
### Training Hyperparameters
#### Non-Default Hyperparameters
- `do_predict`: True
- `eval_strategy`: steps
- `per_device_train_batch_size`: 32
- `per_device_eval_batch_size`: 32
- `num_train_epochs`: 1
- `warmup_ratio`: 0.1
- `fp16`: True
- `load_best_model_at_end`: True
- `batch_sampler`: no_duplicates
#### All Hyperparameters
<details><summary>Click to expand</summary>
- `overwrite_output_dir`: False
- `do_predict`: True
- `eval_strategy`: steps
- `prediction_loss_only`: True
- `per_device_train_batch_size`: 32
- `per_device_eval_batch_size`: 32
- `per_gpu_train_batch_size`: None
- `per_gpu_eval_batch_size`: None
- `gradient_accumulation_steps`: 1
- `eval_accumulation_steps`: None
- `torch_empty_cache_steps`: None
- `learning_rate`: 5e-05
- `weight_decay`: 0.0
- `adam_beta1`: 0.9
- `adam_beta2`: 0.999
- `adam_epsilon`: 1e-08
- `max_grad_norm`: 1.0
- `num_train_epochs`: 1
- `max_steps`: -1
- `lr_scheduler_type`: linear
- `lr_scheduler_kwargs`: {}
- `warmup_ratio`: 0.1
- `warmup_steps`: 0
- `log_level`: passive
- `log_level_replica`: warning
- `log_on_each_node`: True
- `logging_nan_inf_filter`: True
- `save_safetensors`: True
- `save_on_each_node`: False
- `save_only_model`: False
- `restore_callback_states_from_checkpoint`: False
- `no_cuda`: False
- `use_cpu`: False
- `use_mps_device`: False
- `seed`: 42
- `data_seed`: None
- `jit_mode_eval`: False
- `use_ipex`: False
- `bf16`: False
- `fp16`: True
- `fp16_opt_level`: O1
- `half_precision_backend`: auto
- `bf16_full_eval`: False
- `fp16_full_eval`: False
- `tf32`: None
- `local_rank`: 0
- `ddp_backend`: None
- `tpu_num_cores`: None
- `tpu_metrics_debug`: False
- `debug`: []
- `dataloader_drop_last`: False
- `dataloader_num_workers`: 0
- `dataloader_prefetch_factor`: None
- `past_index`: -1
- `disable_tqdm`: False
- `remove_unused_columns`: True
- `label_names`: None
- `load_best_model_at_end`: True
- `ignore_data_skip`: False
- `fsdp`: []
- `fsdp_min_num_params`: 0
- `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
- `fsdp_transformer_layer_cls_to_wrap`: None
- `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
- `deepspeed`: None
- `label_smoothing_factor`: 0.0
- `optim`: adamw_torch
- `optim_args`: None
- `adafactor`: False
- `group_by_length`: False
- `length_column_name`: length
- `ddp_find_unused_parameters`: None
- `ddp_bucket_cap_mb`: None
- `ddp_broadcast_buffers`: False
- `dataloader_pin_memory`: True
- `dataloader_persistent_workers`: False
- `skip_memory_metrics`: True
- `use_legacy_prediction_loop`: False
- `push_to_hub`: False
- `resume_from_checkpoint`: None
- `hub_model_id`: None
- `hub_strategy`: every_save
- `hub_private_repo`: False
- `hub_always_push`: False
- `gradient_checkpointing`: False
- `gradient_checkpointing_kwargs`: None
- `include_inputs_for_metrics`: False
- `include_for_metrics`: []
- `eval_do_concat_batches`: True
- `fp16_backend`: auto
- `push_to_hub_model_id`: None
- `push_to_hub_organization`: None
- `mp_parameters`:
- `auto_find_batch_size`: False
- `full_determinism`: False
- `torchdynamo`: None
- `ray_scope`: last
- `ddp_timeout`: 1800
- `torch_compile`: False
- `torch_compile_backend`: None
- `torch_compile_mode`: None
- `dispatch_batches`: None
- `split_batches`: None
- `include_tokens_per_second`: False
- `include_num_input_tokens_seen`: False
- `neftune_noise_alpha`: None
- `optim_target_modules`: None
- `batch_eval_metrics`: False
- `eval_on_start`: False
- `use_liger_kernel`: False
- `eval_use_gather_object`: False
- `average_tokens_across_devices`: False
- `prompts`: None
- `batch_sampler`: no_duplicates
- `multi_dataset_batch_sampler`: proportional
</details>
### Training Logs
<details><summary>Click to expand</summary>
| Epoch | Step | Training Loss | Validation Loss | eval-dataset_cosine_accuracy | test-dataset_cosine_accuracy |
|:----------:|:--------:|:-------------:|:---------------:|:----------------------------:|:----------------------------:|
| 0 | 0 | - | - | 0.9813 | - |
| 0.0085 | 50 | 1.8471 | - | - | - |
| 0.0169 | 100 | 0.5244 | - | - | - |
| 0.0254 | 150 | 0.2175 | - | - | - |
| 0.0338 | 200 | 0.1392 | - | - | - |
| 0.0423 | 250 | 0.1437 | - | - | - |
| 0.0507 | 300 | 0.142 | - | - | - |
| 0.0592 | 350 | 0.1295 | - | - | - |
| 0.0676 | 400 | 0.1238 | - | - | - |
| 0.0761 | 450 | 0.14 | - | - | - |
| 0.0845 | 500 | 0.1173 | 0.1006 | 0.9931 | - |
| 0.0930 | 550 | 0.1236 | - | - | - |
| 0.1014 | 600 | 0.1127 | - | - | - |
| 0.1099 | 650 | 0.1338 | - | - | - |
| 0.1183 | 700 | 0.1071 | - | - | - |
| 0.1268 | 750 | 0.1149 | - | - | - |
| 0.1352 | 800 | 0.1072 | - | - | - |
| 0.1437 | 850 | 0.1117 | - | - | - |
| 0.1522 | 900 | 0.1087 | - | - | - |
| 0.1606 | 950 | 0.1242 | - | - | - |
| **0.1691** | **1000** | **0.1039** | **0.091** | **0.9965** | **-** |
| 0.1775 | 1050 | 0.1043 | - | - | - |
| 0.1860 | 1100 | 0.1193 | - | - | - |
| 0.1944 | 1150 | 0.1028 | - | - | - |
| 0.2029 | 1200 | 0.1027 | - | - | - |
| 0.2113 | 1250 | 0.1075 | - | - | - |
| 0.2198 | 1300 | 0.1177 | - | - | - |
| 0.2282 | 1350 | 0.0937 | - | - | - |
| 0.2367 | 1400 | 0.1095 | - | - | - |
| 0.2451 | 1450 | 0.1054 | - | - | - |
| 0.2536 | 1500 | 0.1003 | 0.0798 | 0.9958 | - |
| 0.2620 | 1550 | 0.0952 | - | - | - |
| 0.2705 | 1600 | 0.1028 | - | - | - |
| 0.2790 | 1650 | 0.0988 | - | - | - |
| 0.2874 | 1700 | 0.0887 | - | - | - |
| 0.2959 | 1750 | 0.1027 | - | - | - |
| 0.3043 | 1800 | 0.0937 | - | - | - |
| 0.3128 | 1850 | 0.1031 | - | - | - |
| 0.3212 | 1900 | 0.0857 | - | - | - |
| 0.3297 | 1950 | 0.094 | - | - | - |
| 0.3381 | 2000 | 0.1044 | 0.0721 | 0.9954 | - |
| 0.3466 | 2050 | 0.0829 | - | - | - |
| 0.3550 | 2100 | 0.0934 | - | - | - |
| 0.3635 | 2150 | 0.0785 | - | - | - |
| 0.3719 | 2200 | 0.0938 | - | - | - |
| 0.3804 | 2250 | 0.0885 | - | - | - |
| 0.3888 | 2300 | 0.0907 | - | - | - |
| 0.3973 | 2350 | 0.0911 | - | - | - |
| 0.4057 | 2400 | 0.0891 | - | - | - |
| 0.4142 | 2450 | 0.0798 | - | - | - |
| 0.4227 | 2500 | 0.0856 | 0.0655 | 0.9935 | - |
| 0.4311 | 2550 | 0.0925 | - | - | - |
| 0.4396 | 2600 | 0.0778 | - | - | - |
| 0.4480 | 2650 | 0.0871 | - | - | - |
| 0.4565 | 2700 | 0.0769 | - | - | - |
| 0.4649 | 2750 | 0.0815 | - | - | - |
| 0.4734 | 2800 | 0.0697 | - | - | - |
| 0.4818 | 2850 | 0.0714 | - | - | - |
| 0.4903 | 2900 | 0.0788 | - | - | - |
| 0.4987 | 2950 | 0.0772 | - | - | - |
| 0.5072 | 3000 | 0.0825 | 0.0618 | 0.9917 | - |
| 0.5156 | 3050 | 0.0742 | - | - | - |
| 0.5241 | 3100 | 0.0784 | - | - | - |
| 0.5325 | 3150 | 0.0697 | - | - | - |
| 0.5410 | 3200 | 0.0791 | - | - | - |
| 0.5495 | 3250 | 0.0657 | - | - | - |
| 0.5579 | 3300 | 0.0779 | - | - | - |
| 0.5664 | 3350 | 0.0719 | - | - | - |
| 0.5748 | 3400 | 0.0656 | - | - | - |
| 0.5833 | 3450 | 0.0698 | - | - | - |
| 0.5917 | 3500 | 0.0678 | 0.0578 | 0.9903 | - |
| 0.6002 | 3550 | 0.0771 | - | - | - |
| 0.6086 | 3600 | 0.0645 | - | - | - |
| 0.6171 | 3650 | 0.078 | - | - | - |
| 0.6255 | 3700 | 0.064 | - | - | - |
| 0.6340 | 3750 | 0.0691 | - | - | - |
| 0.6424 | 3800 | 0.0634 | - | - | - |
| 0.6509 | 3850 | 0.0732 | - | - | - |
| 0.6593 | 3900 | 0.059 | - | - | - |
| 0.6678 | 3950 | 0.0671 | - | - | - |
| 0.6762 | 4000 | 0.0633 | 0.0552 | 0.9936 | - |
| 0.6847 | 4050 | 0.0732 | - | - | - |
| 0.6932 | 4100 | 0.0593 | - | - | - |
| 0.7016 | 4150 | 0.0639 | - | - | - |
| 0.7101 | 4200 | 0.0672 | - | - | - |
| 0.7185 | 4250 | 0.0604 | - | - | - |
| 0.7270 | 4300 | 0.0666 | - | - | - |
| 0.7354 | 4350 | 0.0594 | - | - | - |
| 0.7439 | 4400 | 0.0783 | - | - | - |
| 0.7523 | 4450 | 0.0654 | - | - | - |
| 0.7608 | 4500 | 0.0596 | 0.0520 | 0.9937 | - |
| 0.7692 | 4550 | 0.0654 | - | - | - |
| 0.7777 | 4600 | 0.0511 | - | - | - |
| 0.7861 | 4650 | 0.0641 | - | - | - |
| 0.7946 | 4700 | 0.0609 | - | - | - |
| 0.8030 | 4750 | 0.0591 | - | - | - |
| 0.8115 | 4800 | 0.0496 | - | - | - |
| 0.8199 | 4850 | 0.0624 | - | - | - |
| 0.8284 | 4900 | 0.0639 | - | - | - |
| 0.8369 | 4950 | 0.056 | - | - | - |
| 0.8453 | 5000 | 0.0641 | 0.0487 | 0.9947 | - |
| 0.8538 | 5050 | 0.0608 | - | - | - |
| 0.8622 | 5100 | 0.0725 | - | - | - |
| 0.8707 | 5150 | 0.055 | - | - | - |
| 0.8791 | 5200 | 0.0556 | - | - | - |
| 0.8876 | 5250 | 0.0489 | - | - | - |
| 0.8960 | 5300 | 0.0513 | - | - | - |
| 0.9045 | 5350 | 0.0493 | - | - | - |
| 0.9129 | 5400 | 0.0574 | - | - | - |
| 0.9214 | 5450 | 0.0665 | - | - | - |
| 0.9298 | 5500 | 0.0588 | 0.0475 | 0.9937 | - |
| 0.9383 | 5550 | 0.0557 | - | - | - |
| 0.9467 | 5600 | 0.0497 | - | - | - |
| 0.9552 | 5650 | 0.0592 | - | - | - |
| 0.9637 | 5700 | 0.0526 | - | - | - |
| 0.9721 | 5750 | 0.0683 | - | - | - |
| 0.9806 | 5800 | 0.0588 | - | - | - |
| 0.9890 | 5850 | 0.0541 | - | - | - |
| 0.9975 | 5900 | 0.0636 | - | - | - |
| 1.0 | 5915 | - | - | - | 0.9964 |
* The bold row denotes the saved checkpoint.
</details>
### Framework Versions
- Python: 3.11.10
- Sentence Transformers: 3.3.0
- Transformers: 4.46.2
- PyTorch: 2.5.1+cu124
- Accelerate: 1.1.1
- Datasets: 3.1.0
- Tokenizers: 0.20.3
## Citation
### BibTeX
#### Sentence Transformers
```bibtex
@inproceedings{reimers-2019-sentence-bert,
title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
author = "Reimers, Nils and Gurevych, Iryna",
booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
month = "11",
year = "2019",
publisher = "Association for Computational Linguistics",
url = "https://arxiv.org/abs/1908.10084",
}
```
#### MultipleNegativesRankingLoss
```bibtex
@misc{henderson2017efficient,
title={Efficient Natural Language Response Suggestion for Smart Reply},
author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
year={2017},
eprint={1705.00652},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
```
<!--
## Glossary
*Clearly define terms in order to be accessible across audiences.*
-->
<!--
## Model Card Authors
*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
-->
<!--
## Model Card Contact
*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
-->