shrijayan's picture
Upload folder using huggingface_hub
41b0d7b verified
---
language:
- en
license: apache-2.0
tags:
- sentence-transformers
- sentence-similarity
- feature-extraction
- generated_from_trainer
- dataset_size:800
- loss:MultipleNegativesRankingLoss
base_model: intfloat/e5-base-v2
widget:
- source_sentence: For the following multiple choice question, select one correct
answer. Let s think step by step. Question In a postoperative patient with a urinary
diversion, the nurse should monitor the urine volume every hour. Below how many
ml h of urine may indicate that the patient is dehydrated or has some type of
internal obstruction or loss ? Options A. 200 ml h. B. 100 ml h. C. 80 ml h. D.
50 ml h. E. 30 ml h.
sentences:
- Our approach shows that gene expression can be explained by a modest number of
co localized transcription factors, however, information on cell type specific
binding is crucial for understanding combinatorial gene regulation.
- We have developed a rapid, simple, sensitive and specific method to quantify β
antithrombin activity using 1μL of plasma. β antithrombin significantly increases
in patients with ischemic cerebrovascular disease during the acute event, probably
by its release from the vasculature.
- A postoperative patient with a urinary diversion requires close monitoring of
urine output to ensure that the diversion is functioning properly and that the
patient is not experiencing any complications. Monitoring urine volume every hour
is a crucial aspect of postoperative care in this scenario. To determine the correct
answer, let s analyze each option A. 200 ml h This is a relatively high urine
output, and it would not typically indicate dehydration or internal obstruction.
In fact, a urine output of 200 ml h is generally considered adequate and may even
be higher than the average urine output for a healthy adult. B. 100 ml h This
is also a relatively high urine output and would not typically indicate dehydration
or internal obstruction. A urine output of 100 ml h is still within the normal
range and would not raise concerns about dehydration or obstruction. C. 80 ml
h While this is a slightly lower urine output, it is still within the normal range
and would not necessarily indicate dehydration or internal obstruction. D. 50
ml h This is a lower urine output, and it may start to raise concerns about dehydration
or internal obstruction. However, it is still not the lowest option, and the nurse
may need to consider other factors before determining the cause of the low urine
output. E. 30 ml h This is the lowest urine output option, and it would likely
indicate that the patient is dehydrated or has some type of internal obstruction
or loss. A urine output of 30 ml h is generally considered low and would require
immediate attention from the nurse to determine the cause and take corrective
action. Considering the options, the correct answer is E. 30 ml h. A urine output
of 30 ml h is a critical threshold that may indicate dehydration or internal obstruction,
and the nurse should take immediate action to assess the patient s fluid status
and the functioning of the urinary diversion. Answer E.
- source_sentence: In tumor lysis syndrome all of the following are seen except
sentences:
- The results indicated that some polymorphic variations of drug metabolic and transporter
genes may be potential biomarkers for clinical outcome of gemcitabine based therapy
in patients with locally advanced pancreatic cancer.
- Variations in the prevalence of depressive symptoms occurred between centres,
not always related to levels of illness. There was no consistent relationship
between proportions of symptoms in well persons and cases for all centres. Few
symptoms were present in 60 of the older population stereotypes of old age were
not upheld.
- Tumor lysis syndrome Caused by destruction of large number of rapidly proliferating
neoplastic cells. It frequently leads to ARF It is characterized by Hypocalcemia
Hyperkalemia Lactic acidosis Hyperuricemia Hyperphosphatemia Most frequently associated
with treatment of Burkitt lymphoma ALL CLL Solid tumors
- source_sentence: Does prevalence of central venous occlusion in patients with chronic
defibrillator lead?
sentences:
- Intraoperative small dose IV haloperidol is effective against post operative nausea
and vomiting with no significant effect on overall QoR. It may also attenuate
the analgesic effects of morphine PCA.
- Intubation is generally done with the help of endotracheal tube ETT . The internal
diameter of ETT used ranges between 3 and 8 mm depending on the age, sex, and
size of nares of the patient. Potex north and south polar performed Rae tubes
RAE right angled ETT and flexo metallic tubes are commonly used. Out of them,
North Pole Rae tube is preferred in case of ankylosis patient due to the direction
of the curve of ETT which favors its placement in restricted mouth opening as
in case of ankylosis.
- The low prevalence of subclavian vein occlusion or severe stenosis among defibrillator
recipients found in this study suggests that the placement of additional transvenous
leads in a patient who already has a ventricular defibrillator is feasible in
a high percentage of patients 93 .
- source_sentence: Is mode of presentation of B3 breast core biopsies screen detected
or symptomatic a distinguishing factor in the final histopathologic result or
risk of diagnosis of malignancy?
sentences:
- This observation may indicate a considerable difference in cardiovascular risk
between genotype groups as a result of an increase in FVIIa after a fat rich diet.
- Mode of patient presentation with a screen detected or symptomatic lesion was
not a distinguishing factor for breast histopathologic subclassification or for
the final cancer diagnosis in patients whose breast core biopsy was classified
as B3.
- Ans. is a i.e., Apaf 1o One of these proteins is cytochrome c, well known for
its role in mitochondrial respiration. In the cytosol, cytochrome C binds to a
protein called Apaf 1 apoptosis activating factor 1 , and the complex activates
caspase 9. Bc1 2 and Bcl x may also directly inhibit Apaf 1 activation, and their
loss from cells may permit activation of Apaf 1 .
- source_sentence: Is the Danish National Hospital Register a valuable study base
for epidemiologic research in febrile seizures?
sentences:
- Interstitial cystitis IC is a condition that causes discomfort or pain in the
bladder and a need to urinate frequently and urgently. It is far more common in
women than in men. The symptoms vary from person to person. Some people may have
pain without urgency or frequency. Others have urgency and frequency without pain.
Women s symptoms often get worse during their periods. They may also have pain
with sexual intercourse. The cause of IC isn t known. There is no one test to
tell if you have it. Doctors often run tests to rule out other possible causes
of symptoms. There is no cure for IC, but treatments can help most people feel
better. They include Distending, or inflating, the bladder Bathing the inside
of the bladder with a drug solution Oral medicines Electrical nerve stimulation
Physical therapy Lifestyle changes Bladder training In rare cases, surgery NIH
National Institute of Diabetes and Digestive and Kidney Diseases
- Ans. is c i.e., Presence of depression Good prognostic factors Acute onset late
onset onset after 35 years of age Presence of precipitating stressor Good premorbid
adjustment catatonic best prognosis Paranoid 2nd best sho duration 6 months Married
Positive symptoms Presence of depression family history of mood disorder first
episode pyknic fat physique female sex good treatment compliance good response
to treatment good social suppo presence of confusion or perplexity normal brain
CT Scan outpatient treatment.
- The Danish National Hospital Register is a valuable tool for epidemiologic research
in febrile seizures.
pipeline_tag: sentence-similarity
library_name: sentence-transformers
metrics:
- cosine_accuracy
model-index:
- name: MPNet base trained on AllNLI triplets
results:
- task:
type: triplet
name: Triplet
dataset:
name: eval dataset
type: eval-dataset
metrics:
- type: cosine_accuracy
value: 1.0
name: Cosine Accuracy
- task:
type: triplet
name: Triplet
dataset:
name: test dataset
type: test-dataset
metrics:
- type: cosine_accuracy
value: 0.97
name: Cosine Accuracy
---
# MPNet base trained on AllNLI triplets
This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [intfloat/e5-base-v2](https://huggingface.co/intfloat/e5-base-v2). It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
## Model Details
### Model Description
- **Model Type:** Sentence Transformer
- **Base model:** [intfloat/e5-base-v2](https://huggingface.co/intfloat/e5-base-v2) <!-- at revision 1c644c92ad3ba1efdad3f1451a637716616a20e8 -->
- **Maximum Sequence Length:** 512 tokens
- **Output Dimensionality:** 768 dimensions
- **Similarity Function:** Cosine Similarity
<!-- - **Training Dataset:** Unknown -->
- **Language:** en
- **License:** apache-2.0
### Model Sources
- **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
- **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers)
- **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers)
### Full Model Architecture
```
SentenceTransformer(
(0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel
(1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
(2): Normalize()
)
```
## Usage
### Direct Usage (Sentence Transformers)
First install the Sentence Transformers library:
```bash
pip install -U sentence-transformers
```
Then you can load this model and run inference.
```python
from sentence_transformers import SentenceTransformer
# Download from the 🤗 Hub
model = SentenceTransformer("sentence_transformers_model_id")
# Run inference
sentences = [
'Is the Danish National Hospital Register a valuable study base for epidemiologic research in febrile seizures?',
'The Danish National Hospital Register is a valuable tool for epidemiologic research in febrile seizures.',
'Ans. is c i.e., Presence of depression Good prognostic factors Acute onset late onset onset after 35 years of age Presence of precipitating stressor Good premorbid adjustment catatonic best prognosis Paranoid 2nd best sho duration 6 months Married Positive symptoms Presence of depression family history of mood disorder first episode pyknic fat physique female sex good treatment compliance good response to treatment good social suppo presence of confusion or perplexity normal brain CT Scan outpatient treatment.',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 768]
# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]
```
<!--
### Direct Usage (Transformers)
<details><summary>Click to see the direct usage in Transformers</summary>
</details>
-->
<!--
### Downstream Usage (Sentence Transformers)
You can finetune this model on your own dataset.
<details><summary>Click to expand</summary>
</details>
-->
<!--
### Out-of-Scope Use
*List how the model may foreseeably be misused and address what users ought not to do with the model.*
-->
## Evaluation
### Metrics
#### Triplet
* Datasets: `eval-dataset` and `test-dataset`
* Evaluated with [<code>TripletEvaluator</code>](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#sentence_transformers.evaluation.TripletEvaluator)
| Metric | eval-dataset | test-dataset |
|:--------------------|:-------------|:-------------|
| **cosine_accuracy** | **1.0** | **0.97** |
<!--
## Bias, Risks and Limitations
*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
-->
<!--
### Recommendations
*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
-->
## Training Details
### Training Dataset
#### Unnamed Dataset
* Size: 800 training samples
* Columns: <code>sentence1</code>, <code>sentence2</code>, and <code>label</code>
* Approximate statistics based on the first 800 samples:
| | sentence1 | sentence2 | label |
|:--------|:-----------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------|:--------------------------------------------------------------|
| type | string | string | float |
| details | <ul><li>min: 5 tokens</li><li>mean: 22.88 tokens</li><li>max: 205 tokens</li></ul> | <ul><li>min: 4 tokens</li><li>mean: 81.77 tokens</li><li>max: 512 tokens</li></ul> | <ul><li>min: 1.0</li><li>mean: 1.0</li><li>max: 1.0</li></ul> |
* Samples:
| sentence1 | sentence2 | label |
|:------------------------------------------------------------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:-----------------|
| <code>Triad of biotin deficiency is</code> | <code>Dermatitis, glossitis, Alopecia 407 H 314 Basic pathology 8th Biotin deficiency clinical features Adult Mental changes depression, hallucination , paresthesia, anorexia, nausea, A scaling, seborrheic and erythematous rash may occur around the eye, nose, mouth, as well as extremities 407 H Infant hypotonia, lethargy, apathy, alopecia and a characteristic rash that includes the ears.Symptoms of biotin deficiency includes Anaemia, loss of apepite dermatitis, glossitis 150 U. Satyanarayan Symptoms of biotin deficiency Dermatitis spectacle eyed appearance due to circumocular alopecia, pallor of skin membrane, depression, Lassitude, somnolence, anemia and hypercholesterolaemia 173 Rana Shinde 6th</code> | <code>1.0</code> |
| <code>Drug responsible for the below condition</code> | <code>Thalidomide given to pregnant lady can lead to hypoplasia of limbs called as Phocomelia .</code> | <code>1.0</code> |
| <code>Is benefit from procarbazine , lomustine , and vincristine in oligodendroglial tumors associated with mutation of IDH?</code> | <code>IDH mutational status identified patients with oligodendroglial tumors who did and did not benefit from alkylating agent chemotherapy with RT. Although patients with codeleted tumors lived longest, patients with noncodeleted IDH mutated tumors also lived longer after CRT.</code> | <code>1.0</code> |
* Loss: [<code>MultipleNegativesRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
```json
{
"scale": 20.0,
"similarity_fct": "cos_sim"
}
```
### Evaluation Dataset
#### Unnamed Dataset
* Size: 100 evaluation samples
* Columns: <code>question</code>, <code>answer</code>, and <code>hard_negative</code>
* Approximate statistics based on the first 100 samples:
| | question | answer | hard_negative |
|:--------|:-----------------------------------------------------------------------------------|:------------------------------------------------------------------------------------|:-------------------|
| type | string | string | NoneType |
| details | <ul><li>min: 5 tokens</li><li>mean: 22.52 tokens</li><li>max: 103 tokens</li></ul> | <ul><li>min: 10 tokens</li><li>mean: 83.51 tokens</li><li>max: 403 tokens</li></ul> | <ul><li></li></ul> |
* Samples:
| question | answer | hard_negative |
|:-----------------------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:------------------|
| <code>Hutchinsons secondaries In skull are due to tumors in</code> | <code>Adrenal neuroblastomas are malig8nant neoplasms arising from sympathetic neuroblsts in Medulla of adrenal gland Neuroblastoma is a cancer that develops from immature nerve cells found in several areas of the body.Neuroblastoma most commonly arises in and around the adrenalglands, which have similar origins to nerve cells and sit atop the kidneys.</code> | <code>None</code> |
| <code>Proliferative glomerular deposits in the kidney are found in</code> | <code>IgA nephropathy or Berger s disease immune complex mediated glomerulonephritis defined by the presence of diffuse mesangial IgA deposits often associated with mesangial hypercellularity. Male preponderance, peak incidence in the second and third decades of life.Clinical and laboratory findings Two most common presentations recurrent episodes of macroscopic hematuria during or immediately following an upper respiratory infection often accompanied by proteinuria or persistent asymptomatic microscopic hematuriaIgA deposited in the mesangium is typically polymeric and of the IgA1 subclass. IgM, IgG, C3, or immunoglobulin light chains may be codistributed with IgAPresence of elevated serum IgA levels in 20 50 of patients, IgA deposition in skin biopsies in 15 55 of patients, elevated levels of secretory IgA and IgA fibronectin complexesIgA nephropathy is a benign disease mostly, 5 30 of patients go into a complete remission, with others having hematuria but well preserved renal functionAbou...</code> | <code>None</code> |
| <code>Does meconium aspiration induce oxidative injury in the hippocampus of newborn piglets?</code> | <code>Our data thus suggest that oxidative injury associated with pulmonary, but not systemic, hemodynamic disturbances may contribute to hippocampal damage after meconium aspiration in newborns.</code> | <code>None</code> |
* Loss: [<code>MultipleNegativesRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
```json
{
"scale": 20.0,
"similarity_fct": "cos_sim"
}
```
### Training Hyperparameters
#### Non-Default Hyperparameters
- `do_predict`: True
- `eval_strategy`: steps
- `per_device_train_batch_size`: 16
- `per_device_eval_batch_size`: 16
- `num_train_epochs`: 1
- `warmup_ratio`: 0.1
- `fp16`: True
- `load_best_model_at_end`: True
- `batch_sampler`: no_duplicates
#### All Hyperparameters
<details><summary>Click to expand</summary>
- `overwrite_output_dir`: False
- `do_predict`: True
- `eval_strategy`: steps
- `prediction_loss_only`: True
- `per_device_train_batch_size`: 16
- `per_device_eval_batch_size`: 16
- `per_gpu_train_batch_size`: None
- `per_gpu_eval_batch_size`: None
- `gradient_accumulation_steps`: 1
- `eval_accumulation_steps`: None
- `torch_empty_cache_steps`: None
- `learning_rate`: 5e-05
- `weight_decay`: 0.0
- `adam_beta1`: 0.9
- `adam_beta2`: 0.999
- `adam_epsilon`: 1e-08
- `max_grad_norm`: 1.0
- `num_train_epochs`: 1
- `max_steps`: -1
- `lr_scheduler_type`: linear
- `lr_scheduler_kwargs`: {}
- `warmup_ratio`: 0.1
- `warmup_steps`: 0
- `log_level`: passive
- `log_level_replica`: warning
- `log_on_each_node`: True
- `logging_nan_inf_filter`: True
- `save_safetensors`: True
- `save_on_each_node`: False
- `save_only_model`: False
- `restore_callback_states_from_checkpoint`: False
- `no_cuda`: False
- `use_cpu`: False
- `use_mps_device`: False
- `seed`: 42
- `data_seed`: None
- `jit_mode_eval`: False
- `use_ipex`: False
- `bf16`: False
- `fp16`: True
- `fp16_opt_level`: O1
- `half_precision_backend`: auto
- `bf16_full_eval`: False
- `fp16_full_eval`: False
- `tf32`: None
- `local_rank`: 0
- `ddp_backend`: None
- `tpu_num_cores`: None
- `tpu_metrics_debug`: False
- `debug`: []
- `dataloader_drop_last`: False
- `dataloader_num_workers`: 0
- `dataloader_prefetch_factor`: None
- `past_index`: -1
- `disable_tqdm`: False
- `remove_unused_columns`: True
- `label_names`: None
- `load_best_model_at_end`: True
- `ignore_data_skip`: False
- `fsdp`: []
- `fsdp_min_num_params`: 0
- `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
- `fsdp_transformer_layer_cls_to_wrap`: None
- `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
- `deepspeed`: None
- `label_smoothing_factor`: 0.0
- `optim`: adamw_torch
- `optim_args`: None
- `adafactor`: False
- `group_by_length`: False
- `length_column_name`: length
- `ddp_find_unused_parameters`: None
- `ddp_bucket_cap_mb`: None
- `ddp_broadcast_buffers`: False
- `dataloader_pin_memory`: True
- `dataloader_persistent_workers`: False
- `skip_memory_metrics`: True
- `use_legacy_prediction_loop`: False
- `push_to_hub`: False
- `resume_from_checkpoint`: None
- `hub_model_id`: None
- `hub_strategy`: every_save
- `hub_private_repo`: False
- `hub_always_push`: False
- `gradient_checkpointing`: False
- `gradient_checkpointing_kwargs`: None
- `include_inputs_for_metrics`: False
- `include_for_metrics`: []
- `eval_do_concat_batches`: True
- `fp16_backend`: auto
- `push_to_hub_model_id`: None
- `push_to_hub_organization`: None
- `mp_parameters`:
- `auto_find_batch_size`: False
- `full_determinism`: False
- `torchdynamo`: None
- `ray_scope`: last
- `ddp_timeout`: 1800
- `torch_compile`: False
- `torch_compile_backend`: None
- `torch_compile_mode`: None
- `dispatch_batches`: None
- `split_batches`: None
- `include_tokens_per_second`: False
- `include_num_input_tokens_seen`: False
- `neftune_noise_alpha`: None
- `optim_target_modules`: None
- `batch_eval_metrics`: False
- `eval_on_start`: False
- `use_liger_kernel`: False
- `eval_use_gather_object`: False
- `average_tokens_across_devices`: False
- `prompts`: None
- `batch_sampler`: no_duplicates
- `multi_dataset_batch_sampler`: proportional
</details>
### Training Logs
| Epoch | Step | eval-dataset_cosine_accuracy | test-dataset_cosine_accuracy |
|:-----:|:----:|:----------------------------:|:----------------------------:|
| 0 | 0 | 1.0 | - |
| 1.0 | 25 | - | 0.97 |
### Framework Versions
- Python: 3.11.10
- Sentence Transformers: 3.3.0
- Transformers: 4.46.2
- PyTorch: 2.5.1+cu124
- Accelerate: 1.1.1
- Datasets: 3.1.0
- Tokenizers: 0.20.3
## Citation
### BibTeX
#### Sentence Transformers
```bibtex
@inproceedings{reimers-2019-sentence-bert,
title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
author = "Reimers, Nils and Gurevych, Iryna",
booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
month = "11",
year = "2019",
publisher = "Association for Computational Linguistics",
url = "https://arxiv.org/abs/1908.10084",
}
```
#### MultipleNegativesRankingLoss
```bibtex
@misc{henderson2017efficient,
title={Efficient Natural Language Response Suggestion for Smart Reply},
author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
year={2017},
eprint={1705.00652},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
```
<!--
## Glossary
*Clearly define terms in order to be accessible across audiences.*
-->
<!--
## Model Card Authors
*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
-->
<!--
## Model Card Contact
*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
-->