diff --git "a/README.md" "b/README.md" --- "a/README.md" +++ "b/README.md" @@ -66,23 +66,26 @@ tags: - sentence-similarity - feature-extraction - generated_from_trainer -- dataset_size:21900 +- dataset_size:226010 - loss:CachedGISTEmbedLoss widget: -- source_sentence: temperature in modesto yesterday +- source_sentence: what is the common lifespan of a star sentences: - - Far-sightedness, also known as long-sightedness and hyperopia, is a condition - of the eye in which light is focused behind, instead of on, the retina. This causes - close objects to be blurry, while far objects may appear normal. As the condition - worsens, objects at all distances may be blurred. - - "Manor (/Ë\x88meɪnÉ\x99r/ MAY-ner) is a city in Travis County, Texas, United\ - \ States. Manor is located 12 miles northeast of Austin and is part of the Austin-Round\ - \ Rock metropolitan area. The population was 5,037 at the 2010 census. Manor is\ - \ one of the faster-growing suburbs of Austin." - - 'Modesto Temperature Yesterday. Maximum temperature yesterday: 101 °F (at 3:53 - PM) Minimum temperature yesterday: 66 °F (at 6:53 AM) Average temperature yesterday: - 84 °F. Note: Actual official high and low records may vary slightly from our - data, if they occured in-between our weather recording intervals...' + - Mites can leave bites that look like they came from bed bugs (see these pictures + of bed bug bites), but not all mites are the same, so let me quickly explain. + In fact, there are almost 46,000 species of mites, but only a few bite humans! + They are the Northern Fowl Mite, Tropical Rat Mite, and Itch or Scabies Mite. + - Cost of Cardiac Catheterization Procedures Any type of cardiac care in the United + States is growing increasingly pricey. A cardiac catheterization procedure, depending + on location, may range in price between $2,400 and $4,000 in the United States. + - "Lifespans for main sequence stars have a vast range. Whilst our Sun will spend\ + \ 10 billion years on the main sequence, a high-mass, ten solar-mass (10 M Sun)\ + \ star will only last 20 million years (2.0Ã\x97 10 7 years) on the main sequence.A\ + \ star with a only half the mass of Sun can spend 80 billion years on the main\ + \ sequence.tars are composed almost entirely of hydrogen and helium. A star such\ + \ as our Sun is about 73% hydrogen by mass and 25% helium. If determined by number\ + \ of nuclei then it is 92% hydrogen and 7.8% helium. The remaining 2% by mass\ + \ or 0.2% by number is all the heavier elements." - source_sentence: More than 169 countries had reported over 212,000 COVID-19 cases before March 19 , 2020 . sentences: @@ -96,67 +99,60 @@ widget: - As of 18 March 2020 , more than 212,000 cases of COVID-19 have been reported in at least 170 countries and territories , with major outbreaks in China , Iran and the European Union . -- source_sentence: 'Premiership +- source_sentence: 'The memory walk saw participants gather at Bents Park in South + Shields on Saturday and travel 7km (4.3miles) along a coastal route. - Aberdeen 2-0 Partick Thistle + The Alzheimer''s Society said it was the biggest event of its kind it had staged + in the north-east of England. - Hamilton Academical 1-1 Kilmarnock + Organisers said the number of participants almost doubled that of last year''s + event. - Inverness Caledonian Thistle 2-2 Dundee - - Motherwell 0-3 Heart of Midlothian - - Rangers 1-1 Ross County - - Championship - - Dumbarton 2-2 St Mirren - - Dundee United 3-0 Raith Rovers - - Falkirk 2-0 Dunfermline Athletic - - Hibernian 1-1 Ayr United - - Queen of the South 3-0 Greenock Morton - - St Johnstone 2-5 Celtic' + About 35,000 people in the region have dementia, according to the charity.' sentences: - - Match reports from the weekend Scottish Premiership and Championship matches. - - The car insurance market is "dysfunctional" and does not reward loyal customers, - said the chief executive of Aviva, Mark Wilson. - - A father who died after being assaulted outside a nightclub in Gwynedd has been - named as Henry Ayabowei. + - More than 4,500 people have taken part in a charity event raising funds for the + fight against Alzheimer's disease. + - Gareth Southgate should be appointed England manager "as soon as possible" and + be given the same contract as predecessor Sam Allardyce, says former Three Lions + defender Danny Mills. + - The owners of a Gwynedd skip hire business have been jailed for illegally storing + waste. - source_sentence: Electrical energy can be converted into kinetic energy and heat energy by an electric motor. sentences: - Solution is the term for a homogeneous mixture of two or more substances. - Solution is the term for a homogeneous mixture of two or more substances. - Electric motors transform electrical energy into kinetic energy. -- source_sentence: when is season 2 of the ranch coming to netflix +- source_sentence: who did ben assault in home and away sentences: - - The Ranch (TV series) All episodes are named after American country music songs, - predominantly Kenny Chesney in part one, George Strait in part two, Tim McGraw - in part three, and Garth Brooks in part four:[5] the first ten episodes premiered - on April 1, 2016,[6][7] the second batch of ten episodes premiered on October - 7, 2016. In April 2016, Netflix renewed The Ranch for a second season of 20 episodes,[8][9] - the first half of which premiered on June 16, 2017,[10] and the second half was - released on December 15, 2017.[11] - - The Presidential Agent series The Presidential Agent series was written by military - author, W. E. B. Griffin. The series consists so far of eight novels, By Order - of the President, The Hostage, The Hunters, The Shooters, Black Ops, The Outlaws, - Covert Warriors, and Hazardous Duty. Like the rest of his novels, Griffin uses - military time, along with the address of the place, and the chapter titles are - never started on a separate page. The series is the author's latest. - - Ashley Peacock In 1999, Ashley and Maxine get back together, and finally marry - in September. Ashley also finds out that his uncle, Fred, is actually his biological - father. Fred tells Ashley about Kathleen and her reluctance to be a mother at - a young age. Fred also explains to Ashley that Beryl, who he believed to be his - mother, is actually his aunt, and that Fred let her raise Ashley so he could watch - him grow up. Ashley decides that he wants to meet his birth mother but Fred begs - him not to, believing it would hurt Beryl. Ashley, however, tracks Kathleen down - to her home in Oldham. He is initially very bitter towards her for abandoning - him but they reconcile and Ashley lets Kathleen attend his and Maxine's wedding. + - List of Home and Away characters (2017) Ben and Maggie learn that Ziggy has been + dating Brody in secret and they disapprove of the relationship. Ziggy leaves the + house and Ben tells her not to come back. He apologises to her the next day, but + does not accept her relationship with Brody, so Ziggy refuses to come home. Brody + later breaks up with her. Ben begins making surf boards to sell at the pier. Ben + finds Coco convulsing in the garden and he and Maggie learn she has bulimia. Ziggy + later leaves home. Days later, Ben sees her with Brody, who is attempting to bring + her home, and punches him in the face. Olivia Fraser Richards (Raechelle Banno) + tells Sergeant Phillip McCarthy (Nicholas Cassim) and Ben is arrested. McCarthy + and Kat Chapman (Pia Miller) learns he has a criminal record for assaulting his + brother. Ben insults Kat, which leads to him being charged. Maggie secures a loan + to get him out on bail. Maggie's mother, Diana (Sarah Chadwick) came to Summer + Bay to visit the family and Diana told Ben and Maggie that she is the one who + bailed Ben out of jail. + - 'Stone (unit) The name "stone" derives from the use of stones for weights, a practice + that dates back into antiquity. The Biblical law against the carrying of "diverse + weights, a large and a small"[7] is more literally translated as "you shall not + carry a stone and a stone (אבן ואבן), a large and a small". There was no standardised + "stone" in the ancient Jewish world,[8] but in Roman times stone weights were + crafted to multiples of the Roman pound.[9] Such weights varied in quality: the + Yale Medical Library holds 10 and 50-pound examples of polished serpentine,[10] + while a 40-pound example at the Eschborn Museum (see right) is made of sandstone.[11]' + - Bad Things (Machine Gun Kelly and Camila Cabello song) "Bad Things" is a song + by American rapper Machine Gun Kelly and Cuban-American singer Camila Cabello. + The song was released on October 14, 2016 and was produced by The Futuristics. + Its music video was directed by Hannah Lux Davis and premiered on December 1, + 2016. The song features an interpolation of Fastball's 1999 single "Out of My + Head". The single peaked at number four on the US Billboard Hot 100. model-index: - name: SentenceTransformer based on microsoft/deberta-v3-small results: @@ -168,34 +164,34 @@ model-index: type: sts-test metrics: - type: pearson_cosine - value: 0.033928485348000664 + value: 0.846466596875356 name: Pearson Cosine - type: spearman_cosine - value: 0.08944249572062771 + value: 0.8904026640082261 name: Spearman Cosine - type: pearson_manhattan - value: 0.06296467882181725 + value: 0.8784788599905751 name: Pearson Manhattan - type: spearman_manhattan - value: 0.08266825793291849 + value: 0.8827673246412652 name: Spearman Manhattan - type: pearson_euclidean - value: 0.03489200141716902 + value: 0.8775593452462649 name: Pearson Euclidean - type: spearman_euclidean - value: 0.06202473500014035 + value: 0.8810458375755512 name: Spearman Euclidean - type: pearson_dot - value: 0.2554086617921545 + value: 0.8480375809921659 name: Pearson Dot - type: spearman_dot - value: 0.27863958137561534 + value: 0.8705808575512824 name: Spearman Dot - type: pearson_max - value: 0.2554086617921545 + value: 0.8784788599905751 name: Pearson Max - type: spearman_max - value: 0.27863958137561534 + value: 0.8904026640082261 name: Spearman Max - task: type: triplet @@ -208,7 +204,7 @@ model-index: value: 1.0 name: Cosine Accuracy - type: dot_accuracy - value: 0.125 + value: 0.0 name: Dot Accuracy - type: manhattan_accuracy value: 1.0 @@ -227,109 +223,109 @@ model-index: type: VitaminC metrics: - type: cosine_accuracy - value: 0.55078125 + value: 0.578125 name: Cosine Accuracy - type: cosine_accuracy_threshold - value: 0.9503422379493713 + value: 0.787956714630127 name: Cosine Accuracy Threshold - type: cosine_f1 - value: 0.6542553191489362 + value: 0.6577540106951871 name: Cosine F1 - type: cosine_f1_threshold - value: 0.656802773475647 + value: 0.2885514795780182 name: Cosine F1 Threshold - type: cosine_precision - value: 0.48616600790513836 + value: 0.4900398406374502 name: Cosine Precision - type: cosine_recall value: 1.0 name: Cosine Recall - type: cosine_ap - value: 0.5203148129920425 + value: 0.5535321831241837 name: Cosine Ap - type: dot_accuracy - value: 0.55078125 + value: 0.5703125 name: Dot Accuracy - type: dot_accuracy_threshold - value: 425.30816650390625 + value: 331.16162109375 name: Dot Accuracy Threshold - type: dot_f1 - value: 0.6542553191489362 + value: 0.6577540106951871 name: Dot F1 - type: dot_f1_threshold - value: 262.8174743652344 + value: 112.65699005126953 name: Dot F1 Threshold - type: dot_precision - value: 0.48616600790513836 + value: 0.4900398406374502 name: Dot Precision - type: dot_recall value: 1.0 name: Dot Recall - type: dot_ap - value: 0.5120444819966403 + value: 0.5538572188565111 name: Dot Ap - type: manhattan_accuracy - value: 0.5390625 + value: 0.57421875 name: Manhattan Accuracy - type: manhattan_accuracy_threshold - value: 107.76934814453125 + value: 273.09307861328125 name: Manhattan Accuracy Threshold - type: manhattan_f1 - value: 0.6542553191489362 + value: 0.6577540106951871 name: Manhattan F1 - type: manhattan_f1_threshold - value: 271.5865478515625 + value: 495.97412109375 name: Manhattan F1 Threshold - type: manhattan_precision - value: 0.48616600790513836 + value: 0.4900398406374502 name: Manhattan Precision - type: manhattan_recall value: 1.0 name: Manhattan Recall - type: manhattan_ap - value: 0.5208015383309144 + value: 0.5467997618408617 name: Manhattan Ap - type: euclidean_accuracy - value: 0.55078125 + value: 0.58203125 name: Euclidean Accuracy - type: euclidean_accuracy_threshold - value: 7.050784111022949 + value: 13.288713455200195 name: Euclidean Accuracy Threshold - type: euclidean_f1 - value: 0.6507936507936508 + value: 0.6594594594594595 name: Euclidean F1 - type: euclidean_f1_threshold - value: 17.465972900390625 + value: 22.802650451660156 name: Euclidean F1 Threshold - type: euclidean_precision - value: 0.4823529411764706 + value: 0.4939271255060729 name: Euclidean Precision - type: euclidean_recall - value: 1.0 + value: 0.991869918699187 name: Euclidean Recall - type: euclidean_ap - value: 0.5175301700973289 + value: 0.5502971665088517 name: Euclidean Ap - type: max_accuracy - value: 0.55078125 + value: 0.58203125 name: Max Accuracy - type: max_accuracy_threshold - value: 425.30816650390625 + value: 331.16162109375 name: Max Accuracy Threshold - type: max_f1 - value: 0.6542553191489362 + value: 0.6594594594594595 name: Max F1 - type: max_f1_threshold - value: 271.5865478515625 + value: 495.97412109375 name: Max F1 Threshold - type: max_precision - value: 0.48616600790513836 + value: 0.4939271255060729 name: Max Precision - type: max_recall value: 1.0 name: Max Recall - type: max_ap - value: 0.5208015383309144 + value: 0.5538572188565111 name: Max Ap --- @@ -395,9 +391,9 @@ from sentence_transformers import SentenceTransformer model = SentenceTransformer("bobox/DeBERTa-small-ST-v1-toytest") # Run inference sentences = [ - 'when is season 2 of the ranch coming to netflix', - 'The Ranch (TV series) All episodes are named after American country music songs, predominantly Kenny Chesney in part one, George Strait in part two, Tim McGraw in part three, and Garth Brooks in part four:[5] the first ten episodes premiered on April 1, 2016,[6][7] the second batch of ten episodes premiered on October 7, 2016. In April 2016, Netflix renewed The Ranch for a second season of 20 episodes,[8][9] the first half of which premiered on June 16, 2017,[10] and the second half was released on December 15, 2017.[11]', - "Ashley Peacock In 1999, Ashley and Maxine get back together, and finally marry in September. Ashley also finds out that his uncle, Fred, is actually his biological father. Fred tells Ashley about Kathleen and her reluctance to be a mother at a young age. Fred also explains to Ashley that Beryl, who he believed to be his mother, is actually his aunt, and that Fred let her raise Ashley so he could watch him grow up. Ashley decides that he wants to meet his birth mother but Fred begs him not to, believing it would hurt Beryl. Ashley, however, tracks Kathleen down to her home in Oldham. He is initially very bitter towards her for abandoning him but they reconcile and Ashley lets Kathleen attend his and Maxine's wedding.", + 'who did ben assault in home and away', + "List of Home and Away characters (2017) Ben and Maggie learn that Ziggy has been dating Brody in secret and they disapprove of the relationship. Ziggy leaves the house and Ben tells her not to come back. He apologises to her the next day, but does not accept her relationship with Brody, so Ziggy refuses to come home. Brody later breaks up with her. Ben begins making surf boards to sell at the pier. Ben finds Coco convulsing in the garden and he and Maggie learn she has bulimia. Ziggy later leaves home. Days later, Ben sees her with Brody, who is attempting to bring her home, and punches him in the face. Olivia Fraser Richards (Raechelle Banno) tells Sergeant Phillip McCarthy (Nicholas Cassim) and Ben is arrested. McCarthy and Kat Chapman (Pia Miller) learns he has a criminal record for assaulting his brother. Ben insults Kat, which leads to him being charged. Maggie secures a loan to get him out on bail. Maggie's mother, Diana (Sarah Chadwick) came to Summer Bay to visit the family and Diana told Ben and Maggie that she is the one who bailed Ben out of jail.", + 'Bad Things (Machine Gun Kelly and Camila Cabello song) "Bad Things" is a song by American rapper Machine Gun Kelly and Cuban-American singer Camila Cabello. The song was released on October 14, 2016 and was produced by The Futuristics. Its music video was directed by Hannah Lux Davis and premiered on December 1, 2016. The song features an interpolation of Fastball\'s 1999 single "Out of My Head". The single peaked at number four on the US Billboard Hot 100.', ] embeddings = model.encode(sentences) print(embeddings.shape) @@ -443,16 +439,16 @@ You can finetune this model on your own dataset. | Metric | Value | |:--------------------|:-----------| -| pearson_cosine | 0.0339 | -| **spearman_cosine** | **0.0894** | -| pearson_manhattan | 0.063 | -| spearman_manhattan | 0.0827 | -| pearson_euclidean | 0.0349 | -| spearman_euclidean | 0.062 | -| pearson_dot | 0.2554 | -| spearman_dot | 0.2786 | -| pearson_max | 0.2554 | -| spearman_max | 0.2786 | +| pearson_cosine | 0.8465 | +| **spearman_cosine** | **0.8904** | +| pearson_manhattan | 0.8785 | +| spearman_manhattan | 0.8828 | +| pearson_euclidean | 0.8776 | +| spearman_euclidean | 0.881 | +| pearson_dot | 0.848 | +| spearman_dot | 0.8706 | +| pearson_max | 0.8785 | +| spearman_max | 0.8904 | #### Triplet * Dataset: `NLI-v2` @@ -461,7 +457,7 @@ You can finetune this model on your own dataset. | Metric | Value | |:-------------------|:--------| | cosine_accuracy | 1.0 | -| dot_accuracy | 0.125 | +| dot_accuracy | 0.0 | | manhattan_accuracy | 1.0 | | euclidean_accuracy | 1.0 | | **max_accuracy** | **1.0** | @@ -472,41 +468,41 @@ You can finetune this model on your own dataset. | Metric | Value | |:-----------------------------|:-----------| -| cosine_accuracy | 0.5508 | -| cosine_accuracy_threshold | 0.9503 | -| cosine_f1 | 0.6543 | -| cosine_f1_threshold | 0.6568 | -| cosine_precision | 0.4862 | +| cosine_accuracy | 0.5781 | +| cosine_accuracy_threshold | 0.788 | +| cosine_f1 | 0.6578 | +| cosine_f1_threshold | 0.2886 | +| cosine_precision | 0.49 | | cosine_recall | 1.0 | -| cosine_ap | 0.5203 | -| dot_accuracy | 0.5508 | -| dot_accuracy_threshold | 425.3082 | -| dot_f1 | 0.6543 | -| dot_f1_threshold | 262.8175 | -| dot_precision | 0.4862 | +| cosine_ap | 0.5535 | +| dot_accuracy | 0.5703 | +| dot_accuracy_threshold | 331.1616 | +| dot_f1 | 0.6578 | +| dot_f1_threshold | 112.657 | +| dot_precision | 0.49 | | dot_recall | 1.0 | -| dot_ap | 0.512 | -| manhattan_accuracy | 0.5391 | -| manhattan_accuracy_threshold | 107.7693 | -| manhattan_f1 | 0.6543 | -| manhattan_f1_threshold | 271.5865 | -| manhattan_precision | 0.4862 | +| dot_ap | 0.5539 | +| manhattan_accuracy | 0.5742 | +| manhattan_accuracy_threshold | 273.0931 | +| manhattan_f1 | 0.6578 | +| manhattan_f1_threshold | 495.9741 | +| manhattan_precision | 0.49 | | manhattan_recall | 1.0 | -| manhattan_ap | 0.5208 | -| euclidean_accuracy | 0.5508 | -| euclidean_accuracy_threshold | 7.0508 | -| euclidean_f1 | 0.6508 | -| euclidean_f1_threshold | 17.466 | -| euclidean_precision | 0.4824 | -| euclidean_recall | 1.0 | -| euclidean_ap | 0.5175 | -| max_accuracy | 0.5508 | -| max_accuracy_threshold | 425.3082 | -| max_f1 | 0.6543 | -| max_f1_threshold | 271.5865 | -| max_precision | 0.4862 | +| manhattan_ap | 0.5468 | +| euclidean_accuracy | 0.582 | +| euclidean_accuracy_threshold | 13.2887 | +| euclidean_f1 | 0.6595 | +| euclidean_f1_threshold | 22.8027 | +| euclidean_precision | 0.4939 | +| euclidean_recall | 0.9919 | +| euclidean_ap | 0.5503 | +| max_accuracy | 0.582 | +| max_accuracy_threshold | 331.1616 | +| max_f1 | 0.6595 | +| max_f1_threshold | 495.9741 | +| max_precision | 0.4939 | | max_recall | 1.0 | -| **max_ap** | **0.5208** | +| **max_ap** | **0.5539** |