Kwaipilot
/

OASIS-code-1.3B

Sentence Similarity

sentence-transformers

feature-extraction

Inference Endpoints

Model card Files Files and versions Community

Zuchen commited on 7 days ago

Commit

215abfa

•

1 Parent(s): 6cf84de

Update README.md

Files changed (1) hide show

README.md +7 -7

README.md CHANGED Viewed

@@ -39,13 +39,13 @@ Kwaipilot upcoming initiatives include:
 ## Performance
-|                 | Size | CoSQA | AdvTest | CSN-Py | CSN-Ja  | CSN-JS    | CSN-PHP   | CSN-Go    | CSN-Ruby  |
-|-----------------|:-----:|:------:|:---------:|:--------:|:-------:|:-------:|:-------:|:-------:|:-------:|
-|Openai-Embedding-Ada-002 | Unknown  | 0.4423| 0.3808  | 0.6802 | 0.7149| 0.6750| 0.6062| 0.8563| 0.7472|
-|jina-embeddings-v2-base-code | 161M |0.6837 |0.385    | 0.6634	| 0.6803| 0.6304| 0.5701| 0.8595| 0.7095|
-| CodeSage-large          | 1.3B     | 0.4753| 0.5267  | 0.7077 | 0.7021| 0.695 | 0.6133| 0.8371| 0.7192|
-| CodeFuse-CGE-Small      | 3.8B     | 0.5619| 0.4639  | 0.6958 | 0.6863| 0.6564| 0.6133| 0.8637| 0.7341|
-| OASIS-1.3B              | 1.3B     | 0.5532| 0.4861  | 0.7110  | 0.7199| 0.6727| 0.6217| 0.8732| 0.7333|
 ## Usage

 ## Performance
+|                 | Size | CoSQA | AdvTest | CSN-Py | CSN-Ja  | CSN-JS    | CSN-PHP   | CSN-Go    | CSN-Ruby  | Avg|
+|-----------------|:-----:|:------:|:---------:|:--------:|:-------:|:-------:|:-------:|:-------:|:-------:|:-------:|
+|Openai-Embedding-Ada-002 | Unknown  | 0.4423| 0.3808  | 0.6802 | 0.7149| 0.6750| 0.6062| 0.8563| **0.7472**|0.6378|
+|jina-embeddings-v2-base-code | 161M |**0.6837** |0.385    | 0.6634	| 0.6803| 0.6304| 0.5701| 0.8595| 0.7095|0.6477|
+| CodeSage-large          | 1.3B     | 0.4753| **0.5267**  | 0.7077 | 0.7021| **0.695** | 0.6133| 0.8371| 0.7192|0.6595|
+| CodeFuse-CGE-Small      | 3.8B     | 0.5619| 0.4639  | 0.6958 | 0.6863| 0.6564| 0.6133| 0.8637| 0.7341|0.6594|
+| OASIS-1.3B              | 1.3B     | 0.5532| 0.4861  | **0.7110**  | **0.7199**| 0.6727| **0.6217**| **0.8732**| 0.7333|**0.6713**|
 ## Usage