Commit
•
7651aec
1
Parent(s):
683255a
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,23 @@
|
|
| 1 |
-
|
| 2 |
-
|
| 3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
## Installation
|
| 2 |
+
|
| 3 |
+
Use the github repo or install via pip: https://github.com/dleemiller/WordLlama
|
| 4 |
+
```python
|
| 5 |
+
pip install wordllama
|
| 6 |
+
```
|
| 7 |
+
|
| 8 |
+
|
| 9 |
+
## MTEB Results (l2_supercat)
|
| 10 |
+
|
| 11 |
+
| Metric | WL64 | WL128 | WL256 (X) | WL512 | WL1024 | GloVe 300d | Komninos | all-MiniLM-L6-v2 |
|
| 12 |
+
|------------------------|-------------|--------------|--------------|--------------|---------------|------------|----------|------------------|
|
| 13 |
+
| Clustering | 30.27 | 32.20 | 33.25 | 33.40 | 33.62 | 27.73 | 26.57 | 42.35 |
|
| 14 |
+
| Reranking | 50.38 | 51.52 | 52.03 | 52.32 | 52.39 | 43.29 | 44.75 | 58.04 |
|
| 15 |
+
| Classification | 53.14 | 56.25 | 58.21 | 59.13 | 59.50 | 57.29 | 57.65 | 63.05 |
|
| 16 |
+
| Pair Classification | 75.80 | 77.59 | 78.22 | 78.50 | 78.60 | 70.92 | 72.94 | 82.37 |
|
| 17 |
+
| STS | 66.24 | 67.53 | 67.91 | 68.22 | 68.27 | 61.85 | 62.46 | 78.90 |
|
| 18 |
+
| CQA DupStack | 18.76 | 22.54 | 24.12 | 24.59 | 24.83 | 15.47 | 16.79 | 41.32 |
|
| 19 |
+
| SummEval | 30.79 | 29.99 | 30.99 | 29.56 | 29.39 | 28.87 | 30.49 | 30.81 |
|
| 20 |
+
|
| 21 |
+
---
|
| 22 |
+
license: mit
|
| 23 |
+
---
|