|
--- |
|
license: apache-2.0 |
|
--- |
|
**OpenHermes-7B-Symbolic** |
|
<img src="https://i.ibb.co/zJJyywL/DALL-E-2023-12-10-22-19-40-A-digital-art-piece-that-creatively-represents-the-famous-Thinking-Man-st.png" width="45%" height="auto"> |
|
|
|
## Model description |
|
OpenHermes-7B-Symbolic is a OpenHermes-2.5-Mistral-7B fine-tuned on 93K comprehensive and meticulously curated samples. |
|
Each sample was structured to facilitate the model's understanding and generation of complex, hierarchical ICD medical coding system. |
|
|
|
## Performance |
|
| Benchmark | OpenHermes-7B-Symbolic | OpenHermes-2.5-Mistral-7B | |
|
|-------------|------------------------|---------------------------| |
|
| Average | 64.44 | 62.92 | |
|
| ARC | 63.14 | 64.93 | |
|
| HellaSwag | 82.73 | 84.18 | |
|
| MMLU | 62.62 | 63.64 | |
|
| TruthfulQA | 48.82 | 52.24 | |
|
| Winogrande | 75.85 | 78.06 | |
|
| GSM8K | 53.45 | 26.08 | |
|
|
