Update README.md
Browse files
README.md
CHANGED
@@ -333,6 +333,17 @@ model
|
|
333 |
Llama-3-SauerkrautLM-8b-Instruct 7.65625
|
334 |
```
|
335 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
336 |
|
337 |
## Disclaimer
|
338 |
We must inform users that despite our best efforts in data cleansing, the possibility of uncensored content slipping through cannot be entirely ruled out.
|
|
|
333 |
Llama-3-SauerkrautLM-8b-Instruct 7.65625
|
334 |
```
|
335 |
|
336 |
+
**German RAG LLM Evaluation**
|
337 |
+
```
|
338 |
+
| Task |Version|Metric|Value| |Stderr|
|
339 |
+
|------------------------------------------------------|------:|------|----:|---|-----:|
|
340 |
+
|all | |acc |0.905|± |0.0086|
|
341 |
+
|community:german_rag_eval:_average:0 | |acc |0.905|± |0.0086|
|
342 |
+
|community:german_rag_eval:choose_context_by_question:0| 0|acc |0.896|± |0.0097|
|
343 |
+
|community:german_rag_eval:choose_question_by_context:0| 0|acc |0.826|± |0.0120|
|
344 |
+
|community:german_rag_eval:context_question_match:0 | 0|acc |0.987|± |0.0036|
|
345 |
+
|community:german_rag_eval:question_answer_match:0 | 0|acc |0.911|± |0.0090|
|
346 |
+
```
|
347 |
|
348 |
## Disclaimer
|
349 |
We must inform users that despite our best efforts in data cleansing, the possibility of uncensored content slipping through cannot be entirely ruled out.
|