DavidGF commited on
Commit
4a77598
1 Parent(s): 33b6f0b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -0
README.md CHANGED
@@ -333,6 +333,17 @@ model
333
  Llama-3-SauerkrautLM-8b-Instruct 7.65625
334
  ```
335
 
 
 
 
 
 
 
 
 
 
 
 
336
 
337
  ## Disclaimer
338
  We must inform users that despite our best efforts in data cleansing, the possibility of uncensored content slipping through cannot be entirely ruled out.
 
333
  Llama-3-SauerkrautLM-8b-Instruct 7.65625
334
  ```
335
 
336
+ **German RAG LLM Evaluation**
337
+ ```
338
+ | Task |Version|Metric|Value| |Stderr|
339
+ |------------------------------------------------------|------:|------|----:|---|-----:|
340
+ |all | |acc |0.905|± |0.0086|
341
+ |community:german_rag_eval:_average:0 | |acc |0.905|± |0.0086|
342
+ |community:german_rag_eval:choose_context_by_question:0| 0|acc |0.896|± |0.0097|
343
+ |community:german_rag_eval:choose_question_by_context:0| 0|acc |0.826|± |0.0120|
344
+ |community:german_rag_eval:context_question_match:0 | 0|acc |0.987|± |0.0036|
345
+ |community:german_rag_eval:question_answer_match:0 | 0|acc |0.911|± |0.0090|
346
+ ```
347
 
348
  ## Disclaimer
349
  We must inform users that despite our best efforts in data cleansing, the possibility of uncensored content slipping through cannot be entirely ruled out.