Update README.md
Browse files
README.md
CHANGED
@@ -15,6 +15,9 @@ metrics:
|
|
15 |
---
|
16 |
|
17 |
# TL;DR
|
|
|
|
|
|
|
18 |
|
19 |
Prometheus is a language model using [Llama-2-Chat](https://huggingface.co/meta-llama/Llama-2-13b-chat-hf) as a base model and fine-tuned on 100K feedback within the [Feedback Collection](https://huggingface.co/datasets/kaist-ai/Feedback-Collection).
|
20 |
Since it was fine-tuned on a large amount of feedback, it is specialized at evaluating long-form responses, outperforming GPT-3.5-Turbo, Llama-2-Chat 70B, and on par with GPT-4 on various benchmarks.
|
|
|
15 |
---
|
16 |
|
17 |
# TL;DR
|
18 |
+
Prometheus is an alternative of GPT-4 evaluation when doing fine-grained evaluation of a LLM & a Reward model for Reinforcement Learning from Human Feedback (RLHF).
|
19 |
+
![plot](./finegrained_eval.JPG)
|
20 |
+
|
21 |
|
22 |
Prometheus is a language model using [Llama-2-Chat](https://huggingface.co/meta-llama/Llama-2-13b-chat-hf) as a base model and fine-tuned on 100K feedback within the [Feedback Collection](https://huggingface.co/datasets/kaist-ai/Feedback-Collection).
|
23 |
Since it was fine-tuned on a large amount of feedback, it is specialized at evaluating long-form responses, outperforming GPT-3.5-Turbo, Llama-2-Chat 70B, and on par with GPT-4 on various benchmarks.
|