DontPlanToEnd commited on
Commit
7a29403
1 Parent(s): 6c39896

Update app.py

Browse files
Files changed (1) hide show
  1. app.py +1 -1
app.py CHANGED
@@ -112,7 +112,7 @@ with GraInter:
112
  gr.Markdown("""
113
  **UGI: Uncensored General Intelligence**. A measurement of the amount of uncensored/controversial information an LLM knows. It is calculated from the average score of 5 subjects LLMs commonly refuse to talk about. The leaderboard is made of roughly 60 questions/tasks, measuring both "willingness to answer" and "accuracy" in controversial fact-based questions. I'm choosing to keep the questions private so people can't train on them and devalue the leaderboard.
114
 
115
- **W/10:** A more narrow, 10-point score, solely measuring the LLM's Willingness to answer the most controversial questions.
116
 
117
  A high UGI but low W/10 could mean for example that the model can provide a lot of sensitive information, but will refuse to form the information into a malicious argument.
118
  <br><br>
 
112
  gr.Markdown("""
113
  **UGI: Uncensored General Intelligence**. A measurement of the amount of uncensored/controversial information an LLM knows. It is calculated from the average score of 5 subjects LLMs commonly refuse to talk about. The leaderboard is made of roughly 60 questions/tasks, measuring both "willingness to answer" and "accuracy" in controversial fact-based questions. I'm choosing to keep the questions private so people can't train on them and devalue the leaderboard.
114
 
115
+ **W/10:** Willingness/10. A more narrow, 10-point score, solely measuring how far the model can be pushed before refusing to answer.
116
 
117
  A high UGI but low W/10 could mean for example that the model can provide a lot of sensitive information, but will refuse to form the information into a malicious argument.
118
  <br><br>