DontPlanToEnd commited on
Commit
90bde65
1 Parent(s): 2cb801d

Update app.py

Browse files
Files changed (1) hide show
  1. app.py +2 -0
app.py CHANGED
@@ -113,6 +113,8 @@ with GraInter:
113
  **UGI: Uncensored General Intelligence**. A measurement of the amount of uncensored/controversial information an LLM knows about. It is calculated from the average score of 5 subjects LLMs commonly refuse to talk about. The leaderboard is made of roughly 60 questions/tasks, measuring both "willingness to answer" and "accuracy" in controversial fact-based questions. I'm choosing to keep the questions private so people can't train on them and devalue the leaderboard.
114
 
115
  **W/10:** A more narrow, 10-point score, solely measuring the LLM's Willingness to answer the most controversial questions.
 
 
116
 
117
  **Unruly:** Knowledge of activities that are generally frowned upon.
118
 
 
113
  **UGI: Uncensored General Intelligence**. A measurement of the amount of uncensored/controversial information an LLM knows about. It is calculated from the average score of 5 subjects LLMs commonly refuse to talk about. The leaderboard is made of roughly 60 questions/tasks, measuring both "willingness to answer" and "accuracy" in controversial fact-based questions. I'm choosing to keep the questions private so people can't train on them and devalue the leaderboard.
114
 
115
  **W/10:** A more narrow, 10-point score, solely measuring the LLM's Willingness to answer the most controversial questions.
116
+
117
+ A high UGI but low W/10 could mean for example that the model can provide a lot of sensitive information, but will refuse to form the information into a malicious argument.
118
 
119
  **Unruly:** Knowledge of activities that are generally frowned upon.
120