Update README.md
Browse files
README.md
CHANGED
@@ -127,7 +127,7 @@ All 3 models here are trained using the same configuration with differing FIM hy
|
|
127 |
|
128 |
|
129 |
|
130 |
-
Here HumanEval-infilling is reported as Pass@10 with a temperature of 0.8 (such that 100
|
131 |
|
132 |
|
133 |
These results are subject to change, but appear to indicate that AliBi with FIM does not enable infilling, while rotary positional embeddings do allow for infilling to be learned.
|
|
|
127 |
|
128 |
|
129 |
|
130 |
+
Here HumanEval-infilling is reported as Pass@10 with a temperature of 0.8 (such that 100 times the score reported here = Pass@10 as a percentage), Lambada is reported as perplexity, and all other benchmarks report accuracy as a number between 0 and 1.
|
131 |
|
132 |
|
133 |
These results are subject to change, but appear to indicate that AliBi with FIM does not enable infilling, while rotary positional embeddings do allow for infilling to be learned.
|