hails commited on
Commit
51a5f31
1 Parent(s): 4f3e5b7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -127,7 +127,7 @@ All 3 models here are trained using the same configuration with differing FIM hy
127
 
128
 
129
 
130
- Here HumanEval-infilling is reported as Pass@10 with a temperature of 0.8 (such that 100 \* the score reported here = Pass@10 as a percentage), Lambada is reported as perplexity, and all other benchmarks report accuracy as a number between 0 and 1.
131
 
132
 
133
  These results are subject to change, but appear to indicate that AliBi with FIM does not enable infilling, while rotary positional embeddings do allow for infilling to be learned.
 
127
 
128
 
129
 
130
+ Here HumanEval-infilling is reported as Pass@10 with a temperature of 0.8 (such that 100 times the score reported here = Pass@10 as a percentage), Lambada is reported as perplexity, and all other benchmarks report accuracy as a number between 0 and 1.
131
 
132
 
133
  These results are subject to change, but appear to indicate that AliBi with FIM does not enable infilling, while rotary positional embeddings do allow for infilling to be learned.