Update index.html
Browse files- index.html +10 -12
index.html
CHANGED
@@ -37,7 +37,8 @@
|
|
37 |
<a href="https://huggingface.co/datasets/openai_humaneval" target="_blank">HumanEval</a> and
|
38 |
<a href="https://github.com/YihongDong/CodeGenEvaluation" target="_blank">HumanEval-ET</a> benchamrk. We also measure Memorization-Generalization Index and
|
39 |
provide information about the models.
|
40 |
-
We compare both open and closed pre-trained code models, that people can start from as base models for
|
|
|
41 |
</p>
|
42 |
</div>
|
43 |
</section>
|
@@ -53,18 +54,17 @@
|
|
53 |
<div class="section_evalTable__table">
|
54 |
<table id="evalTable">
|
55 |
<colgroup>
|
56 |
-
|
57 |
-
<col style="width:
|
58 |
-
<col style="width:
|
59 |
-
<col style="width:
|
60 |
-
<col style="width:
|
61 |
-
<col style="width:
|
62 |
-
<col style="width: 16%">
|
63 |
</colgroup>
|
64 |
|
65 |
<thead>
|
66 |
<!-- <th rowspan="2">Benchmark</th> -->
|
67 |
-
<th rowspan="2"
|
68 |
<button class="button_sort" data-direction="desc" data-type="name"></button>
|
69 |
</th>
|
70 |
<th data-direction="desc" rowspan="2" data-type="MGI">MGI
|
@@ -100,9 +100,7 @@
|
|
100 |
<p><strong>Notes</strong>
|
101 |
<p>
|
102 |
<ul>
|
103 |
-
<li>MGI stands for Memorization-Generalization Index,
|
104 |
-
which is derived from Avg. Peak in the original paper.
|
105 |
-
A higher MGI value indicates a greater propensity for a model to engage in memorization as opposed to generalization.</li>
|
106 |
<li>For more details check the π About section.</li>
|
107 |
</ul>
|
108 |
</div>
|
|
|
37 |
<a href="https://huggingface.co/datasets/openai_humaneval" target="_blank">HumanEval</a> and
|
38 |
<a href="https://github.com/YihongDong/CodeGenEvaluation" target="_blank">HumanEval-ET</a> benchamrk. We also measure Memorization-Generalization Index and
|
39 |
provide information about the models.
|
40 |
+
We compare both open and closed pre-trained code models, that people can start from as base models for
|
41 |
+
their trainings.
|
42 |
</p>
|
43 |
</div>
|
44 |
</section>
|
|
|
54 |
<div class="section_evalTable__table">
|
55 |
<table id="evalTable">
|
56 |
<colgroup>
|
57 |
+
<col style="width: 25%">
|
58 |
+
<col style="width: 15%">
|
59 |
+
<col style="width: 15%">
|
60 |
+
<col style="width: 15%">
|
61 |
+
<col style="width: 15%">
|
62 |
+
<col style="width: 15%">
|
|
|
63 |
</colgroup>
|
64 |
|
65 |
<thead>
|
66 |
<!-- <th rowspan="2">Benchmark</th> -->
|
67 |
+
<th rowspan="2">Model
|
68 |
<button class="button_sort" data-direction="desc" data-type="name"></button>
|
69 |
</th>
|
70 |
<th data-direction="desc" rowspan="2" data-type="MGI">MGI
|
|
|
100 |
<p><strong>Notes</strong>
|
101 |
<p>
|
102 |
<ul>
|
103 |
+
<li>MGI stands for Memorization-Generalization Index, which is derived from Avg. Peak in the original paper. A higher MGI value indicates a greater propensity for a model to engage in memorization as opposed to generalization.</li>
|
|
|
|
|
104 |
<li>For more details check the π About section.</li>
|
105 |
</ul>
|
106 |
</div>
|