Update README.md
Browse files
README.md
CHANGED
|
@@ -20,19 +20,19 @@ InternVL-Chat-V1.2-Plus uses the same model architecture as [InternVL-Chat-V1.2]
|
|
| 20 |
|
| 21 |
### Performance
|
| 22 |
|
| 23 |
-
\* Proprietary Model
|
| 24 |
-
|
| 25 |
-
| name
|
| 26 |
-
|
|
| 27 |
-
| GPT-4V\*
|
| 28 |
-
| Gemini Ultra\*
|
| 29 |
-
| Gemini Pro\*
|
| 30 |
-
| Qwen−VL−Plus\*
|
| 31 |
-
| Qwen−VL−Max\*
|
| 32 |
-
|
|
| 33 |
-
| LLaVA−NEXT−34B
|
| 34 |
-
| InternVL−Chat−V1.2
|
| 35 |
-
| InternVL−Chat−V1.2−Plus | 448x448 | 50.3
|
| 36 |
|
| 37 |
- MMBench results are collected from the [leaderboard](https://mmbench.opencompass.org.cn/leaderboard).
|
| 38 |
|
|
|
|
| 20 |
|
| 21 |
### Performance
|
| 22 |
|
| 23 |
+
\* Proprietary Model † Training Set Observed
|
| 24 |
+
|
| 25 |
+
| name | image size | MMMU<br>(val) | MMMU<br>(test) | MathVista<br>(testmini) | MMB<br>(test) | MMB−CN<br>(test) | MMVP | MME | ScienceQA<br>(image) | POPE | TextVQA<br>(val) | SEEDv1<br>(image) | VizWiz<br>(test) | GQA<br>(test) |
|
| 26 |
+
| ----------------------- | ---------- | ------------- | -------------- | ----------------------- | ------------- | ---------------- | ---- | -------- | -------------------- | ---- | ---------------- | ----------------- | ---------------- | ------------- |
|
| 27 |
+
| GPT-4V\* | unknown | 56.8 | 55.7 | 49.9 | 77.0 | 74.4 | 38.7 | 1409/517 | - | - | 78.0 | 71.6 | - | - |
|
| 28 |
+
| Gemini Ultra\* | unknown | 59.4 | - | 53.0 | - | - | - | - | - | - | 82.3 | - | - | - |
|
| 29 |
+
| Gemini Pro\* | unknown | 47.9 | - | 45.2 | 73.6 | 74.3 | 40.7 | 1497/437 | - | - | 74.6 | 70.7 | - | - |
|
| 30 |
+
| Qwen−VL−Plus\* | unknown | 45.2 | 40.8 | 43.3 | 67.0 | 70.7 | - | 1681/502 | - | - | 78.9 | 65.7 | - | - |
|
| 31 |
+
| Qwen−VL−Max\* | unknown | 51.4 | 46.8 | 51.0 | 77.6 | 75.7 | - | - | - | - | 79.5 | - | - | - |
|
| 32 |
+
| | | | | | | | | | | | | | | |
|
| 33 |
+
| LLaVA−NEXT−34B | 672x672 | 51.1 | 44.7 | 46.5 | 79.3 | 79.0 | - | 1631/397 | 81.8 | 87.7 | 69.5 | 75.9 | 63.8 | 67.1† |
|
| 34 |
+
| InternVL−Chat−V1.2 | 448x448 | 51.6 | 46.2 | 47.7 | 82.2 | 81.2 | 56.7 | 1672/509 | 83.3 | 88.0 | 69.7 | 75.6 | 60.0 | 64.0† |
|
| 35 |
+
| InternVL−Chat−V1.2−Plus | 448x448 | 50.3 | 45.6 | 59.9 | 83.8 | 82.0 | 58.7 | 1624/551 | 98.1† | 88.7 | 71.3† | 76.4 | - | 66.9† |
|
| 36 |
|
| 37 |
- MMBench results are collected from the [leaderboard](https://mmbench.opencompass.org.cn/leaderboard).
|
| 38 |
|