Update README.md
Browse files
README.md
CHANGED
@@ -28,6 +28,18 @@ In the second phase, it was fine-tuned with LLaVA-v1.5-Instruct-620K-JA.
|
|
28 |
|
29 |
resources for more information: https://github.com/tosiyuki/LLaVA-JP/tree/main
|
30 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
31 |
## How to use the model
|
32 |
**1. Download dependencies**
|
33 |
```
|
|
|
28 |
|
29 |
resources for more information: https://github.com/tosiyuki/LLaVA-JP/tree/main
|
30 |
|
31 |
+
**Comparing VLMs**
|
32 |
+
|Model|JA-VG-VQA-500<br>(ROUGE-L)|JA-VLM-Bench-In-the-Wild<br>(ROUGE-L)|Heron-Bench(Detail)|Heron-Bench(Conv)|Heron-Bench(Complex)|Heron-Bench(Average)
|
33 |
+
|-|-|-|-|-|-|-|
|
34 |
+
|[Japanese Stable VLM](https://huggingface.co/stabilityai/japanese-stable-vlm)|-|40.50|25.15|51.23|37.84|38.07|
|
35 |
+
|[EvoVLM-JP-v1-7B](https://huggingface.co/SakanaAI/EvoVLM-JP-v1-7B)|19.70|51.25|50.31|44.42|40.47|45.07|
|
36 |
+
|[Heron BLIP Japanese StableLM Base 7B llava-620k](https://huggingface.co/turing-motors/heron-chat-blip-ja-stablelm-base-7b-v1-llava-620k)|14.51|33.26|49.09|41.51|45.72|45.44|
|
37 |
+
|[Heron GIT Japanese StableLM Base 7B](https://huggingface.co/turing-motors/heron-chat-git-ja-stablelm-base-7b-v1)|15.18|37.82|42.77|54.20|43.53|46.83|
|
38 |
+
|[llava-jp-1.3b-v1.0-620k](https://huggingface.co/toshi456/llava-jp-1.3b-v1.0-620k)|12.69|44.58|51.21|41.05|45.95|44.84|
|
39 |
+
|[llava-jp-1.3b-v1.1](https://huggingface.co/toshi456/llava-jp-1.3b-v1.1)|13.33|44.40|50.00|51.83|48.98|**50.39**|
|
40 |
+
|
41 |
+
![image/png](https://cdn-uploads.huggingface.co/production/uploads/630af71ffaaea618ebc973db/rnzCN-LFpK4iDL5RZ9oyI.png)
|
42 |
+
|
43 |
## How to use the model
|
44 |
**1. Download dependencies**
|
45 |
```
|