Text Generation
Transformers
Safetensors
imp_qwen2
conversational
custom_code
Oyoy1235 commited on
Commit
db24078
1 Parent(s): ab5a36d

update readme

Browse files
Files changed (2) hide show
  1. README.md +7 -7
  2. config.json +1 -1
README.md CHANGED
@@ -16,9 +16,9 @@ datasets:
16
 
17
  ## Introduction
18
 
19
- The Imp project aims to provide a family of a strong multimodal `small` language models (MSLMs). Our `Imp-v1.5-2B-Qwen1.5` is a strong MSLM with only **2B** parameters, which is build upon a small yet powerful SLM [Qwen1.5-1.8B-Chat ](https://huggingface.co/Qwen/Qwen1.5-1.8B-Chat)(1.8B) and a powerful visual encoder [SigLIP ](https://huggingface.co/google/siglip-so400m-patch14-384)(0.4B), and trained on the [LLaVA-v1.5](https://github.com/haotian-liu/LLaVA) training set.
20
 
21
- As shown in the Table below, `Imp-v1.5-2B-Qwen1.5` significantly outperforms the counterparts of similar model sizes, and even achieves slightly better performance than the strong LLaVA-7B model on various multimodal benchmarks.
22
 
23
  We release our model weights and provide an example below to run our model . Detailed technical report and corresponding training/evaluation code will be released soon on our [GitHub repo](https://github.com/MILVLG/imp). We will persistently improve our model and release the next versions to further improve model performance :)
24
 
@@ -85,10 +85,10 @@ This project is maintained by the [MILVLG](https://github.com/MILVLG)@Hangzhou D
85
  If you use our model or refer our work in your studies, please cite:
86
 
87
  ```bibtex
88
- @misc{imp2024,
89
- author = {Shao, Zhenwei and Ouyang, Xuecheng and Yu, Zhou and Yu, Jun},
90
- title = {Imp: An Emprical Study of Multimodal Small Language Models},
91
- year = {2024},
92
- url = {https://huggingface.co/MILVLG/Imp-v1.5-2B-Qwen1.5}
93
  }
94
  ```
 
16
 
17
  ## Introduction
18
 
19
+ The Imp project aims to provide a family of a strong multimodal `small` language models (MSLMs). Our `Imp-v1.5-2B-Qwen1.5` is a strong MSLM with only **2B** parameters, which is build upon a small yet powerful SLM [Qwen1.5-1.8B-Chat ](https://huggingface.co/Qwen/Qwen1.5-1.8B-Chat)(1.8B) and a powerful visual encoder [SigLIP ](https://huggingface.co/google/siglip-so400m-patch14-384)(0.4B), and trained on on 1M mixed dataset.
20
 
21
+ As shown in the Table below, `Imp-v1.5-2B-Qwen1.5` significantly outperforms the counterparts of similar model sizes.
22
 
23
  We release our model weights and provide an example below to run our model . Detailed technical report and corresponding training/evaluation code will be released soon on our [GitHub repo](https://github.com/MILVLG/imp). We will persistently improve our model and release the next versions to further improve model performance :)
24
 
 
85
  If you use our model or refer our work in your studies, please cite:
86
 
87
  ```bibtex
88
+ @article{imp2024,
89
+ title={Imp: Highly Capable Large Multimodal Models for Mobile Devices},
90
+ author={Shao, Zhenwei and Yu, Zhou and Yu, Jun and Ouyang, Xuecheng and Lihao, Zheng and Zhenbiao, Gai and Mingyang, Wang and Jiajun, Ding},
91
+ journal={arXiv preprint arXiv:2405.12107},
92
+ year={2024}
93
  }
94
  ```
config.json CHANGED
@@ -1,5 +1,5 @@
1
  {
2
- "_name_or_path": "MILVLG/imp-qwen-v1-2b",
3
  "architectures": [
4
  "ImpQwen2ForCausalLM"
5
  ],
 
1
  {
2
+ "_name_or_path": "MILVLG/Imp-v1.5-2B-Qwen1.5",
3
  "architectures": [
4
  "ImpQwen2ForCausalLM"
5
  ],