license:apache-2.0 region:us
---
license: apache-2.0
---
This version of Multimodal Instruction Data includes diverse and high-quality dowanstream data.

It contains about 2M samples from VQA, Detector, Detailed Description of Image, and others.
```
{'aokvqa_qa': 17056, 'vsr_tof': 7680, 'flickr30k_caption': 158914, 'esnlive_evil': 401717, 'nocaps_caption': 45000, 'okvqa_qg': 9009, 'okvqa_qa': 9009, 'openvqa_qa': 34602, 'minigpt4_description': 3439, 'chart2image_chart': 8305, 'minigpt4_detailed-qa': 17195, 'vqav2_qa': 443757, 'llava_detailed-qa': 356753, 'vqav2_qg': 443757, 'semart_art': 20313, 'coco_caption': 591753, 'refcoco_detector': 8540, 'visdial_QA': 1000, 'gqa_qa': 943000, 'scienceqa_scienceqa': 6218, 'iconqa_qa': 29859, 'textcaps_caption': 109765}
```

The above statistic can be used for WeightRandom sampling of Data while training your Visiual-Language Models.

More details about Our LMEye project, please see https://github.com/YunxinLi/LingCloud

We will present a LMEye Variant with new architecture trained on enormous Instruction Data in the next week.