|
--- |
|
license: apache-2.0 |
|
tags: |
|
--- |
|
|
|
# Vision-and-Language Transformer (ViLT), pre-trained only |
|
|
|
Vision-and-Language Transformer (ViLT) model pre-trained on GCC+SBU+COCO+VG (200k steps). It was introduced in the paper [ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision](https://arxiv.org/abs/2102.03334) by Kim et al. and first released in [this repository](https://github.com/dandelin/ViLT). Note: this model only includes the language modeling head. |
|
|
|
Disclaimer: The team releasing ViLT did not write a model card for this model so this model card has been written by the Hugging Face team. |
|
|
|
## Model description |
|
|
|
(to do) |
|
|
|
## Intended uses & limitations |
|
|
|
You can use the raw model for visual question answering. |
|
|
|
### How to use |
|
|
|
(to do) |
|
|
|
## Training data |
|
|
|
(to do) |
|
|
|
## Training procedure |
|
|
|
### Preprocessing |
|
|
|
(to do) |
|
|
|
### Pretraining |
|
|
|
(to do) |
|
|
|
## Evaluation results |
|
|
|
(to do) |
|
|
|
### BibTeX entry and citation info |
|
|
|
```bibtex |
|
@misc{kim2021vilt, |
|
title={ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision}, |
|
author={Wonjae Kim and Bokyung Son and Ildoo Kim}, |
|
year={2021}, |
|
eprint={2102.03334}, |
|
archivePrefix={arXiv}, |
|
primaryClass={stat.ML} |
|
} |
|
``` |
