gabrielmotablima commited on
Commit
83a35d1
1 Parent(s): 913616c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -8
README.md CHANGED
@@ -14,23 +14,23 @@ base_model:
14
  pipeline_tag: text-generation
15
  ---
16
 
17
- # 🎉 Swin-GPorTuguese for Brazilian Portuguese Image Captioning
18
 
19
- Swin-GPorTuguese model trained for image captioning on [Flickr30K Portuguese](https://huggingface.co/datasets/laicsiifes/flickr30k-pt-br) (translated version using Google Translator API)
20
  at resolution 224x224 and max sequence length of 1024 tokens.
21
 
22
 
23
  ## 🤖 Model Description
24
 
25
- The Swin-GPorTuguese is a type of Vision Encoder Decoder which leverage the checkpoints of the [Swin Transformer](https://huggingface.co/microsoft/swin-base-patch4-window7-224)
26
- as encoder and the checkpoints of the [GPorTuguese](pierreguillou/gpt2-small-portuguese) as decoder.
27
  The encoder checkpoints come from Swin Trasnformer version pre-trained on ImageNet-1k at resolution 224x224.
28
 
29
- The code used for training and evaluation is available at: https://github.com/laicsiifes/ved-transformer-caption-ptbr. In this work, Swin-GPorTuguese
30
  was trained together with its buddy [Swin-DistilBERTimbau](https://huggingface.co/laicsiifes/swin-distilbert-flickr30k-pt-br).
31
 
32
- Other models evaluated didn't achieve performance as high as Swin-DistilBERTimbau and Swin-GPorTuguese, namely: DeiT-BERTimbau,
33
- DeiT-DistilBERTimbau, DeiT-GPorTuguese, Swin-BERTimbau, ViT-BERTimbau, ViT-DistilBERTimbau and ViT-GPorTuguese.
34
 
35
  ## 🧑‍💻 How to Get Started with the Model
36
 
@@ -65,7 +65,7 @@ The evaluation metrics Cider-D, BLEU@4, ROUGE-L, METEOR and BERTScore are abbrev
65
  |Model|Training|Evaluation|C|B@4|RL|M|BS|
66
  |:---:|:------:|:--------:|:-----:|:----:|:-----:|:----:|:-------:|
67
  |Swin-DistilBERTimbau|Flickr30K Portuguese|Flickr30K Portuguese|66.73|24.65|39.98|44.71|72.30|
68
- |Swin-GPorTuguese|Flickr30K Portuguese|Flickr30K Portuguese|64.71|23.15|39.39|44.36|71.70|
69
 
70
  ## 📋 BibTeX entry and citation info
71
 
 
14
  pipeline_tag: text-generation
15
  ---
16
 
17
+ # 🎉 Swin-GPorTuguese-2 for Brazilian Portuguese Image Captioning
18
 
19
+ Swin-GPorTuguese-2 model trained for image captioning on [Flickr30K Portuguese](https://huggingface.co/datasets/laicsiifes/flickr30k-pt-br) (translated version using Google Translator API)
20
  at resolution 224x224 and max sequence length of 1024 tokens.
21
 
22
 
23
  ## 🤖 Model Description
24
 
25
+ The Swin-GPorTuguese-2 is a type of Vision Encoder Decoder which leverage the checkpoints of the [Swin Transformer](https://huggingface.co/microsoft/swin-base-patch4-window7-224)
26
+ as encoder and the checkpoints of the [GPorTuguese-2](pierreguillou/gpt2-small-portuguese) as decoder.
27
  The encoder checkpoints come from Swin Trasnformer version pre-trained on ImageNet-1k at resolution 224x224.
28
 
29
+ The code used for training and evaluation is available at: https://github.com/laicsiifes/ved-transformer-caption-ptbr. In this work, Swin-GPorTuguese-2
30
  was trained together with its buddy [Swin-DistilBERTimbau](https://huggingface.co/laicsiifes/swin-distilbert-flickr30k-pt-br).
31
 
32
+ Other models evaluated didn't achieve performance as high as Swin-DistilBERTimbau and Swin-GPorTuguese-2, namely: DeiT-BERTimbau,
33
+ DeiT-DistilBERTimbau, DeiT-GPorTuguese-2, Swin-BERTimbau, ViT-BERTimbau, ViT-DistilBERTimbau and ViT-GPorTuguese-2.
34
 
35
  ## 🧑‍💻 How to Get Started with the Model
36
 
 
65
  |Model|Training|Evaluation|C|B@4|RL|M|BS|
66
  |:---:|:------:|:--------:|:-----:|:----:|:-----:|:----:|:-------:|
67
  |Swin-DistilBERTimbau|Flickr30K Portuguese|Flickr30K Portuguese|66.73|24.65|39.98|44.71|72.30|
68
+ |Swin-GPorTuguese-2|Flickr30K Portuguese|Flickr30K Portuguese|64.71|23.15|39.39|44.36|71.70|
69
 
70
  ## 📋 BibTeX entry and citation info
71