gabrielmotablima
commited on
Commit
•
83a35d1
1
Parent(s):
913616c
Update README.md
Browse files
README.md
CHANGED
@@ -14,23 +14,23 @@ base_model:
|
|
14 |
pipeline_tag: text-generation
|
15 |
---
|
16 |
|
17 |
-
# 🎉 Swin-GPorTuguese for Brazilian Portuguese Image Captioning
|
18 |
|
19 |
-
Swin-GPorTuguese model trained for image captioning on [Flickr30K Portuguese](https://huggingface.co/datasets/laicsiifes/flickr30k-pt-br) (translated version using Google Translator API)
|
20 |
at resolution 224x224 and max sequence length of 1024 tokens.
|
21 |
|
22 |
|
23 |
## 🤖 Model Description
|
24 |
|
25 |
-
The Swin-GPorTuguese is a type of Vision Encoder Decoder which leverage the checkpoints of the [Swin Transformer](https://huggingface.co/microsoft/swin-base-patch4-window7-224)
|
26 |
-
as encoder and the checkpoints of the [GPorTuguese](pierreguillou/gpt2-small-portuguese) as decoder.
|
27 |
The encoder checkpoints come from Swin Trasnformer version pre-trained on ImageNet-1k at resolution 224x224.
|
28 |
|
29 |
-
The code used for training and evaluation is available at: https://github.com/laicsiifes/ved-transformer-caption-ptbr. In this work, Swin-GPorTuguese
|
30 |
was trained together with its buddy [Swin-DistilBERTimbau](https://huggingface.co/laicsiifes/swin-distilbert-flickr30k-pt-br).
|
31 |
|
32 |
-
Other models evaluated didn't achieve performance as high as Swin-DistilBERTimbau and Swin-GPorTuguese, namely: DeiT-BERTimbau,
|
33 |
-
DeiT-DistilBERTimbau, DeiT-GPorTuguese, Swin-BERTimbau, ViT-BERTimbau, ViT-DistilBERTimbau and ViT-GPorTuguese.
|
34 |
|
35 |
## 🧑💻 How to Get Started with the Model
|
36 |
|
@@ -65,7 +65,7 @@ The evaluation metrics Cider-D, BLEU@4, ROUGE-L, METEOR and BERTScore are abbrev
|
|
65 |
|Model|Training|Evaluation|C|B@4|RL|M|BS|
|
66 |
|:---:|:------:|:--------:|:-----:|:----:|:-----:|:----:|:-------:|
|
67 |
|Swin-DistilBERTimbau|Flickr30K Portuguese|Flickr30K Portuguese|66.73|24.65|39.98|44.71|72.30|
|
68 |
-
|Swin-GPorTuguese|Flickr30K Portuguese|Flickr30K Portuguese|64.71|23.15|39.39|44.36|71.70|
|
69 |
|
70 |
## 📋 BibTeX entry and citation info
|
71 |
|
|
|
14 |
pipeline_tag: text-generation
|
15 |
---
|
16 |
|
17 |
+
# 🎉 Swin-GPorTuguese-2 for Brazilian Portuguese Image Captioning
|
18 |
|
19 |
+
Swin-GPorTuguese-2 model trained for image captioning on [Flickr30K Portuguese](https://huggingface.co/datasets/laicsiifes/flickr30k-pt-br) (translated version using Google Translator API)
|
20 |
at resolution 224x224 and max sequence length of 1024 tokens.
|
21 |
|
22 |
|
23 |
## 🤖 Model Description
|
24 |
|
25 |
+
The Swin-GPorTuguese-2 is a type of Vision Encoder Decoder which leverage the checkpoints of the [Swin Transformer](https://huggingface.co/microsoft/swin-base-patch4-window7-224)
|
26 |
+
as encoder and the checkpoints of the [GPorTuguese-2](pierreguillou/gpt2-small-portuguese) as decoder.
|
27 |
The encoder checkpoints come from Swin Trasnformer version pre-trained on ImageNet-1k at resolution 224x224.
|
28 |
|
29 |
+
The code used for training and evaluation is available at: https://github.com/laicsiifes/ved-transformer-caption-ptbr. In this work, Swin-GPorTuguese-2
|
30 |
was trained together with its buddy [Swin-DistilBERTimbau](https://huggingface.co/laicsiifes/swin-distilbert-flickr30k-pt-br).
|
31 |
|
32 |
+
Other models evaluated didn't achieve performance as high as Swin-DistilBERTimbau and Swin-GPorTuguese-2, namely: DeiT-BERTimbau,
|
33 |
+
DeiT-DistilBERTimbau, DeiT-GPorTuguese-2, Swin-BERTimbau, ViT-BERTimbau, ViT-DistilBERTimbau and ViT-GPorTuguese-2.
|
34 |
|
35 |
## 🧑💻 How to Get Started with the Model
|
36 |
|
|
|
65 |
|Model|Training|Evaluation|C|B@4|RL|M|BS|
|
66 |
|:---:|:------:|:--------:|:-----:|:----:|:-----:|:----:|:-------:|
|
67 |
|Swin-DistilBERTimbau|Flickr30K Portuguese|Flickr30K Portuguese|66.73|24.65|39.98|44.71|72.30|
|
68 |
+
|Swin-GPorTuguese-2|Flickr30K Portuguese|Flickr30K Portuguese|64.71|23.15|39.39|44.36|71.70|
|
69 |
|
70 |
## 📋 BibTeX entry and citation info
|
71 |
|