---
language:
- id
- en
- multilingual
license: apache-2.0
tags:
- idt5
---

# Indonesian Version of Multilingual T5 Transformer

Smaller version of the [Google's Multilingual T5-base](https://huggingface.co/google/mt5-base) model with only Indonesian and some English embeddings.

This model has to be fine-tuned before it is useable on a downstream task.\
Fine-tuned idT5 for the Question Generation and Question Answering tasks, available at [idT5-qa-qg](https://huggingface.co/muchad/idt5-qa-qg).

#### Citation
1. [IEEE](https://ieeexplore.ieee.org/document/10420049)
2. [ArXiv](https://arxiv.org/abs/2302.00856)