|
--- |
|
language: |
|
- ja |
|
library_name: transformers |
|
tags: |
|
- conversational |
|
- ja |
|
- japanese |
|
- gpt2 |
|
- text-generation |
|
- lm |
|
- nlp |
|
--- |
|
|
|
|
|
# Japanese DialoGPT trained with Aozora |
|
|
|
**(ja) 青空文庫のセリフで学習した日本語のDialoGPT Smallです** |
|
**(en) Japanese DialoGPT Small trained on Aozora Bunko.** |
|
|
|
## [Demo](https://huggingface.co/spaces/akiFQC/Japanese_DialoGPT_small_Aozora) |
|
Demo in this page is not working so well. I recommend you to try it on [Hugging Face Spaces Version](https://huggingface.co/spaces/akiFQC/Japanese_DialoGPT_small_Aozora). |
|
|
|
|
|
## Reference |
|
- [Aozora-bunko](https://www.aozora.gr.jp/) |
|
- Japanese public domain books. |
|
- I extracted the dialogue part from the books and used it as the training data. |
|
- [japanese-gpt2-small](https://huggingface.co/rinna/japanese-gpt2-small) |
|
- Novel Japanese GPT2. I used a small model because of the limitation of GPU memory of my desktop PC(with RTX3060x1) 😢. |
|
- I used this model as a pre-trained model. |
|
- [DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generation](https://arxiv.org/abs/1911.00536) |
|
|
