File size: 1,119 Bytes
be3c327 4478503 be3c327 4478503 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 |
---
language:
- ja
library_name: transformers
tags:
- conversational
- ja
- japanese
- gpt2
- text-generation
- lm
- nlp
---
# Japanese DialoGPT trained with Aozora
**(ja) 青空文庫のセリフで学習した日本語のDialoGPT Smallです**
**(en) Japanese DialoGPT Small trained on Aozora Bunko.**
## [Demo](https://huggingface.co/spaces/akiFQC/Japanese_DialoGPT_small_Aozora)
Demo in this page is not working so well. I recommend you to try it on [Hugging Face Spaces Version](https://huggingface.co/spaces/akiFQC/Japanese_DialoGPT_small_Aozora).
## Reference
- [Aozora-bunko](https://www.aozora.gr.jp/)
- Japanese public domain books.
- I extracted the dialogue part from the books and used it as the training data.
- [japanese-gpt2-small](https://huggingface.co/rinna/japanese-gpt2-small)
- Novel Japanese GPT2. I used a small model because of the limitation of GPU memory of my desktop PC(with RTX3060x1) 😢.
- I used this model as a pre-trained model.
- [DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generation](https://arxiv.org/abs/1911.00536)
|