eublefar's picture
Create README.md
96ded35
|
raw
history blame
800 Bytes
---
license: mit
language: en
tags:
- conversational
---
# BART chatbot trained on [LIGHT](https://parl.ai/projects/light/) dataset with [Text Generative Adversarial Imitation Learning](https://arxiv.org/abs/2004.13796)
This model is intended to be used with [npc-engine](https://github.com/npc-engine/npc-engine).
It was based on [facebook/bart-large](https://huggingface.co/facebook/bart-large). [microsoft/deberta-base](https://huggingface.co/microsoft/deberta-base) was used as an adversarial for GAIL stage.
MSE fine-tuning: https://colab.research.google.com/drive/1goFW4X6qyK_vyLSdkanyFf0-zO_rrO1W?usp=sharing
GAIL fine-tuning: https://colab.research.google.com/drive/1jxHNWBh9em9FWevo99WBBdSkUSvrUvTx?usp=sharing
Packages used during training are not supported so it may not work anymore.