File size: 1,126 Bytes
3af623d
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
646a9eb
3af623d
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
# Question Generation Model with KorQuAD
___

This model is a fine-tuend version of paust/pko-t5-base on the KorQuAD v1.0 Dataset.  
Most ideas were inspired by [Leaf-Question-Generation](https://github.com/KristiyanVachev/Leaf-Question-Generation).

### Dataset
KorQuAD v1.0 Dataset (csv)  
[Train](https://drive.google.com/file/d/1p0LYPBQE8OW6XRFEW5nxc8P03wgD_plE/view?usp=sharing)  
[Valid](https://drive.google.com/file/d/1O0-8BCsYn3PpEmIUjiEBnPz4sBBmQmud/view?usp=sharing)  

### Train

30% ํ™•๋ฅ ๋กœ input answer ๋Œ€์‹  '[MASK]'๋ฅผ ๋„ฃ์–ด ์งˆ๋ฌธ ๋ฌธ์žฅ์„ ์ƒ์„ฑํ•˜๋„๋ก ํ•™์Šตํ•œ๋‹ค.  
๊ทธ ๊ฒฐ๊ณผ, input answer๊ฐ€ ์—†์„ ๋•Œ๋„ ์ ์ ˆํžˆ answer์„ ์ฐพ์•„ ์งˆ๋ฌธ์„ ์ƒ์„ฑํ•  ์ˆ˜ ์žˆ๋‹ค.

### Question Generation without Input Answer

```python
context = """ CONTEXT """
input_answer = '[MASK]'
        
generated = generate(best_model, input_answer, context)
        
show_result(generated)
```

### References
____
Leaf-Question-Generation :https://github.com/KristiyanVachev/Leaf-Question-Generation  
pko-t5-base : https://huggingface.co/paust/pko-t5-base  
KorQuAD v1.0 : https://korquad.github.io/KorQuad%201.0/