# K-urse_Detection_with_BERT

![TensorFlow](https://img.shields.io/badge/TensorFlow-%23FF6F00.svg?style=for-the-badge&logo=TensorFlow&logoColor=white)  ![Keras](https://img.shields.io/badge/Keras-%23D00000.svg?style=for-the-badge&logo=Keras&logoColor=white)

## Overview
**K-urse_Detection_with_BERT** : Korean Cursing expression Detection with fine-tuned klue_BERT

This is the KWU "text mining" output for the first semester of 2023.

See Project Overview Here! : [Notion(Korean)](https://www.notion.so/tolerblanc/4d70c776b3f74dbe8e03a38ccda27fbb?pvs=4)

See this model on GitHub : [Link](https://github.com/Tolerblanc/K-urse_Detection_with_BERT)

## Evaluation
- Comparison Model is [here](https://github.com/JminJ/Bad_text_classifier)
- Used [2runo's Curse-detection-data](https://github.com/2runo/Curse-detection-data)

| Model/Metric | Accuracy | Precision | Recall | F1 Score |
| --- | --- | --- | --- | --- |
| Comparison(Electra base) | 0.81 | 0.69 | **0.87** | **0.77** |
| klue-BERT base(Our best result) | **0.83** | **0.76**** | 0.75 | 0.75 |

- Used Youtube Comments

| Model/Metric | Accuracy | Precision | Recall | F1 Score |
| --- | --- | --- | --- | --- |
| Comparison(Electra base) | 0.77 | 0.52 | **0.90** | 0.66 |
| klue-BERT base(Our best result) | **0.89** | **0.75** | 0.80 | **0.78** |

## Demo with HuggingFace's Space 🤗
Try Demo Here! [Go to HuggingFace Space](https://huggingface.co/datasets/Tolerblanc/Demo_Kurse_detection)

## Reference
- Smilegate-AI's Korean Unsmile Dataset : [Link](https://huggingface.co/datasets/smilegate-ai/kor_unsmile)
- JeanLee's K-MHaS Dataset and Paper : [Link](https://huggingface.co/datasets/jeanlee/kmhas_korean_hate_speech)
- KLUE(Korean Language Understanding Evaluation) BERT : [Link](https://github.com/KLUE-benchmark/KLUE)
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding : [Link](https://arxiv.org/abs/1810.04805)
- 2runo's Curse Detection Dataset : [Link](https://github.com/2runo/Curse-detection-data)
- JminJ's Bad Text Classifier : [Link](https://github.com/JminJ/Bad_text_classifier)

{"language": ["ko"], "datasets": ["smilegate-ai/kor_unsmile", "jeanlee/kmhas_korean_hate_speech"]}
transformers tf bert text-classification ko dataset:smilegate-ai/kor_unsmile dataset:jeanlee/kmhas_korean_hate_speech arxiv:1810.04805 autotrain_compatible endpoints_compatible has_space region:us
TAGS
#transformers #tf #bert #text-classification #ko #dataset-smilegate-ai/kor_unsmile #dataset-jeanlee/kmhas_korean_hate_speech #arxiv-1810.04805 #autotrain_compatible #endpoints_compatible #has_space #region-us 

K-urse\_Detection\_with\_BERT
=============================


!TensorFlow !Keras


Overview
--------


K-urse\_Detection\_with\_BERT : Korean Cursing expression Detection with fine-tuned klue\_BERT


This is the KWU "text mining" output for the first semester of 2023.


See Project Overview Here! : Notion(Korean)


See this model on GitHub : Link


Evaluation
----------


* Comparison Model is here
* Used 2runo's Curse-detection-data



* Used Youtube Comments



Demo with HuggingFace's Space
-----------------------------


Try Demo Here! Go to HuggingFace Space


Reference
---------


* Smilegate-AI's Korean Unsmile Dataset : Link
* JeanLee's K-MHaS Dataset and Paper : Link
* KLUE(Korean Language Understanding Evaluation) BERT : Link
* BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding : Link
* 2runo's Curse Detection Dataset : Link
* JminJ's Bad Text Classifier : Link



TAGS
#transformers #tf #bert #text-classification #ko #dataset-smilegate-ai/kor_unsmile #dataset-jeanlee/kmhas_korean_hate_speech #arxiv-1810.04805 #autotrain_compatible #endpoints_compatible #has_space #region-us 
