File size: 2,514 Bytes
45d8f26 1d64715 45d8f26 f30fa89 45d8f26 f30fa89 45d8f26 1d64715 45d8f26 f30fa89 45d8f26 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 |
---
license: apache-2.0
tags:
- generated_from_trainer
metrics:
- accuracy
model-index:
- name: polibert-malaysia-ver4
results: []
---
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->
# polibert-malaysia-ver4
This model is new version of YagiASAFAS/polibert-malaysia-ver2.
What is new is that this model used a new dataset which not only used tnwei/ms-newspapers dataset but also almost 10k of instagram posts regarding several topics about Malaysia.
By doing so, this model captures not only formal sentences such as News, but also captures informal sentences such as personal posts.
As a tradeoff, the accuracy was quite lower compared to the previous one(ver3).
This model is an updated version of the ver3, increasing accuracy.
It achieves the following results on the evaluation set:
- Loss: 0.2641
- Accuracy: 0.9371
## Model description
More information needed
## Intended uses & limitations
More information needed
## Training and evaluation data
More information needed
## Training procedure
### Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 3e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 8
- mixed_precision_training: Native AMP
### Label Mappings
- 0: Economic Concerns
- 1: Racial discrimination or polarization
- 2: Leadership weaknesses
- 3: Development and infrastructure gaps
- 4: Corruption
- 5: Political instablility
- 6: Socials and Public safety
- 7: Administration
- 8: Education
- 9: Religion issues
- 10: Environmental
### Training results
| Training Loss | Epoch | Step | Validation Loss | Accuracy |
|:-------------:|:-----:|:----:|:---------------:|:--------:|
| 1.032 | 1.0 | 938 | 0.3282 | 0.9227 |
| 0.2967 | 2.0 | 1876 | 0.2641 | 0.9371 |
| 0.1987 | 3.0 | 2814 | 0.2902 | 0.9403 |
| 0.163 | 4.0 | 3752 | 0.2995 | 0.9451 |
| 0.1315 | 5.0 | 4690 | 0.2922 | 0.9445 |
| 0.0864 | 6.0 | 5628 | 0.2760 | 0.9504 |
| 0.0861 | 7.0 | 6566 | 0.2836 | 0.9493 |
| 0.0686 | 8.0 | 7504 | 0.2933 | 0.9509 |
### Framework versions
- Transformers 4.18.0
- Pytorch 2.3.0+cu121
- Datasets 2.19.1
- Tokenizers 0.12.1
|