
**Hyperparameters:** 

 - learning rate: 2e-5
 - weight decay: 0.01
 - per_device_train_batch_size: 16
 - per_device_eval_batch_size: 16
 - gradient_accumulation_steps:1
 - eval steps: 50000
 - max_length: 512
 - num_epochs: 1
 - hidden_dropout_prob: 0.3
 - attention_probs_dropout_prob: 0.25
   
**Dataset version:** 
 - taskydata/tasky_or_not/v_1

**Checkpoint:** 

 - 455000 steps.

**Results on Validation set:**

| **Step** | **Training Loss** | **Validation Loss** | **Accuracy** | **Precision** | **Recall** |  **F1**  |
|:--------:|:-----------------:|:-------------------:|:------------:|:-------------:|:----------:|:--------:|
|   50000  |       0.0148      |       0.10890       |    0.9798    |     0.9755    |   0.9843   |  0.9799  |
|  100000  |       0.0121      |       0.09090       |    0.9863    |     0.9958    |   0.9767   |  0.9862  |
|  150000  |       0.0080      |       0.11800       |    0.9863    |     0.9779    |   0.9950   |  0.9864  |
|  200000  |       0.0116      |       0.08965       |    0.9877    |     0.9905    |   0.9848   |  0.9876  |
|  250000  |       0.0073      |       3.50100       |    0.6507    |     0.5905    |   0.9830   |  0.7378  |
|  300000  |       0.0072      |       0.09807       |    0.9850    |     0.9863    |   0.9870   |  0.9849  |
|  350000  |       0.0053      |       0.09830       |    0.9854    |     0.9939    |   0.9870   |  0.9852  |
|  400000  |       0.0046      |       0.08130       |    0.9893    |     0.9957    |   0.9828   |  0.9892  |
|  450000  |       0.0054      |       0.61280       |    0.9095    |     0.5835    |   0.9888   |  0.9162  |
|  455000  |       0.0055      |       0.15790       |    0.9710    |     0.9561    |   0.9874   |  0.9715  |


**Uploaded Checkpoint:**
- 400000

{"language": ["en"], "license": "mit", "datasets": ["taskydata/tasky_or_not"], "metrics": ["f1", "accuracy", "recall", "precision"], "pipeline_tag": "text-classification"}
transformers pytorch deberta-v2 text-classification en dataset:taskydata/tasky_or_not license:mit autotrain_compatible endpoints_compatible region:us
TAGS
#transformers #pytorch #deberta-v2 #text-classification #en #dataset-taskydata/tasky_or_not #license-mit #autotrain_compatible #endpoints_compatible #region-us 

Hyperparameters:


* learning rate: 2e-5
* weight decay: 0.01
* per\_device\_train\_batch\_size: 16
* per\_device\_eval\_batch\_size: 16
* gradient\_accumulation\_steps:1
* eval steps: 50000
* max\_length: 512
* num\_epochs: 1
* hidden\_dropout\_prob: 0.3
* attention\_probs\_dropout\_prob: 0.25


Dataset version:


* taskydata/tasky\_or\_not/v\_1


Checkpoint:


* 455000 steps.


Results on Validation set:



Uploaded Checkpoint:


* 400000



TAGS
#transformers #pytorch #deberta-v2 #text-classification #en #dataset-taskydata/tasky_or_not #license-mit #autotrain_compatible #endpoints_compatible #region-us 
