End of training

README.md

@@ -1,4 +1,5 @@
 ---
+base_model: sinonimayzer/roberta-1.8-v2
 tags:
 - generated_from_trainer
 model-index:
@@ -11,7 +12,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 # roberta-1.8-v3
 
-This model is a fine-tuned version of [](https://huggingface.co/) on the None dataset.
+This model is a fine-tuned version of [sinonimayzer/roberta-1.8-v2](https://huggingface.co/sinonimayzer/roberta-1.8-v2) on the None dataset.
 
 ## Model description
 
@@ -31,8 +32,8 @@ More information needed
 
 The following hyperparameters were used during training:
 - learning_rate: 5e-05
-- train_batch_size: 32
-- eval_batch_size: 32
+- train_batch_size: 30
+- eval_batch_size: 30
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear

config.json

@@ -1,4 +1,5 @@
 {
+  "_name_or_path": "sinonimayzer/roberta-1.8-v2",
   "architectures": [
     "RobertaForMaskedLM"
   ],
@@ -15,7 +16,7 @@
   "max_position_embeddings": 512,
   "model_type": "roberta",
   "num_attention_heads": 12,
-  "num_hidden_layers": 12,
+  "num_hidden_layers": 6,
   "pad_token_id": 1,
   "position_embedding_type": "absolute",
   "torch_dtype": "float32",

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:907da3b578e036982620bfe40f0cfa0a5c584424b1944990563d354b7e1079ed
-size 504144664
+oid sha256:fd86956a4a53fd044ccb4b3ec09951c0547648ec0487a8f42d3deeb5829ef418
+size 334024120

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:500224f271f6d65ac967249e029bb453c65fbd9b2de83c36284530a561d5b1ba
+oid sha256:100c3b1e32cfa1c19168485d917b243fb461a0f4e87c74aa912e4048a96c989f
 size 4600