tamang0000 commited on
Commit
1ba0e1f
1 Parent(s): 440ee02

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +28 -0
README.md CHANGED
@@ -11,6 +11,34 @@ tags:
11
  - trl
12
  ---
13
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
14
  # Uploaded model
15
 
16
  - **Developed by:** tamang0000
 
11
  - trl
12
  ---
13
 
14
+ Before:
15
+ কম্পিউটাৰ এন্ড এন্ডিং এন্ডিং এন্ডিং �
16
+ কম্পিউটাৰ এন্ড এন্ডিং এন্ডিং এন্ডিং �
17
+
18
+
19
+ After:
20
+ কম্পিউটাৰ সংবাদ এই সমূহ এই সংবাদ এই সমূ
21
+ কম্পিউটাৰ সংবাদ এই সমূহ এই সংবাদ এই সমূ
22
+
23
+ ```
24
+ max_seq_length = 1024
25
+ per_device_train_batch_size = 2,
26
+ gradient_accumulation_steps = 4,
27
+ warmup_steps = 2,
28
+ max_steps = 10,
29
+ learning_rate = 0.0005,
30
+ fp16 = not torch.cuda.is_bf16_supported(),
31
+ bf16 = torch.cuda.is_bf16_supported(),
32
+ logging_steps = 1,
33
+ optim = "adamw_8bit",
34
+ weight_decay = 0.01,
35
+ lr_scheduler_type = "linear",
36
+ seed = 3407,
37
+ output_dir = "outputs",
38
+ ```
39
+
40
+ ---
41
+
42
  # Uploaded model
43
 
44
  - **Developed by:** tamang0000