Training in progress, step 10

24_10_23_config_test_5.csv

@@ -1,5 +1,5 @@
 run_number,comment,peformed_already,num_train_epochs,max_tokens,temperature,stop_token
-1,no variations,False,2,100,0.8,False
+1,no variations,True,2,100,0.8,False
 2,num_train_epochs set 1,False,1,100,0.8,False
 3,num_train_epochs set 4,False,4,100,0.8,False
 4,temperature set 0.1,False,2,100,0.1,False

24_10_23_results_real.csv

@@ -1,4 +1,5 @@
 run_number,items_per_minute,changed_settings,total_time_taken,rouge_scores_unnest,rouge1 low Precision,rouge1 low Recall,rouge1 low F1 Score,rouge1 mid Precision,rouge1 mid Recall,rouge1 mid F1 Score,rouge1 high Precision,rouge1 high Recall,rouge1 high F1 Score,rouge2 low Precision,rouge2 low Recall,rouge2 low F1 Score,rouge2 mid Precision,rouge2 mid Recall,rouge2 mid F1 Score,rouge2 high Precision,rouge2 high Recall,rouge2 high F1 Score
-1,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0
-2,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0
-3,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0
+1,0.0,0,0.0,0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0
+2,0.0,0,0.0,0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0
+3,1523.9837159869403,no variations,17.3230197429657,0,0.1636485914474813,0.2442045694140484,0.1797223166652443,0.2022430465904158,0.2801373375823723,0.2116393486309779,0.2415684051660303,0.3169552846418265,0.2454148877244572,0.0478798760618172,0.0576684379443441,0.0477967373151322,0.0678391323266069,0.077928569151534,0.0650191619264259,0.0907738130484548,0.0998870507246741,0.0832964711085375
+4,0.0,0,0.0,0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0

README.md

@@ -448,6 +448,18 @@ The following `bitsandbytes` quantization config was used during training:
 - bnb_4bit_use_double_quant: True
 - bnb_4bit_compute_dtype: bfloat16
 
+The following `bitsandbytes` quantization config was used during training:
+- quant_method: bitsandbytes
+- load_in_8bit: False
+- load_in_4bit: True
+- llm_int8_threshold: 6.0
+- llm_int8_skip_modules: None
+- llm_int8_enable_fp32_cpu_offload: False
+- llm_int8_has_fp16_weight: False
+- bnb_4bit_quant_type: nf4
+- bnb_4bit_use_double_quant: True
+- bnb_4bit_compute_dtype: bfloat16
+
 The following `bitsandbytes` quantization config was used during training:
 - quant_method: bitsandbytes
 - load_in_8bit: False
@@ -498,5 +510,6 @@ The following `bitsandbytes` quantization config was used during training:
 - PEFT 0.5.0
 - PEFT 0.5.0
 - PEFT 0.5.0
+- PEFT 0.5.0
 
 - PEFT 0.5.0

adapter_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6495c50392c3db4c05b92d1f4b378853cff912ca12444df7b2fa38207041f3d9
+oid sha256:a5338ae47c619a5ad3222c9401e190b74dc8a0da77aab2e3b6ebea7b958a986c
 size 100733709

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:568aec43b2cefbad0e93f274bc26965dd7f3b69ac59a3cd86f73b9b69f5e6665
+oid sha256:1184ea326ad999311776155dd6acfcca0635e9ba0a28490e87c053079ce69e89
 size 100690288

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:42c5b5d430ba0688eb0074439f7fa811ba56ece135f1cdc9eaf721376238a565
+oid sha256:81bd48e63e8c8a5af7631bdd73ab92e520077951420cd224048754ea23cdd4ff
 size 4283