Training in progress, step 10

README.md

@@ -88,6 +88,18 @@ The following `bitsandbytes` quantization config was used during training:
 - bnb_4bit_use_double_quant: True
 - bnb_4bit_compute_dtype: bfloat16
 
+The following `bitsandbytes` quantization config was used during training:
+- quant_method: bitsandbytes
+- load_in_8bit: False
+- load_in_4bit: True
+- llm_int8_threshold: 6.0
+- llm_int8_skip_modules: None
+- llm_int8_enable_fp32_cpu_offload: False
+- llm_int8_has_fp16_weight: False
+- bnb_4bit_quant_type: nf4
+- bnb_4bit_use_double_quant: True
+- bnb_4bit_compute_dtype: bfloat16
+
 The following `bitsandbytes` quantization config was used during training:
 - quant_method: bitsandbytes
 - load_in_8bit: False
@@ -108,5 +120,6 @@ The following `bitsandbytes` quantization config was used during training:
 - PEFT 0.5.0
 - PEFT 0.5.0
 - PEFT 0.5.0
+- PEFT 0.5.0
 
 - PEFT 0.5.0

adapter_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:31f480f1554254a07c5f6d77e2038ca9540a5d8f809e2895f1a1ed488d409939
+oid sha256:36ded364b13e679b62983c9619cc21ac8abdc121999fe3e4a8a51eda135a1d20
 size 100733709

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:1575c34311ba0e7a9f9eeca608bc1727207a71f157db4128c6024142c2201dd9
+oid sha256:cd748b06a20a0497dcd79418163e902e609044b94ab14e5304c7fdce32b22b6c
 size 100690288

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6cf11f33b9fb77ff569635b7a5c8225f14e6b7fbe8837836d2369d4075dbb591
+oid sha256:5993014329aa7aefbfd5fe4f23b60b84ae8cc445ebc12a9c96ffa114cf0a6d46
 size 4091