giobin commited on
Commit
bd0ed4a
1 Parent(s): 568084a

added description

Browse files
Files changed (1) hide show
  1. README.md +34 -0
README.md ADDED
@@ -0,0 +1,34 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ title: "Idefics2-Chatty LoRA Adapter"
3
+ description: "A pretrained Idefics2-chatty LoRA adapter trained on 'dawoz/frozenlake_prompts_dataset'."
4
+ ---
5
+
6
+ # Idefics2-Chatty LoRA Adapter
7
+
8
+ This is a pretrained Idefics2-chatty LoRA adapter trained on 'dawoz/frozenlake_prompts_dataset'.
9
+
10
+ ## Trainer Hyperparameters
11
+
12
+ ```yaml
13
+ num_train_epochs: 3
14
+ per_device_train_batch_size: 8
15
+ per_device_eval_batch_size: 4
16
+ gradient_accumulation_steps: 4
17
+ gradient_checkpointing: true
18
+ optim: adamw_bnb_8bit
19
+ warmup_steps: 50
20
+ learning_rate: 1e-4
21
+ weight_decay: 0.01
22
+ logging_steps: 25
23
+ output_dir: "outputs"
24
+ run_name: "idefics2-frozenlake"
25
+ save_strategy: "epoch"
26
+ save_steps: 250
27
+ save_total_limit: 4
28
+ eval_strategy: "steps"
29
+ eval_steps: 250
30
+ bf16: true
31
+ push_to_hub: false
32
+ hub_model_id: "idefics2-frozenlake"
33
+ remove_unused_columns: false
34
+ report_to: "wandb"