Finetuning scripts for Molmo
#5
by
2U1
- opened
I made a code for fine-tuning Molmo series.
https://github.com/2U1/Molmo-Finetune
However, the model is sort of a preview and has some limitations. It will be updated soon.
For now you can use
- LoRA/QLoRA
- Deepspeed
- Full-finetuning
- Flexibly select module to train
PRs and feedbacks are always welcome!