How to finetune paligemma for Object Detection task
@sravanneeli did you find any torch code on how to finetune it ? because i still find nothing..
HI @edmond ,
I am not sure about torch finetune but there is a jax inference for object detection, pelase take a look at this notebook: https://www.kaggle.com/code/sineeli/object-detection-using-paligemma-mix-model/notebook
Hopefully I will try to fine-tuning for same using JAX.
Thansk
HI @edmond ,
I am not sure about torch finetune but there is a jax inference for object detection, pelase take a look at this notebook: https://www.kaggle.com/code/sineeli/object-detection-using-paligemma-mix-model/notebook
Hopefully I will try to fine-tuning for same using JAX.
Thansk
All I wanted was to train manually on my dataset the vlm https://huggingface.co/google/paligemma-3b-pt-448/discussions/4. I really needed paligemma as its the only vlm with decent detection performance