Support LLaVA-Critic Series

#3
by FuryMartin - opened

Hi everyone,

lmms-lab has created a new series of models named LLaVA-Critic, which are finetuned on LLaVA-OneVision.

Considering that LLaVA-Critic is also part of the official LLaVA series models, could we make an official conversion in llava-hf?

I have tried to convert LLaVA-Critic-7b to hf-format using convert_llava_weights_to_hf.py by myself, but encountered some problems in #34467.

  • I resolved some of the problems, such as obtaining expected_slices and pass the assertcheck.
  • However, I am still unclear on how to obtain expected_text, and uncertain whether converting on my RTX 4090 server would result in a loss of precision.
Llava Hugging Face org

Sign up or log in to comment