Spaces:
Running
Running
Support LLaVA-Critic Series
#3
by
FuryMartin
- opened
Hi everyone,
lmms-lab has created a new series of models named LLaVA-Critic, which are finetuned on LLaVA-OneVision
.
Considering that LLaVA-Critic
is also part of the official LLaVA series models, could we make an official conversion in llava-hf?
I have tried to convert LLaVA-Critic-7b to hf-format using convert_llava_weights_to_hf.py by myself, but encountered some problems in #34467.
- I resolved some of the problems, such as obtaining
expected_slices
and pass theassert
check. - However, I am still unclear on how to obtain
expected_text
, and uncertain whether converting on my RTX 4090 server would result in a loss of precision.
Further discussion will be in https://github.com/huggingface/transformers/issues/34467