Evaluation
#35
by
russwang
- opened
How to evaluate the hf version LLAVA? There are some differences between llava-hf and Haotian Liu-LLAVA.
Hey! You mean diffs when you generate with the same image and prompt? Can you make sure that the models are loaded in the same way with dtypes and attn implementations? The difference can be attributed to that sometimes