Mozilla/llava-v1.5-7b-llamafile · llamafile: virus message.

vonjd

Feb 9

The llamafile can not be downloaded because windows blocks it due to a virus message. Please advise, thank you.

Tiwaz

Mar 5

Similar issue, Bitdefender just quarantined it.

PFnove

Apr 2

if you don't trust it you can download the model and llamafile separately

jartine

mozilla org Apr 2

Virus scanners sometimes get upset about our binaries that have weights inside them. We can't get them unflagged, because the online form with Microsoft Security Intelligence has an upload limit. What we can promise, is that the llamafile release binaries won't be flagged by Windows Defender. (We have zero support for any other AVs). So, could you try these commands:

curl -L -o llamafile.exe https://github.com/Mozilla-Ocho/llamafile/releases/download/0.7/llamafile-0.7
curl -L -o llava-v1.5-7b-Q4_K.gguf https://huggingface.co/jartine/llava-v1.5-7B-GGUF/resolve/main/llava-v1.5-7b-Q4_K.gguf
curl -L -o llava-v1.5-7b-mmproj-Q8_0.gguf https://huggingface.co/jartine/llava-v1.5-7B-GGUF/resolve/main/llava-v1.5-7b-mmproj-Q8_0.gguf
.\llamafile.exe -m llava-v1.5-7b-Q4_K.gguf --mmproj llava-v1.5-7b-mmproj-Q8_0.gguf --image SOMETHING.JPG -p "### User: What do you see?\n### Assistant:"

If that still gets flagged by Windows Defender, you should file an issue on https://github.com/mozilla-ocho/llamafile/

jartine changed discussion status to closed Apr 2