Alibaba-NLP

/

gte-Qwen1.5-7B-instruct

like 91

Follow

Alibaba-NLP 91

雀食

出个4bit量化版本吧
Found this one but hasn't tested it yet:
https://huggingface.co/gaianet/gte-Qwen1.5-7B-instruct-GGUF

出个4bit量化版本吧
Found this one but hasn't tested it yet:
https://huggingface.co/gaianet/gte-Qwen1.5-7B-instruct-GGUF

Ive tried earlier, can not run with llama.cpp, error goes like : llama_add_eos_token(model) != 1