saucam
/

aqua-qwen-0.1-110B-GGUF

Inference Endpoints

Model card Files Files and versions Community

saucam commited on May 14

Commit

de5874d

•

1 Parent(s): 42636e7

Update README.md

Files changed (1) hide show

README.md +1 -2

README.md CHANGED Viewed

@@ -11,8 +11,7 @@ This is GGUF model of [saucam/aqua-qwen-0.1-110B](https://huggingface.co/saucam/
 Download the 2 files and requantize using [llama.cpp](https://github.com/ggerganov/llama.cpp). Then use the single generated file like below:
 ```
-$ ./main -m ../aqua-qwen/ggml-model-Q4_K_M.gg
-uf -p "<|im_start|>user\nHow are you?<|im_end|>\n<|im_start|>assistant" -n 400 -e
 Log start
 main: build = 2874 (e0f55618)
 main: built with cc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0 for x86_64-linux-gnu

 Download the 2 files and requantize using [llama.cpp](https://github.com/ggerganov/llama.cpp). Then use the single generated file like below:
 ```
+$ ./main -m aqua-qwen-0.1-110B-Q4_K_M.gguf -p "<|im_start|>user\nHow are you?<|im_end|>\n<|im_start|>assistant" -n 400 -e
 Log start
 main: build = 2874 (e0f55618)
 main: built with cc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0 for x86_64-linux-gnu