mradermacher

/

llama-3-70B-instruct-uncensored-i1-GGUF

like 1

That's usually a problem of an inference engine thats older than a few days, bad prompting, or using ROCm or something that is known to corrupt things. I'll download the q3_k_s, however, and have a look.

The non-imatrix one is working as intended with the same settings

Seems to work fine for me:

<|begin_of_text|><|start_header_id|>user<|end_header_id|>
What's the capital of Australia?<|eot_id|><|start_header_id|>assistant<|end_header_id|>

The capital of Australia is Canberra!<|eot_id|> [end of text]

<|begin_of_text|><|start_header_id|>user<|end_header_id|>
List the ten best-selling SF books.<|eot_id|><|start_header_id|>assistant<|end_header_id|>

Here are the top 10 best-selling science fiction books of all time, based on various sources such as Amazon, Publishers Weekly, and The Guardian:

1. **"Dune" (1965) by Frank Herbert**: With over 20 million copies sold, this classic novel is widely considered one of the greatest SF books ever written...
'''