Hugging Face's logo

dranger003
/
Qwen1.5-72B-Chat-iMat.GGUF

Text Generation
GGUF
Model card Files Community
2
dranger003 commited on
Commit
631f030
•
1 Parent(s): cbbf8f0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -8,7 +8,8 @@ base_model: Qwen/Qwen1.5-72B-Chat
8
  ---
9
  <u>**NOTE**</u>: You will need a recent build of llama.cpp to run these quants (i.e. at least commit `494c870`).
10
 
11
- **2023-03-07**: Refreshing quants using latest build as things seem to have stabilized a bit now.
 
12
 
13
  GGUF importance matrix (imatrix) quants for https://huggingface.co/Qwen/Qwen1.5-72B-Chat
14
  * The importance matrix was trained for ~50K tokens (105 batches of 512 tokens) using a [general purpose imatrix calibration dataset](https://github.com/ggerganov/llama.cpp/discussions/5263#discussioncomment-8395384).
 
8
  ---
9
  <u>**NOTE**</u>: You will need a recent build of llama.cpp to run these quants (i.e. at least commit `494c870`).
10
 
11
+ **2024-03-19**: Uploading new quants retrained on `wiki.train.raw` for ~100K tokens.
12
+ **2024-03-07**: Refreshing quants using latest build as things seem to have stabilized a bit now.
13
 
14
  GGUF importance matrix (imatrix) quants for https://huggingface.co/Qwen/Qwen1.5-72B-Chat
15
  * The importance matrix was trained for ~50K tokens (105 batches of 512 tokens) using a [general purpose imatrix calibration dataset](https://github.com/ggerganov/llama.cpp/discussions/5263#discussioncomment-8395384).