yhyu13
commited on
Commit
•
d466d57
1
Parent(s):
6d7284d
Update readme
Browse files
README.md
CHANGED
|
@@ -4,4 +4,6 @@ license: apache-2.0
|
|
| 4 |
|
| 5 |
Genearted from https://github.com/yhyu13/AutoGPTQ.git branch cuda_dev
|
| 6 |
|
| 7 |
-
Original weight: https://huggingface.co/tiiuae/falcon-7b-instruct
|
|
|
|
|
|
|
|
|
| 4 |
|
| 5 |
Genearted from https://github.com/yhyu13/AutoGPTQ.git branch cuda_dev
|
| 6 |
|
| 7 |
+
Original weight: https://huggingface.co/tiiuae/falcon-7b-instruct
|
| 8 |
+
|
| 9 |
+
Note, autogptq does not generate 128 group size successfully when evaluating, at this moment. So the group size is 64
|