GPTQv2, no group size, activation order and true sequential. Will work on CUDA.
Browse files
Alpaca-7b-native-enhanced-ao-ts-4bit.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c658102380b2e5f1fd20626d76d9475b9758ddfd6408dd0b9e76da5458e315d2
|
| 3 |
+
size 4299597572
|