Hugging Face's logo

ruikangliu
/
FlatQuant

Model card Files Community
ruikangliu commited on
Commit
bb08c6d
•
1 Parent(s): eb35c43

Initial commit

Browse files
Files changed (8) hide show
  1. llama-2-13b/w4a4/flat_matrices.pth +3 -0
  2. llama-2-70b/w4a4/flat_matrices.pth +3 -0
  3. llama-2-7b/w4a4/flat_matrices.pth +3 -0
  4. llama-3-70b/w4a4/flat_matrices.pth +3 -0
  5. llama-3-8b/w4a16/flat_matrices.pth +3 -0
  6. llama-3-8b/w4a4/flat_matrices.pth +3 -0
  7. qwen-2.5-instruct-32b/w4a4/flat_matrices.pth +3 -0
  8. qwen-2.5-instruct-7b/w4a4/flat_matrices.pth +3 -0
llama-2-13b/w4a4/flat_matrices.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:52c00bf25101266e0de2366bacbafe1e805b5344ca3b01e2d1448ae32dfe1565
3
+ size 48256202
llama-2-70b/w4a4/flat_matrices.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d80794c59f0a020524e57cf2838493911d0f9bd6c8a954db467ff1ed9e917f0a
3
+ size 161917298
llama-2-7b/w4a4/flat_matrices.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7133f8a7bab8179ffa9cc0404c66d22e656f5b67a5abd31066d16bdd25d336ef
3
+ size 32808706
llama-3-70b/w4a4/flat_matrices.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4fa486fa090ce4f0d40854923cd6b96ac974ca463f8267e967ce59291b189887
3
+ size 161917298
llama-3-8b/w4a16/flat_matrices.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f651ed053b7955bfe0803cef619b0b382a6b1b69070bf0c723a40c3b47c54ac1
3
+ size 30428482
llama-3-8b/w4a4/flat_matrices.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:089cf7313e5d4c238bb6294145f525a0793bb3821ac49f584bebc690881971fd
3
+ size 34684674
qwen-2.5-instruct-32b/w4a4/flat_matrices.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d07f45863aa51ce2cb64bf4285f53d0a75bd383c6dd7c3ff5b357ceb260fb484
3
+ size 105842146
qwen-2.5-instruct-7b/w4a4/flat_matrices.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8f745b654d1957d19f898abfb861087e3206f56b62bd61a741e570f52a83b751
3
+ size 33853982