Hugging Face's logo

SparseLLM
/
prosparse-llama-2-13b-predictor

Feature Extraction
Transformers
English
sparsellama
custom_code
Model card Files Community
Raincleared commited on
Commit
e8273c2
•
0 Parent(s):

Duplicate from PowerInfer/prosparse-llama-2-13b-predictor

Browse files
Files changed (42) hide show
  1. .gitattributes +35 -0
  2. README.md +23 -0
  3. model_0.pt +3 -0
  4. model_1.pt +3 -0
  5. model_10.pt +3 -0
  6. model_11.pt +3 -0
  7. model_12.pt +3 -0
  8. model_13.pt +3 -0
  9. model_14.pt +3 -0
  10. model_15.pt +3 -0
  11. model_16.pt +3 -0
  12. model_17.pt +3 -0
  13. model_18.pt +3 -0
  14. model_19.pt +3 -0
  15. model_2.pt +3 -0
  16. model_20.pt +3 -0
  17. model_21.pt +3 -0
  18. model_22.pt +3 -0
  19. model_23.pt +3 -0
  20. model_24.pt +3 -0
  21. model_25.pt +3 -0
  22. model_26.pt +3 -0
  23. model_27.pt +3 -0
  24. model_28.pt +3 -0
  25. model_29.pt +3 -0
  26. model_3.pt +3 -0
  27. model_30.pt +3 -0
  28. model_31.pt +3 -0
  29. model_32.pt +3 -0
  30. model_33.pt +3 -0
  31. model_34.pt +3 -0
  32. model_35.pt +3 -0
  33. model_36.pt +3 -0
  34. model_37.pt +3 -0
  35. model_38.pt +3 -0
  36. model_39.pt +3 -0
  37. model_4.pt +3 -0
  38. model_5.pt +3 -0
  39. model_6.pt +3 -0
  40. model_7.pt +3 -0
  41. model_8.pt +3 -0
  42. model_9.pt +3 -0
.gitattributes ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,23 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ language:
4
+ - en
5
+ ---
6
+
7
+ # ProSparse-LLaMA-2-13B-Predictor
8
+
9
+ - Model Creator: [THUNLP](https://nlp.csai.tsinghua.edu.cn/), [ModelBest](modelbest.cn), and [PowerInfer](https://huggingface.co/PowerInfer)
10
+
11
+ This repository provides a group of sparsity predictors serving for [SparseLLM/ProSparse-LLaMA-2-13B](https://huggingface.co/SparseLLM/prosparse-llama-2-13b).
12
+
13
+ ### Citation
14
+
15
+ Please kindly cite using the following BibTeX:
16
+
17
+ ```bibtex
18
+ @article{song2024prosparse,
19
+ title={{ProSparse}: Introducing and Enhancing Intrinsic Activation Sparsity within Large Language Models},
20
+ author={Song, Chenyang and Han, Xu and Zhang, Zhengyan and Hu, Shengding and Shi, Xiyu and Li, Kuai and Chen, Chen and Liu, Zhiyuan and Li, Guangli and Yang, Tao and Sun, Maosong},
21
+ year={2024},
22
+ }
23
+ ```
model_0.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4dba774ad96c6a24f33d99cc61af7fdac743ea36c6f39520b51c559c022b3183
3
+ size 77595731
model_1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:21bd953c2c1f0ec49002db3366a24bd5252c1083fac0752b110ac60bd05a9886
3
+ size 77595731
model_10.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a871ffc6fbffdb02a291a680645f828aafcd9e03609fa41117cf5130876497eb
3
+ size 77595735
model_11.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4ca97fdf7583f9abdd747085c9db1d118c969c96c1128f32762b6b9e10bb3879
3
+ size 77595735
model_12.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9650a45cf20483176a90c57f2d261458e8aeee3a09ad50c6ecdd42de2d1b87f5
3
+ size 77595735
model_13.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e981bbcf750cc864ba9ddd9bbbd82bfb84a30ffbdfaae8d75932ab79f1b42055
3
+ size 77595735
model_14.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e79899157859c86a6be3f8fd3b52d0b67b7625a5c2d5117ab72e5765106d7a75
3
+ size 77595735
model_15.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7b24b3595745fc629934d85d5c2d39cda716fbfd01d3bf4a9ed03a41bdfd8b84
3
+ size 77595735
model_16.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ff5fca1bad2d3729b778606cb5f58718c72191976b4f2fa2866bbdb95be9c4d6
3
+ size 77595735
model_17.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6e80a0cfe175fbd02cce1c43eceab6e79c953b9feb5e6d7da51134a5f09a430b
3
+ size 77595735
model_18.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:06c91428a6627f039de2b084003199e3e4391fd45347192f96ca3466c52f9c6c
3
+ size 77595735
model_19.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7521fbfbdbd878fb360b02ba4214060ea57f872e335c0737dd0c6f0b410d5b75
3
+ size 77595735
model_2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3bb7d155cd6eda17091203a8e090d94b161d568dc65a88b0d4033d0b453c24ca
3
+ size 77595731
model_20.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:91130c71e1bded350d0674a5a493d8442726dbd81f43d9afcf989841be6826bd
3
+ size 77595735
model_21.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cc3e0017bc3b34f88e08096a26946df65a4dfbb55203af2eab818c7da46515b8
3
+ size 77595735
model_22.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c055d5188fdf95d8b85e0bfbe98e4c0c2f1871b025b1f2fd6750bcb60296f26b
3
+ size 77595735
model_23.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d51ef3a78abea4c30c5f6fa9bd4b7940109032c46e91f1c7e64fba5b31849a2b
3
+ size 77595735
model_24.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:840e58ec58f166429df7ad843346dddb0e3128748337bf0104028b0984b934a3
3
+ size 77595735
model_25.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e611fdac95fb69ae3c0f4219870a6639032da313ec3d9807b0f936061f40eb2c
3
+ size 77595735
model_26.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e8f05f490be7b1c08fc8976e50b85c4cfdb08e0ff174ff583b1189dd640e8a21
3
+ size 77595735
model_27.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f46a0b83efd252ded835fc7d15be9c262f805bf876b1a60268b141ca423ed0a1
3
+ size 77595735
model_28.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2952f1eef5f60c4226428d726f6fd449d991be635a7202e52c05b45fe002d1a0
3
+ size 77595735
model_29.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ba70f1a1b49001ff6daab2e8caaf5b9e1d53155c99dd5129df52135a65cf73f6
3
+ size 77595735
model_3.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:72f28275132ac304c813b64fd3f1539c313090a5ac95e7e4645eeedf891d2c8c
3
+ size 77595731
model_30.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ef1d85bb7e6278c36e2463dc47f2189c0b144caf465bd0a6e6c403cd45df254f
3
+ size 77595735
model_31.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:31cb4254925a9a2248d3fa65361062d451e18723baea692b0c2dd9d62cc58cfb
3
+ size 77595735
model_32.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c614522437ec95e559a12a9fa4831072578e59ef352afceb3328ca872fd13ea8
3
+ size 77595735
model_33.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9f6064eb7e6fb6a46961ecf6cfe1bf704e7c6962b89bbc558f2e160af8cc2abc
3
+ size 77595735
model_34.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aade432c9baa595564ac8160a1ff8c449e2a0a1e2308bcda2aac20d72e48d321
3
+ size 77595735
model_35.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1b1ad40c39f3ce4804fddeeb62ddaea631da62b28a9cef051558072391c6d3be
3
+ size 77595735
model_36.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2f8fd28f98e040bc859aed8024f26b7662b54e89dae6661a002477b8e845f3f8
3
+ size 77595735
model_37.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:225aa50d5ca0e493ad2c4c6d6ab345e9fc59b760b3638f7d7a0c04b8b7bebfa1
3
+ size 77595735
model_38.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c3a6f2c3b834e5651811d569f8f70434bfa7af357ef3d90e577bf7b614c49661
3
+ size 77595735
model_39.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c8ef219471980bb26e51781d661553b083d77096cbda1e47711dc270a902a041
3
+ size 77595735
model_4.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:343944a7f23c9a8a8a5cd4fabf24b92017ac6a0ef5c578b165088d61ce4193f6
3
+ size 77595731
model_5.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8d2b6f217b1ba10e9f9578b5bdc85f6f9513ab1a47952597cdb20924d20ab095
3
+ size 77595731
model_6.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b0f63ee066e4c220e3dd940ce71832e9f2e261443d83a22a7780e086a90a35e9
3
+ size 77595731
model_7.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0ee1102558ab4c2fe88bd2d068204a141a58001740f3a7cb8fa0a1efa02f79b1
3
+ size 77595731
model_8.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7d9db56883c67847ab5976a41df2ed95373b17bfca440d4c7f3d7d0f20c66246
3
+ size 77595731
model_9.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8f264850a382fe4ac7b790adb05a4671e5844fde5f6c2ee0007b94e8fe94db5e
3
+ size 77595731