Raincleared
commited on
Commit
•
3422dc5
1
Parent(s):
66c2c80
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
@@ -7,7 +7,7 @@ language:
|
|
7 |
# ProSparse-LLaMA-2-13B-GGUF
|
8 |
|
9 |
- Original model: [SparseLLM/ProSparse-LLaMA-2-13B](https://huggingface.co/SparseLLM/prosparse-llama-2-13b)
|
10 |
-
- Converted & distributed by: [PowerInfer](https://huggingface.co/PowerInfer)
|
11 |
|
12 |
This model is the downstream distribution of [SparseLLM/ProSparse-LLaMA-2-13B](https://huggingface.co/SparseLLM/prosparse-llama-2-13b) in PowerInfer GGUF format consisting of the LLM model weights and predictor weights.
|
13 |
|
@@ -20,5 +20,7 @@ Please kindly cite using the following BibTeX:
|
|
20 |
title={{ProSparse}: Introducing and Enhancing Intrinsic Activation Sparsity within Large Language Models},
|
21 |
author={Song, Chenyang and Han, Xu and Zhang, Zhengyan and Hu, Shengding and Shi, Xiyu and Li, Kuai and Chen, Chen and Liu, Zhiyuan and Li, Guangli and Yang, Tao and Sun, Maosong},
|
22 |
year={2024},
|
|
|
|
|
23 |
}
|
24 |
```
|
|
|
7 |
# ProSparse-LLaMA-2-13B-GGUF
|
8 |
|
9 |
- Original model: [SparseLLM/ProSparse-LLaMA-2-13B](https://huggingface.co/SparseLLM/prosparse-llama-2-13b)
|
10 |
+
- Converted & distributed by: [THUNLP](https://nlp.csai.tsinghua.edu.cn/), [ModelBest](modelbest.cn), and [PowerInfer](https://huggingface.co/PowerInfer)
|
11 |
|
12 |
This model is the downstream distribution of [SparseLLM/ProSparse-LLaMA-2-13B](https://huggingface.co/SparseLLM/prosparse-llama-2-13b) in PowerInfer GGUF format consisting of the LLM model weights and predictor weights.
|
13 |
|
|
|
20 |
title={{ProSparse}: Introducing and Enhancing Intrinsic Activation Sparsity within Large Language Models},
|
21 |
author={Song, Chenyang and Han, Xu and Zhang, Zhengyan and Hu, Shengding and Shi, Xiyu and Li, Kuai and Chen, Chen and Liu, Zhiyuan and Li, Guangli and Yang, Tao and Sun, Maosong},
|
22 |
year={2024},
|
23 |
+
journal={arXiv preprint arXiv:2402.13516},
|
24 |
+
url={https://arxiv.org/pdf/2402.13516.pdf}
|
25 |
}
|
26 |
```
|