Update README.md
Browse files
README.md
CHANGED
@@ -21,6 +21,10 @@ tags:
|
|
21 |
- llama-2
|
22 |
license: other
|
23 |
---
|
|
|
|
|
|
|
|
|
24 |
# **Llama 2**
|
25 |
Llama 2 is a collection of pretrained and fine-tuned generative text models ranging in scale from 7 billion to 70 billion parameters. This is the repository for the 7B fine-tuned model, optimized for dialogue use cases and converted for the Hugging Face Transformers format. Links to other models can be found in the index at the bottom.
|
26 |
|
|
|
21 |
- llama-2
|
22 |
license: other
|
23 |
---
|
24 |
+
# Overview
|
25 |
+
This model has been pruned to 10% sparsity using the [Wanda pruning method](https://arxiv.org/abs/2306.11695). This method requires no retraining or weight updates and still achieves competitive performance. A link to the base model can be found [here](https://huggingface.co/meta-llama/Llama-2-7b-chat-hf).
|
26 |
+
|
27 |
+
|
28 |
# **Llama 2**
|
29 |
Llama 2 is a collection of pretrained and fine-tuned generative text models ranging in scale from 7 billion to 70 billion parameters. This is the repository for the 7B fine-tuned model, optimized for dialogue use cases and converted for the Hugging Face Transformers format. Links to other models can be found in the index at the bottom.
|
30 |
|