Hugging Face's logo

fsaudm
/
Meta-Llama-3.1-8B-Instruct-NF4

Text Generation
Transformers
Safetensors
PyTorch
llama
facebook
meta
llama-3
conversational
text-generation-inference
Inference Endpoints
4-bit precision
bitsandbytes
Model card Files Community
1
fsaudm commited on
Commit
49a4a75
•
1 Parent(s): 33ffce3

Upload LlamaForCausalLM

Browse files
Files changed (3) hide show
  1. config.json +1 -1
  2. model-00001-of-00002.safetensors +2 -2
  3. model.safetensors.index.json +1 -1
config.json CHANGED
@@ -1,5 +1,5 @@
1
  {
2
- "_name_or_path": "meta-llama/Meta-Llama-3.1-8B-Instruct",
3
  "architectures": [
4
  "LlamaForCausalLM"
5
  ],
 
1
  {
2
+ "_name_or_path": "hugging-quants/Meta-Llama-3.1-8B-Instruct-BNB-NF4",
3
  "architectures": [
4
  "LlamaForCausalLM"
5
  ],
model-00001-of-00002.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3c4a79180091cae0d86a4dbb6a4ff24af3e5058c8be5930cba7e39113eebd854
3
- size 4651954871
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:792ab04aa66c88113acf4feb24b30c99b7ddc287e8cf681bfa85fea747bc4a83
3
+ size 4652073135
model.safetensors.index.json CHANGED
@@ -1,6 +1,6 @@
1
  {
2
  "metadata": {
3
- "total_size": 5702456095
4
  },
5
  "weight_map": {
6
  "lm_head.weight": "model-00002-of-00002.safetensors",
 
1
  {
2
  "metadata": {
3
+ "total_size": 5702577951
4
  },
5
  "weight_map": {
6
  "lm_head.weight": "model-00002-of-00002.safetensors",