Hugging Face's logo

dbands
/
llama-3-8b-instruct-code-instructions-blender-4bit

Text Generation
Transformers
Safetensors
English
llama
text-generation-inference
unsloth
trl
sft
Inference Endpoints
4-bit precision
bitsandbytes
Model card Files Community
dbands commited on
Commit
d73d4df
•
1 Parent(s): 776b883

Trained with Unsloth

Browse files

Upload model trained with Unsloth 2x faster

Files changed (3) hide show
  1. config.json +1 -0
  2. model-00001-of-00002.safetensors +2 -2
  3. model.safetensors.index.json +1 -1
config.json CHANGED
@@ -16,6 +16,7 @@
16
  "num_attention_heads": 32,
17
  "num_hidden_layers": 32,
18
  "num_key_value_heads": 8,
 
19
  "pretraining_tp": 1,
20
  "quantization_config": {
21
  "bnb_4bit_compute_dtype": "bfloat16",
 
16
  "num_attention_heads": 32,
17
  "num_hidden_layers": 32,
18
  "num_key_value_heads": 8,
19
+ "pad_token_id": 128255,
20
  "pretraining_tp": 1,
21
  "quantization_config": {
22
  "bnb_4bit_compute_dtype": "bfloat16",
model-00001-of-00002.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3e3b4d2d62dbe167e5b21b8b6595517b3632c2488e19890c7ec269c95ec79605
3
- size 4652072941
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5b03128a9d2dbccde743491664a009cec2832fc42a59bd5232d1f4ea64305cff
3
+ size 4652072920
model.safetensors.index.json CHANGED
@@ -1,6 +1,6 @@
1
  {
2
  "metadata": {
3
- "total_size": 5702577757
4
  },
5
  "weight_map": {
6
  "lm_head.weight": "model-00002-of-00002.safetensors",
 
1
  {
2
  "metadata": {
3
+ "total_size": 5702577736
4
  },
5
  "weight_map": {
6
  "lm_head.weight": "model-00002-of-00002.safetensors",