Hugging Face's logo

mlx-community
/
Llama-3.1-Nemotron-70B-Instruct-HF-8bit

Text Generation
Transformers
Safetensors
MLX
English
llama
nvidia
llama3.1
conversational
text-generation-inference
8-bit precision
Model card Files Community
5
schroneko commited on
Commit
a633e64
•
1 Parent(s): 970727c

Upload folder using huggingface_hub (#3)

Browse files

- e93bc25479254f15044e1fecc29d110addaabb94af8ad96f63b101bfcc3cd279 (8c8278a2d61e388a17466b0c11945190f88ed5f5)
- a40aa24799bb50c767b0b8ad716f4d00a78435086b8859c683e915a1cfc30823 (93e9c3bcc45460b759f31439ec9af99741ab5f92)
- ec50881336e2c1dfde0f05104ac4e10174ca7c0e5d517241a6e93e2fbd48f500 (abf37eac8783e7234848ccd05033cba8f894824a)
- 48ab0b73183819c8946ceb91bc4024505795367348568e8194f028c3ebf4550b (abc445fc121cb1f4b3c437df4e7a319cf72b57bf)
- 43c9f712be9205091d74ce6ce77514fef84038ec474384878ee88e96e9e5b090 (acf29e4fc9e9c3d68b0b93ce395eb6254fe0dda2)
- a745aad9c412b00109ac9b72f4deaf538a1b3447b75009b41f8a740d7fe85750 (1b9996a3b51f041ef2e4399abfdf95511813bdc7)
- 3703e98491d1d0f94338689e1be76e88730b83aa45f3c4d019ecfcca491bc147 (9743aa1fcb61d7f277fc0247e3e50d054554243d)
- 7a40b9e4334e448507452d52fb2898b57c4e32b8be8bf3fa45207f1a62724363 (fa41d6bd1d78d7fde1a73d975d10361f240561f8)
- fd924645a2a29a508ae0c19f4e0610bd3798d2746ae74db7e1aa0cd7eac9ce86 (2ec483062bf0dbb40d551d1d655b2074ccffd699)
- 8bce5b3ee6f91d246a76d641a39de34a3de6837b83c7e90c6f0c3d9d322c42e2 (2d6cef5e656b129ef3e21b616909de01e20eeeec)
- 2965dd5ba9a8af0393c0844dcfef9e34b6a1d669eee6d2294e9d8ef1ca4dd521 (754967fdb168082a06212c19e6a0aab27ff6a854)
- bc9e24bb33336c4855985c51650d765fce8e5353b7dae2a71957c265f112104c (5643f29b727330c37a6f1add042959b9d429e779)
- ad6a51d3b50fb9c40fd465cff37225b9fba97ebf7e6ba2da8b6d4ebfd321d273 (4ee194465fb5c68756bb62cfaeba3800ebe60266)
- 37d07ecff65ee48d18c06bd8f96506fc35de6a864c3c156c30cd9cc134c5f722 (f8479c6ffa8cc0d2e5f0f753ff484307b5f39cda)
- bc897484fe2de30f296dfacad584f3a7b3e54f0e860e5fccfc8a0b7215642300 (ee65e16e90be5649c6f027b75a2924479c2ae9dd)

Files changed (18) hide show
  1. .gitattributes +1 -0
  2. README.md +1 -1
  3. model-00001-of-00015.safetensors +2 -2
  4. model-00002-of-00015.safetensors +2 -2
  5. model-00003-of-00015.safetensors +2 -2
  6. model-00004-of-00015.safetensors +2 -2
  7. model-00005-of-00015.safetensors +2 -2
  8. model-00006-of-00015.safetensors +2 -2
  9. model-00007-of-00015.safetensors +2 -2
  10. model-00008-of-00015.safetensors +2 -2
  11. model-00009-of-00015.safetensors +2 -2
  12. model-00010-of-00015.safetensors +2 -2
  13. model-00011-of-00015.safetensors +2 -2
  14. model-00012-of-00015.safetensors +2 -2
  15. model-00013-of-00015.safetensors +2 -2
  16. model-00014-of-00015.safetensors +2 -2
  17. model-00015-of-00015.safetensors +2 -2
  18. tokenizer.json +0 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ tokenizer.json filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -17,7 +17,7 @@ fine-tuning: false
17
 
18
  # mlx-community/Llama-3.1-Nemotron-70B-Instruct-HF-8bit
19
 
20
- The Model [mlx-community/Llama-3.1-Nemotron-70B-Instruct-HF-8bit](https://huggingface.co/mlx-community/Llama-3.1-Nemotron-70B-Instruct-HF-8bit) was converted to MLX format from [nvidia/Llama-3.1-Nemotron-70B-Instruct-HF](https://huggingface.co/nvidia/Llama-3.1-Nemotron-70B-Instruct-HF) using mlx-lm version **0.19.1**.
21
 
22
  ## Use with mlx
23
 
 
17
 
18
  # mlx-community/Llama-3.1-Nemotron-70B-Instruct-HF-8bit
19
 
20
+ The Model [mlx-community/Llama-3.1-Nemotron-70B-Instruct-HF-8bit](https://huggingface.co/mlx-community/Llama-3.1-Nemotron-70B-Instruct-HF-8bit) was converted to MLX format from [nvidia/Llama-3.1-Nemotron-70B-Instruct-HF](https://huggingface.co/nvidia/Llama-3.1-Nemotron-70B-Instruct-HF) using mlx-lm version **0.19.0**.
21
 
22
  ## Use with mlx
23
 
model-00001-of-00015.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c369434b8e5388151c86a3fce6548759719ff169a4c84ac8c51b1121d2eb55af
3
- size 5162938575
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:62afcadae2d5168fd84432a0a8550b0571e13415710a0199d626086c0e44c4b5
3
+ size 5162938579
model-00002-of-00015.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7ca62fd95c4949113f7389494773fb14c118121f3be72adb484229247b09b37c
3
- size 5205343244
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:97b493d310926732a7461369011488793aac2baf8cf7958d72d46940628e9f52
3
+ size 5205343236
model-00003-of-00015.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:82a8761d4295170fe4ac242563ebf9278cb30faee328a0ed563e0e8777337174
3
- size 5365774823
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c5eb3cf5010bc1478970de5361af36b1495eb56180a6f46254611d10e9ec9ca0
3
+ size 5365774815
model-00004-of-00015.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e395a84223a27dcece15a846a3c9fef5252742eb77dd4c184f8d74311ba42f5b
3
- size 5134006885
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7c800b3df10458fd0db081edc375f3f719210155b0a32b9aa31e79ce1d132b34
3
+ size 5134006863
model-00005-of-00015.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f9e2f587abd498b5a4d85d756e6298649a52d6ad0ab69243e42a92d95d9f0078
3
- size 5205343388
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:721764ad8707a5e31158544a8f3e797d56f73e2605dc7682e7a484de4a2b89c9
3
+ size 5205343384
model-00006-of-00015.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:84ff09fc1993c9a644d6a3a5a9e2718b8c621770166975e192325ad1cf6813c9
3
- size 5205343345
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b58e50ec4af533121a9f8315c8a1df2bb4062e9c9e8dcef9d5eedc22831b621e
3
+ size 5205343355
model-00007-of-00015.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c39d9b993f742c9df44dfa592e50813b21fd0e5b2462e5ab649cbd07cbb401b7
3
- size 5365774809
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6ac5b63099f4e4ec805e9165c7d282e75ff50520faa3ece6eb37f5a29062be0f
3
+ size 5365774825
model-00008-of-00015.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:efea3f2e42dd0f85d4ff7d99ed8e0e51fbd1e627eaf4fa456dff738fbbafbe47
3
- size 5134006875
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:454147291578d8cd051317e580f2c4c5fb10f20d98c907772b16ddbda8ed94ce
3
+ size 5134006849
model-00009-of-00015.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f1e4793a8dbed08d284e53e9367a29d1effc460ed05e576fe781d8286780eccb
3
- size 5205343378
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1609474c1d49007dc91ca5003f0fd9b9652a915d6d60afc19d88d1937c862fbf
3
+ size 5205343372
model-00010-of-00015.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5c4039dc2f81a6a526b3e942648d7a4d28f545df02869a7b6c93e5c491cb8ad7
3
- size 5205343347
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:916ea47c41bf611f22e124aa10f6efd861b3446609c40ad7533fa09cd41a041f
3
+ size 5205343369
model-00011-of-00015.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5fe182ea36e3ebef2e85887b690126e44358edff2b11016f86ad34931f941c29
3
- size 5365774789
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b51484e9ba98919c919e1401a06466112e1ba39a7356791b5110d75dc464dfdf
3
+ size 5365774793
model-00012-of-00015.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:54ea0c884b4c36d2c464efe13540d2505cdd8808a7ce43815ac1d589e71c9f3c
3
- size 5134006901
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c920a08a6a6083a358508c62f16182fac51baf2187fa4a046d99cf56750438f1
3
+ size 5134006871
model-00013-of-00015.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:385472a0236dc9f398e5d9f16f6c5575e86c68a4990e83608a447b21389caca8
3
- size 5205343376
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9c5f0dd09ecb1f25285cfb0cc7e17552f062fa642cbbd807edb24b3cf92e48a3
3
+ size 5205343360
model-00014-of-00015.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:96b307fef6ada91e7b4e67bf988ec3b0e67804770e8798b8583797940325f025
3
- size 5205343369
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c81b949074487770fa5e419d49e0582f62316afb66de5867f601a8b7f3276a8d
3
+ size 5205343363
model-00015-of-00015.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:03289dccbc9d3ec33db8a8ed28fbbcebd9f63f1bdbebdfb4a5077617b77cf0d0
3
- size 1865074261
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8f35474696a9f25d677ee265b38ebe24a30e021beed1e3f3956f32e3e25234e8
3
+ size 1865074267
tokenizer.json CHANGED
The diff for this file is too large to render. See raw diff