morriszms commited on
Commit
e4c338f
1 Parent(s): 38010b4

Upload folder using huggingface_hub

Browse files
README.md CHANGED
@@ -1,16 +1,9 @@
1
  ---
2
  library_name: transformers
3
- license: apache-2.0
4
- language:
5
- - en
6
- pipeline_tag: text-generation
7
  tags:
8
- - safetensors
9
- - onnx
10
- - transformers.js
11
  - TensorBlock
12
  - GGUF
13
- base_model: HuggingFaceTB/SmolLM2-135M-Instruct
14
  ---
15
 
16
  <div style="width: auto; margin-left: auto; margin-right: auto">
@@ -24,11 +17,11 @@ base_model: HuggingFaceTB/SmolLM2-135M-Instruct
24
  </div>
25
  </div>
26
 
27
- ## HuggingFaceTB/SmolLM2-135M-Instruct - GGUF
28
 
29
- This repo contains GGUF format model files for [HuggingFaceTB/SmolLM2-135M-Instruct](https://huggingface.co/HuggingFaceTB/SmolLM2-135M-Instruct).
30
 
31
- The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
32
 
33
  <div style="text-align: left; margin: 20px 0;">
34
  <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
 
1
  ---
2
  library_name: transformers
 
 
 
 
3
  tags:
 
 
 
4
  - TensorBlock
5
  - GGUF
6
+ base_model: tmickleydoyle/SmolLM2-135M-Instruct
7
  ---
8
 
9
  <div style="width: auto; margin-left: auto; margin-right: auto">
 
17
  </div>
18
  </div>
19
 
20
+ ## tmickleydoyle/SmolLM2-135M-Instruct - GGUF
21
 
22
+ This repo contains GGUF format model files for [tmickleydoyle/SmolLM2-135M-Instruct](https://huggingface.co/tmickleydoyle/SmolLM2-135M-Instruct).
23
 
24
+ The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4242](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
25
 
26
  <div style="text-align: left; margin: 20px 0;">
27
  <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
SmolLM2-135M-Instruct-Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f7ef35ffb61c7ad8680be32552ffcb43baa3c4b59724936dd17ebd06eba41e1f
3
- size 88202144
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:086228ad2c83fe24995e44c8097c61275082f453031a55296af4aad11e13af82
3
+ size 88201792
SmolLM2-135M-Instruct-Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b5178ce58468247aea50c16879f4978fb2836170c7e81eac6255355d2e090ce7
3
- size 97533344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0b554276b401d45a6305832f20c5cd21e6f9924ec9d27d0c5e2db10393bdd8d9
3
+ size 97532992
SmolLM2-135M-Instruct-Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:efc9898eef3e7571a2e1d71dcb26f38c57dbac6beba52c7fa4128efbc0798393
3
- size 93510560
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:78d13dbafaad561084f4d4ddecb4ede755cd0936b83860baa04f9abb09b37d21
3
+ size 93510208
SmolLM2-135M-Instruct-Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f6ceb704ef5973c5c6d3cf32f6be6a0285b16e1b16ddbd7054610c47bd47dd72
3
- size 88202144
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ddc8377b132815a84e7c8e2bd396d873e31847e2d8cca652c7a907ff65484e0f
3
+ size 88201792
SmolLM2-135M-Instruct-Q4_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6154a5e93fe0e7c64b2ca48089f40fa1d755f4e6310089f48c8a7adeaabc94dc
3
- size 91727264
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c9aadcc06c780227a3edab26f22de4e8fb4ec59ab82d28f1068a7baa689b0af3
3
+ size 91726912
SmolLM2-135M-Instruct-Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c59053718380427d8125b646b226d1dc5c1837b5ae7ca1f7c8e3acb15dcc5d98
3
- size 105454496
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e0bd34654d053fb36b47399d1a55b1e26cc8bc3dbe98e0b81bfc6f5961290a75
3
+ size 105454144
SmolLM2-135M-Instruct-Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:64fb31e4101c396339f12167832aee54fb75e33815e1595f8aef485fc7cfdc4b
3
- size 102039968
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:789a38cfd942e14595f737d7ee3b75538dc83b0486cff82a199ae47bcc1cd191
3
+ size 102039616
SmolLM2-135M-Instruct-Q5_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0cb02519d5022261a2c3050c56e6cf84bc94e48fe91524772b4fb0d1a2eef5e3
3
- size 104998304
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:58fe428be736d5245c21e81ac22538cea0f59001476bb052892c38ad12b04f1b
3
+ size 104997952
SmolLM2-135M-Instruct-Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7691b5c98f7f165c6c92ff4659dcca3e90bdf55581df60866543fddb66589dd1
3
- size 112103840
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:daa8a78a50c07d1ff97f4f67478337a852cd3243215d146b72e5125f9269d7ec
3
+ size 112103488
SmolLM2-135M-Instruct-Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a0fcb31d997d4b9a59cea48b7016ac3e5053c1a9ed80acd141412adfd3ddeeee
3
- size 109974944
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f486bcfb6c2662f25b289ddaa3d6d17eb22b0f08fb72c8dfc0a47689e4236a71
3
+ size 109974592
SmolLM2-135M-Instruct-Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:327eace3d0286329e6de8133eaff1225e576f8a0fbe5d844c34438686cb4c02d
3
- size 138383264
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:90993bb64eed729605e3ddd30b802dbc4b9820a26ec6f3edd3e34c58bcd2595c
3
+ size 138382912
SmolLM2-135M-Instruct-Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:44907029bd9e355417140fc218fc3c8fdef1b3f2cdc33db3320bc86286c56d35
3
- size 144811424
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:63a2ec033ec5562964b9a0b4a227e170415561aaa56d924a767e25402a05df95
3
+ size 144811072