Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,15 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+gpt2-large-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+gpt2-large-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+gpt2-large-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+gpt2-large-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+gpt2-large-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+gpt2-large-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+gpt2-large-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+gpt2-large-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
+gpt2-large-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+gpt2-large-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+gpt2-large-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+gpt2-large-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,71 @@
+---
+language: en
+license: mit
+tags:
+- TensorBlock
+- GGUF
+base_model: openai-community/gpt2-large
+---
+
+<div style="width: auto; margin-left: auto; margin-right: auto">
+<img src="https://i.imgur.com/jC7kdl8.jpeg" alt="TensorBlock" style="width: 100%; min-width: 400px; display: block; margin: auto;">
+</div>
+<div style="display: flex; justify-content: space-between; width: 100%;">
+    <div style="display: flex; flex-direction: column; align-items: flex-start;">
+        <p style="margin-top: 0.5em; margin-bottom: 0em;">
+            Feedback and support: TensorBlock's  <a href="https://x.com/tensorblock_aoi">Twitter/X</a>, <a href="https://t.me/TensorBlock">Telegram Group</a> and <a href="https://x.com/tensorblock_aoi">Discord server</a>
+        </p>
+    </div>
+</div>
+
+## openai-community/gpt2-large - GGUF
+
+This repo contains GGUF format model files for [openai-community/gpt2-large](https://huggingface.co/openai-community/gpt2-large).
+
+The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
+
+## Prompt template
+
+```
+
+```
+
+## Model file specification
+
+| Filename | Quant type | File Size | Description |
+| -------- | ---------- | --------- | ----------- |
+| [gpt2-large-Q2_K.gguf](https://huggingface.co/tensorblock/gpt2-large-GGUF/tree/main/gpt2-large-Q2_K.gguf) | Q2_K | 0.322 GB | smallest, significant quality loss - not recommended for most purposes |
+| [gpt2-large-Q3_K_S.gguf](https://huggingface.co/tensorblock/gpt2-large-GGUF/tree/main/gpt2-large-Q3_K_S.gguf) | Q3_K_S | 0.367 GB | very small, high quality loss |
+| [gpt2-large-Q3_K_M.gguf](https://huggingface.co/tensorblock/gpt2-large-GGUF/tree/main/gpt2-large-Q3_K_M.gguf) | Q3_K_M | 0.427 GB | very small, high quality loss |
+| [gpt2-large-Q3_K_L.gguf](https://huggingface.co/tensorblock/gpt2-large-GGUF/tree/main/gpt2-large-Q3_K_L.gguf) | Q3_K_L | 0.460 GB | small, substantial quality loss |
+| [gpt2-large-Q4_0.gguf](https://huggingface.co/tensorblock/gpt2-large-GGUF/tree/main/gpt2-large-Q4_0.gguf) | Q4_0 | 0.462 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
+| [gpt2-large-Q4_K_S.gguf](https://huggingface.co/tensorblock/gpt2-large-GGUF/tree/main/gpt2-large-Q4_K_S.gguf) | Q4_K_S | 0.465 GB | small, greater quality loss |
+| [gpt2-large-Q4_K_M.gguf](https://huggingface.co/tensorblock/gpt2-large-GGUF/tree/main/gpt2-large-Q4_K_M.gguf) | Q4_K_M | 0.511 GB | medium, balanced quality - recommended |
+| [gpt2-large-Q5_0.gguf](https://huggingface.co/tensorblock/gpt2-large-GGUF/tree/main/gpt2-large-Q5_0.gguf) | Q5_0 | 0.552 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
+| [gpt2-large-Q5_K_S.gguf](https://huggingface.co/tensorblock/gpt2-large-GGUF/tree/main/gpt2-large-Q5_K_S.gguf) | Q5_K_S | 0.552 GB | large, low quality loss - recommended |
+| [gpt2-large-Q5_K_M.gguf](https://huggingface.co/tensorblock/gpt2-large-GGUF/tree/main/gpt2-large-Q5_K_M.gguf) | Q5_K_M | 0.589 GB | large, very low quality loss - recommended |
+| [gpt2-large-Q6_K.gguf](https://huggingface.co/tensorblock/gpt2-large-GGUF/tree/main/gpt2-large-Q6_K.gguf) | Q6_K | 0.648 GB | very large, extremely low quality loss |
+| [gpt2-large-Q8_0.gguf](https://huggingface.co/tensorblock/gpt2-large-GGUF/tree/main/gpt2-large-Q8_0.gguf) | Q8_0 | 0.836 GB | very large, extremely low quality loss - not recommended |
+
+
+## Downloading instruction
+
+### Command line
+
+Firstly, install Huggingface Client
+
+```shell
+pip install -U "huggingface_hub[cli]"
+```
+
+Then, downoad the individual model file the a local directory
+
+```shell
+huggingface-cli download tensorblock/gpt2-large-GGUF --include "gpt2-large-Q2_K.gguf" --local-dir MY_LOCAL_DIR
+```
+
+If you wanna download multiple model files with a pattern (e.g., `*Q4_K*gguf`), you can try:
+
+```shell
+huggingface-cli download tensorblock/gpt2-large-GGUF --local-dir MY_LOCAL_DIR --local-dir-use-symlinks False --include='*Q4_K*gguf'
+```

gpt2-large-Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:456234f131256bab9f4f9be15b87041b9470553894ac5a3bc0424970ec18e30b
+size 345513760

gpt2-large-Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b27397fa2bdf78f415bf421911f1557c1e9bab477ca54bfde79b37145350898c
+size 493512768

gpt2-large-Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7a5ecfd7e46c1022c82cfff5bc84101bd8e5a816c780b2200d2257a63bb79334
+size 458287168

gpt2-large-Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b05968112bbd2ada800d9ee2fea6909494be6ec20980f02f657028a551103f20
+size 393979968

gpt2-large-Q4_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cec5f5b78f7bedd790f2c6ea4c675b88e672159fd80e0cba943a2b915786414a
+size 496526848

gpt2-large-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d838ab62ed756fff13d89255c14ad2e0e7a8eb32305218ad49ca90e92d175f9f
+size 549058048

gpt2-large-Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6b7a847652dc69358576315b0e8dcd35042d28fba188719e24adf5185772bdb4
+size 499803648

gpt2-large-Q5_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4b5a903867bad65d9d4937b4b70aaaa24008682e74db2fc0649e7a35e577e0a1
+size 593041568

gpt2-large-Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:71022462c30205933249a9a8d6d1af9c2fb7d131e2bf81aa0bf410c89694b9af
+size 632209568

gpt2-large-Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:42816a93d90957215df6c1f5a903c762caa15182d279edb5553244f9ddc3dd0a
+size 593041568

gpt2-large-Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a1a0559829777c161495f33643b3ca178d497290f1875187502f515d18f28560
+size 695588448

gpt2-large-Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ea9575d7bde736da2156d3707d9b6f1aa901d29054bafe93a39d82bf35f416fe
+size 898165408