Hugging Face's logo

MaziyarPanahi
/
Meraj-Mini-GGUF

Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
imatrix
conversational
Model card Files Community
1
MaziyarPanahi commited on
Commit
b74da67
•
1 Parent(s): 3c36e11

Upload folder using huggingface_hub (#1)

Browse files

- db92885a03ab27f17ae898e420b11cce80bcc8871192ed7d932442e2ca911c5c (4250e9d7475ce1aa78e2ddff5053a36c11e3f307)
- b27e7a6fddecd99c17b01ba04b59a7147185d2576d3eddf2c349e5224390e0d2 (1970ee13aca2648460f9ad537665122790f36726)
- cfa1e568f76012586b473aedfa63b0f49767e0f3eb89d6954bd19631eb65407d (f0ed04ee46b76304774272d395478befe9248bb4)
- eecec9431ea7e257f9983a65d10a16d889d3996fd698830849e9531203629991 (c6cbef2a4d5e7a20e5ae5e5a2b606ae562be53e7)
- 9368b99cc87038260ebdd1877e2220aab86d89f12b5280e1b53abf157d960032 (e315652e4aa997b7ce1eeb5d1c163a0ea1ed3db0)
- 76395e683af48ffd0a6c9fcd6d67896812f63524d94b5d3ca1c0783a60d1371f (3931866f65a43c216f3a0a37bf904d24d9a23df8)
- 2544111670e309c8f1c907a7c3ab1dc29c890ebc12a34dc49a5b0887a0a4d2d7 (abb2dd116215b2b83579549788175a60a57e7217)
- 9cdc74c2afffd213a0b4f70b2f91847d7be802032feb96204537ce0525eaf6c2 (7b754daf06d367b2e681da300b65573eaaaf1a43)
- 56471b069839242057fae32412f82b236cd1d3e3ac1e78398b28b3dac2822ef8 (70f3845984e5404321c4dee6f32c26b0240aba01)
- ddff462a12f18626b2d062bcd1dea0c71953bd9fa88dae12ef96fab3116271fa (68fb55dde1127e5a136fbc6a47a57c2f4c246af5)
- eb8f9e183ece3fe8a1b3b81cbf1a3408ab8a36f82792539beeec1ba60e5069c2 (e966d45dbff053ba2fd753a2e5acf7088ee75214)
- bab3208a94458b1eea71a286e2f27a0be5d2bc8972478902b585e2f914c181b8 (dece8adcb58abfc2dba70ab35e4ee83e78e007dd)
- ca0560f84790b192e340ea8f64afae802c6e1ebe3999bc774dac8123c5fe7db1 (36414a526b016897445e404c93c2ebe0f833271a)
- 34a90e051fdb5961002446ce7a8dc1a76c37c1925d8a03bf8d2c2e73aae0b00f (803659fa6bfdebb9901b4243f1b6b554d16fb4c7)
- 5cbd69d3212b4c1c5c6c5b5a3fb30bfd38fa32d8b18c8ed799c327a268c03189 (4541bfe67b6bb2ffa3a3ca3a9c11187d9eb1cdd4)
- c25386e83ba8cfeaff39485a92fe138f5d15e62433dfd6d9b457fefe1c893380 (deb3a312af97636131b1420aa733e16633370e57)

Files changed (19) hide show
  1. .gitattributes +17 -0
  2. Meraj-Mini-GGUF_imatrix.dat +3 -0
  3. Meraj-Mini.IQ1_M.gguf +3 -0
  4. Meraj-Mini.IQ1_S.gguf +3 -0
  5. Meraj-Mini.IQ2_XS.gguf +3 -0
  6. Meraj-Mini.IQ3_XS.gguf +3 -0
  7. Meraj-Mini.IQ4_XS.gguf +3 -0
  8. Meraj-Mini.Q2_K.gguf +3 -0
  9. Meraj-Mini.Q3_K_L.gguf +3 -0
  10. Meraj-Mini.Q3_K_M.gguf +3 -0
  11. Meraj-Mini.Q3_K_S.gguf +3 -0
  12. Meraj-Mini.Q4_K_M.gguf +3 -0
  13. Meraj-Mini.Q4_K_S.gguf +3 -0
  14. Meraj-Mini.Q5_K_M.gguf +3 -0
  15. Meraj-Mini.Q5_K_S.gguf +3 -0
  16. Meraj-Mini.Q6_K.gguf +3 -0
  17. Meraj-Mini.Q8_0.gguf +3 -0
  18. Meraj-Mini.fp16.gguf +3 -0
  19. README.md +46 -0
.gitattributes CHANGED
@@ -33,3 +33,20 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Meraj-Mini-GGUF_imatrix.dat filter=lfs diff=lfs merge=lfs -text
37
+ Meraj-Mini.IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Meraj-Mini.IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Meraj-Mini.IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Meraj-Mini.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Meraj-Mini.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Meraj-Mini.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Meraj-Mini.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Meraj-Mini.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Meraj-Mini.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Meraj-Mini.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Meraj-Mini.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
48
+ Meraj-Mini.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
49
+ Meraj-Mini.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
50
+ Meraj-Mini.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
51
+ Meraj-Mini.fp16.gguf filter=lfs diff=lfs merge=lfs -text
52
+ Meraj-Mini.IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Meraj-Mini-GGUF_imatrix.dat ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e4f644b1fa39a3a07a31faf1fd8d62a388f1279d8144054897487c31340d39fa
3
+ size 4536654
Meraj-Mini.IQ1_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ae5f89fe5cdaac2543adb2dd47431fc07716e3841278a4b871297820a2f7a998
3
+ size 2042802912
Meraj-Mini.IQ1_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:67e8ae0d23e7ef17cc42c316360e927849eb4b1a7cf76613be0786ebe9697390
3
+ size 1904274144
Meraj-Mini.IQ2_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a9475dc738ef83ffec6ad5b93a3e9af43d25391bd7c442185a9f144fefaee46f
3
+ size 2469628640
Meraj-Mini.IQ3_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e72a97df05d7e0beec492ef6017d9f288943fc485bc1146b327b88dae2a51822
3
+ size 3346862816
Meraj-Mini.IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:14a8700d7b339f7ecac9ee538c0bd4635f4d5c0973be3c99e6aa73fd1c95c478
3
+ size 4219079392
Meraj-Mini.Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8a74c9b7bbb59a859abab9023afa3b6c02e601cbb6003252fafc1c63c236b3df
3
+ size 3016547040
Meraj-Mini.Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:be4fea7d445fd522adb8c54ce0823710b7a078c385dbfda9e99d4986668203e9
3
+ size 4089066208
Meraj-Mini.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7d7489c94076c9be771d905ea4f876e8e4c6cf460ff85e48cb1eb9108fb383e6
3
+ size 3808998112
Meraj-Mini.Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5fa083af60b0aa4c194598f623c6e8d1f486c0dd411141e7011dc73f2eb16048
3
+ size 3492975328
Meraj-Mini.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:606feb552c74072632d729040d0ed68c9c832f736c331863d499e4813c3515e0
3
+ size 4683680480
Meraj-Mini.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bcbf0a6ff5f9ec8e030a6f8e174d7b12cf68990cc4a99e2c6f623f7c2c7bab7c
3
+ size 4458375904
Meraj-Mini.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6c66f99d798a485980a12d0dc3058d1de747fb30348a39ae75e89be102e69334
3
+ size 5445438176
Meraj-Mini.Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c0c89f579bfab30e3500cf91ca9d49a6f57ca6218dba70fa3bbf418bb133b4e0
3
+ size 5315783392
Meraj-Mini.Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bd1fa870bbf5b0435608ce6ef00fa087f23331139de5f656a52ce68bdcd5fbb2
3
+ size 6254805728
Meraj-Mini.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e11629392eb701aa56fa38026b662eb9c2eb45ba1379d44e852822adba46b3df
3
+ size 8099132128
Meraj-Mini.fp16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b51e276d5d46bc2340a2356e7577f4923bf85de40b8cf957b30ad56326ba1a11
3
+ size 15238459872
README.md ADDED
@@ -0,0 +1,46 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - quantized
4
+ - 2-bit
5
+ - 3-bit
6
+ - 4-bit
7
+ - 5-bit
8
+ - 6-bit
9
+ - 8-bit
10
+ - GGUF
11
+ - text-generation
12
+ - text-generation
13
+ model_name: Meraj-Mini-GGUF
14
+ base_model: arcee-ai/Meraj-Mini
15
+ inference: false
16
+ model_creator: arcee-ai
17
+ pipeline_tag: text-generation
18
+ quantized_by: MaziyarPanahi
19
+ ---
20
+ # [MaziyarPanahi/Meraj-Mini-GGUF](https://huggingface.co/MaziyarPanahi/Meraj-Mini-GGUF)
21
+ - Model creator: [arcee-ai](https://huggingface.co/arcee-ai)
22
+ - Original model: [arcee-ai/Meraj-Mini](https://huggingface.co/arcee-ai/Meraj-Mini)
23
+
24
+ ## Description
25
+ [MaziyarPanahi/Meraj-Mini-GGUF](https://huggingface.co/MaziyarPanahi/Meraj-Mini-GGUF) contains GGUF format model files for [arcee-ai/Meraj-Mini](https://huggingface.co/arcee-ai/Meraj-Mini).
26
+
27
+ ### About GGUF
28
+
29
+ GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
30
+
31
+ Here is an incomplete list of clients and libraries that are known to support GGUF:
32
+
33
+ * [llama.cpp](https://github.com/ggerganov/llama.cpp). The source project for GGUF. Offers a CLI and a server option.
34
+ * [llama-cpp-python](https://github.com/abetlen/llama-cpp-python), a Python library with GPU accel, LangChain support, and OpenAI-compatible API server.
35
+ * [LM Studio](https://lmstudio.ai/), an easy-to-use and powerful local GUI for Windows and macOS (Silicon), with GPU acceleration. Linux available, in beta as of 27/11/2023.
36
+ * [text-generation-webui](https://github.com/oobabooga/text-generation-webui), the most widely used web UI, with many features and powerful extensions. Supports GPU acceleration.
37
+ * [KoboldCpp](https://github.com/LostRuins/koboldcpp), a fully featured web UI, with GPU accel across all platforms and GPU architectures. Especially good for story telling.
38
+ * [GPT4All](https://gpt4all.io/index.html), a free and open source local running GUI, supporting Windows, Linux and macOS with full GPU accel.
39
+ * [LoLLMS Web UI](https://github.com/ParisNeo/lollms-webui), a great web UI with many interesting and unique features, including a full model library for easy model selection.
40
+ * [Faraday.dev](https://faraday.dev/), an attractive and easy to use character-based chat GUI for Windows and macOS (both Silicon and Intel), with GPU acceleration.
41
+ * [candle](https://github.com/huggingface/candle), a Rust ML framework with a focus on performance, including GPU support, and ease of use.
42
+ * [ctransformers](https://github.com/marella/ctransformers), a Python library with GPU accel, LangChain support, and OpenAI-compatible AI server. Note, as of time of writing (November 27th 2023), ctransformers has not been updated in a long time and does not support many recent models.
43
+
44
+ ## Special thanks
45
+
46
+ 🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.