Hugging Face's logo

backyardai
/
Yi-34B-200K-RPMerge-GGUF

Transformers
GGUF
English
mergekit
Merge
Yi
exllama
exllamav2
exl2
Inference Endpoints
Model card Files Community
brooketh commited on
Commit
9600e7a
•
1 Parent(s): 0f9aaf1

Upload Yi-34B-200K-RPMerge-GGUF

Browse files
Files changed (28) hide show
  1. .gitattributes +24 -0
  2. BackyardAI_Banner.png +0 -0
  3. BackyardAI_Logo.png +0 -0
  4. README.md +52 -0
  5. Yi-34B-200K-RPMerge-split-00001-of-00003.gguf +3 -0
  6. Yi-34B-200K-RPMerge-split-00002-of-00003.gguf +3 -0
  7. Yi-34B-200K-RPMerge-split-00003-of-00003.gguf +3 -0
  8. Yi-34B-200K-RPMerge.IQ1_M.gguf +3 -0
  9. Yi-34B-200K-RPMerge.IQ1_S.gguf +3 -0
  10. Yi-34B-200K-RPMerge.IQ2_M.gguf +3 -0
  11. Yi-34B-200K-RPMerge.IQ2_S.gguf +3 -0
  12. Yi-34B-200K-RPMerge.IQ2_XS.gguf +3 -0
  13. Yi-34B-200K-RPMerge.IQ2_XXS.gguf +3 -0
  14. Yi-34B-200K-RPMerge.IQ3_M.gguf +3 -0
  15. Yi-34B-200K-RPMerge.IQ3_S.gguf +3 -0
  16. Yi-34B-200K-RPMerge.IQ3_XS.gguf +3 -0
  17. Yi-34B-200K-RPMerge.IQ3_XXS.gguf +3 -0
  18. Yi-34B-200K-RPMerge.IQ4_XS.gguf +3 -0
  19. Yi-34B-200K-RPMerge.Q3_K_L.gguf +3 -0
  20. Yi-34B-200K-RPMerge.Q3_K_M.gguf +3 -0
  21. Yi-34B-200K-RPMerge.Q3_K_S.gguf +3 -0
  22. Yi-34B-200K-RPMerge.Q4_K_M.gguf +3 -0
  23. Yi-34B-200K-RPMerge.Q4_K_S.gguf +3 -0
  24. Yi-34B-200K-RPMerge.Q5_K_M.gguf +3 -0
  25. Yi-34B-200K-RPMerge.Q5_K_S.gguf +3 -0
  26. Yi-34B-200K-RPMerge.Q6_K.gguf +3 -0
  27. Yi-34B-200K-RPMerge.Q8_0.gguf +3 -0
  28. Yi-34B-200K-RPMerge.imatrix +3 -0
.gitattributes CHANGED
@@ -33,3 +33,27 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Yi-34B-200K-RPMerge-split-00001-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Yi-34B-200K-RPMerge-split-00002-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Yi-34B-200K-RPMerge-split-00003-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Yi-34B-200K-RPMerge.IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Yi-34B-200K-RPMerge.IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Yi-34B-200K-RPMerge.IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Yi-34B-200K-RPMerge.IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Yi-34B-200K-RPMerge.IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Yi-34B-200K-RPMerge.IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Yi-34B-200K-RPMerge.IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Yi-34B-200K-RPMerge.IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Yi-34B-200K-RPMerge.IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
48
+ Yi-34B-200K-RPMerge.IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
49
+ Yi-34B-200K-RPMerge.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
50
+ Yi-34B-200K-RPMerge.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
51
+ Yi-34B-200K-RPMerge.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
52
+ Yi-34B-200K-RPMerge.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
53
+ Yi-34B-200K-RPMerge.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
54
+ Yi-34B-200K-RPMerge.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
55
+ Yi-34B-200K-RPMerge.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
56
+ Yi-34B-200K-RPMerge.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
57
+ Yi-34B-200K-RPMerge.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
58
+ Yi-34B-200K-RPMerge.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
59
+ Yi-34B-200K-RPMerge.imatrix filter=lfs diff=lfs merge=lfs -text
BackyardAI_Banner.png ADDED
BackyardAI_Logo.png ADDED
README.md ADDED
@@ -0,0 +1,52 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ license: other
5
+ library_name: transformers
6
+ tags:
7
+ - mergekit
8
+ - merge
9
+ - Yi
10
+ - exllama
11
+ - exllamav2
12
+ - exl2
13
+ base_model: brucethemoose/Yi-34B-200K-RPMerge
14
+ model_name: Yi-34B-200K-RPMerge-GGUF
15
+ license_name: yi-license
16
+ license_link: https://huggingface.co/01-ai/Yi-34B/blob/main/LICENSE
17
+ quantized_by: brooketh
18
+ parameter_count: 34388945920
19
+ ---
20
+ <img src="BackyardAI_Banner.png" alt="Backyard.ai" style="height: 90px; min-width: 32px; display: block; margin: auto;">
21
+
22
+ **<p style="text-align: center;">The official library of GGUF format models for use in the local AI chat app, Backyard AI.</p>**
23
+
24
+ <p style="text-align: center;"><a href="https://backyard.ai/">Download Backyard AI here to get started.</a></p>
25
+
26
+ <p style="text-align: center;"><a href="https://www.reddit.com/r/LLM_Quants/">Request Additional models at r/LLM_Quants.</a></p>
27
+
28
+ ***
29
+ # Yi 200K RPMerge 34B
30
+ - **Creator:** [brucethemoose](https://huggingface.co/brucethemoose/)
31
+ - **Original:** [Yi 200K RPMerge 34B](https://huggingface.co/brucethemoose/Yi-34B-200K-RPMerge)
32
+ - **Date Created:** 2024-02-07
33
+ - **Trained Context:** 200000 tokens
34
+ - **Description:** A merge of several Yi 34B models with the goal of instruct-enhanced storytelling at 40K+ context. Very coherent, with a unique personality that feels genuine without being too casual.
35
+ ***
36
+ ## What is a GGUF?
37
+ GGUF is a large language model (LLM) format that can be split between CPU and GPU. GGUFs are compatible with applications based on llama.cpp, such as Backyard AI. Where other model formats require higher end GPUs with ample VRAM, GGUFs can be efficiently run on a wider variety of hardware.
38
+ GGUF models are quantized to reduce resource usage, with a tradeoff of reduced coherence at lower quantizations. Quantization reduces the precision of the model weights by changing the number of bits used for each weight.
39
+
40
+ ***
41
+ <img src="BackyardAI_Logo.png" alt="Backyard.ai" style="height: 75px; min-width: 32px; display: block; horizontal align: left;">
42
+
43
+ ## Backyard AI
44
+ - Free, local AI chat application.
45
+ - One-click installation on Mac and PC.
46
+ - Automatically use GPU for maximum speed.
47
+ - Built-in model manager.
48
+ - High-quality character hub.
49
+ - Zero-config desktop-to-mobile tethering.
50
+ Backyard AI makes it easy to start chatting with AI using your own characters or one of the many found in the built-in character hub. The model manager helps you find the latest and greatest models without worrying about whether it's the correct format. Backyard AI supports advanced features such as lorebooks, author's note, text formatting, custom context size, sampler settings, grammars, local TTS, cloud inference, and tethering, all implemented in a way that is straightforward and reliable.
51
+ **Join us on [Discord](https://discord.gg/SyNN2vC9tQ)**
52
+ ***
Yi-34B-200K-RPMerge-split-00001-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:47875494392f682d6d24d3688c31478f34a6daf8f506ed45b551026078dd05a2
3
+ size 49870956416
Yi-34B-200K-RPMerge-split-00002-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:15510121d458521021a3fe3bd6bfefcb421bf9559b7e7b65304266c177c14020
3
+ size 49443700768
Yi-34B-200K-RPMerge-split-00003-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d51776f4dbaed270923d5aa356d0597bf267cdfd1464d3241fd04e4dd66d1c6e
3
+ size 38242636416
Yi-34B-200K-RPMerge.IQ1_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4b9058f1e97a20d03f8e6626d50fed48d7465993e6447bd23255aa9bce275143
3
+ size 8176800416
Yi-34B-200K-RPMerge.IQ1_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f066b191004110d7c93fd15c9ce89f63368141105f6afab1d2c45f14663364d4
3
+ size 7498994336
Yi-34B-200K-RPMerge.IQ2_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:90b6dd691a7ff51ab07f0a4c280b6a9b7ae6e24dd21d1280ea61c2eebcc5bfb8
3
+ size 11794778208
Yi-34B-200K-RPMerge.IQ2_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9fbc916f863aa937df11d52b5b34746a3a3d879a03e9ec850b805792a42ffe99
3
+ size 10891036768
Yi-34B-200K-RPMerge.IQ2_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:20bc62b72e0c64f109db872b59801c9584e761b3edbd08747c2953cca575f92a
3
+ size 10306556576
Yi-34B-200K-RPMerge.IQ2_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:062f19717290ec5c473d17d69d36693cd9fa6f36ea3f557ec737386dcf5af9bf
3
+ size 9306477216
Yi-34B-200K-RPMerge.IQ3_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bf54edf3443905059ca88e708db8cbe042a3b281b42b9b45792784dc5a9d2aad
3
+ size 15564718048
Yi-34B-200K-RPMerge.IQ3_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f79f4788f2f1718a1ba266356c742d69347b5edf6414e455b87acd43fdca9617
3
+ size 15018803168
Yi-34B-200K-RPMerge.IQ3_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d059015ba742ec8245d4c43489771fb5fc39fb0ee54bafbe7605f96e5b6aa081
3
+ size 14234337248
Yi-34B-200K-RPMerge.IQ3_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cf515c0b746ce8e5e8611c79a4800a16144b72d240d9410f5edef56d83c7df5b
3
+ size 13333891168
Yi-34B-200K-RPMerge.IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:05bdeee450041941e7198d87e6d2dbe27277883b161e7081574d1e97d40fb0a1
3
+ size 18475070848
Yi-34B-200K-RPMerge.Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f98e9a097dcc155c43e50239bd3a1ac597898d562952fb55bf1bd2f063234504
3
+ size 18139463424
Yi-34B-200K-RPMerge.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:af0c4fb22ab70b53fc1a0aa3285d5e2b26bb8daab16a8f16e2469766c2c272f7
3
+ size 16654941952
Yi-34B-200K-RPMerge.Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b51585f791e6d96e96586ef39ed37e57d5d8d4c2a49ea3469db2a52ebf3b6c6d
3
+ size 14960312064
Yi-34B-200K-RPMerge.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7ebff27a76505116be5fc4e586c1b0cf71e3925edcdfb061eb302bac8a8a8f20
3
+ size 20658730592
Yi-34B-200K-RPMerge.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bd867fa6150938e9b99488b9a29c700dca236415379bf587ceee398ac4c1ad5b
3
+ size 19598669408
Yi-34B-200K-RPMerge.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eab16faaa991aaab7ee7e4921cf8c690afb3f178e16f98c9772e29ae7a4fb555
3
+ size 24321867104
Yi-34B-200K-RPMerge.Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4106cd7395a17834800a471a3325ddd51b119f7645ca97c371873af3a8243f83
3
+ size 23707712864
Yi-34B-200K-RPMerge.Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f0740be3aca598b70b94fb5deb09f4b381c5f7fda5dcd6582b522519e0b77a66
3
+ size 28213949664
Yi-34B-200K-RPMerge.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e0a942999f1e81f69a3d2536cc50999648af243820ae4a1e61f58172a672337f
3
+ size 36542312416
Yi-34B-200K-RPMerge.imatrix ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a7d7f2502f81eb9df32850ca8b859a17705a8e195b660ed8e33adbfc63a93b14
3
+ size 15251061