Hugging Face's logo

KoboldAI
/
LLaMA2-13B-Tiefighter-GGUF

GGUF
Inference Endpoints
Model card Files
aaxaxax commited on
Commit
77c9acb
•
1 Parent(s): 736bdbd

Release GGUF

Browse files
Files changed (14) hide show
  1. LLaMA2-13B-Tiefighter.F16.gguf +3 -0
  2. LLaMA2-13B-Tiefighter.Q2_K.gguf +3 -0
  3. LLaMA2-13B-Tiefighter.Q3_K_L.gguf +3 -0
  4. LLaMA2-13B-Tiefighter.Q3_K_M.gguf +3 -0
  5. LLaMA2-13B-Tiefighter.Q3_K_S.gguf +3 -0
  6. LLaMA2-13B-Tiefighter.Q4_0.gguf +3 -0
  7. LLaMA2-13B-Tiefighter.Q4_1.gguf +3 -0
  8. LLaMA2-13B-Tiefighter.Q4_K_M.gguf +3 -0
  9. LLaMA2-13B-Tiefighter.Q4_K_S.gguf +3 -0
  10. LLaMA2-13B-Tiefighter.Q5_0.gguf +3 -0
  11. LLaMA2-13B-Tiefighter.Q5_1.gguf +3 -0
  12. LLaMA2-13B-Tiefighter.Q5_K_M.gguf +3 -0
  13. LLaMA2-13B-Tiefighter.Q6_K.gguf +3 -0
  14. LLaMA2-13B-Tiefighter.Q8_0.gguf +3 -0
LLaMA2-13B-Tiefighter.F16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:23f536e60baf93e0d20f7a432d32c0d819f662570982a4b09790c56ef115afd5
3
+ size 26033303424
LLaMA2-13B-Tiefighter.Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:60cfeab4e9481dbc91554955cb12cc6586644c9c6aa5c39677988785137609e8
3
+ size 5429348288
LLaMA2-13B-Tiefighter.Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d0e0e1e84bd5470e9ad81791b102fc1a1cf08633f6544e1ebeeed39f03d49b4f
3
+ size 6929559488
LLaMA2-13B-Tiefighter.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6ad3ec7a074496350e6d49bb3499faefbaeda60a55a1aee543c18394b2f8b8b1
3
+ size 6337769408
LLaMA2-13B-Tiefighter.Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:743152c6588dd3dfc892fde876389f460848c25daa0488923176c50c29820bd0
3
+ size 5658980288
LLaMA2-13B-Tiefighter.Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:159619f7786da3fccfd2af25c5144d824c09b98f88093b5938dc6a89db2e683f
3
+ size 7365834688
LLaMA2-13B-Tiefighter.Q4_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:90b9368391d96a34975c6d76e9b2f4bf791d969254375cf9dcd9efc62dde3840
3
+ size 8169060288
LLaMA2-13B-Tiefighter.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ea97134b32f2e282cc0e245f9d53902115d3b17b84b7c18b1190bf095220c582
3
+ size 7865956288
LLaMA2-13B-Tiefighter.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dd4fcee944c5a4fbdad06b93acb58d4ce56f729235501fccbbae63dc243a7ed7
3
+ size 7414331328
LLaMA2-13B-Tiefighter.Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d435edc1893c466a8a7fe6b854c173ddcc75ad8220fcfdfda9f5fd4872388499
3
+ size 8972285888
LLaMA2-13B-Tiefighter.Q5_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ef5d089c1a8f8ff34e1cbbd6cd0306bf5eceeb9ca8dcb33b47517d3c937822a5
3
+ size 9775511488
LLaMA2-13B-Tiefighter.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fbcbec3d8f11de536496e1fbbdb30b8bb2c8d505b9d2c986054eba03c58cf23a
3
+ size 9229924288
LLaMA2-13B-Tiefighter.Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eff24af123a6dbb36b76c610a8b556dcb881e251edc01ea149da05a1ffabd51c
3
+ size 10679140288
LLaMA2-13B-Tiefighter.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3d60cae60e7692f6de06fa1886b772f831d18afdabbbad20d7956a25b74ba334
3
+ size 13831319488