phi0112358 commited on
Commit
84b5e7b
1 Parent(s): 365edf6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +72 -0
README.md CHANGED
@@ -1,3 +1,75 @@
1
  ---
2
  license: apache-2.0
 
 
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
+ datasets:
4
+ - yahma/alpaca-cleaned
5
+ language:
6
+ - de
7
+ tags:
8
+ - llama
9
+ - alpaca
10
+ - ggml
11
+ - german
12
+ - deutsch
13
+ - zicklein
14
  ---
15
+
16
+ # ---
17
+
18
+ # Zicklein: A german finetuned instruction LLaMA 🇩🇪
19
+
20
+
21
+ ## This is a ggml conversion of [Zicklein](https://github.com/avocardio/zicklein) 7B.
22
+
23
+ ## Zicklein itself is a LLaMA finetuned model with the cleaned and into german translated [Alpaca](https://github.com/tatsu-lab/stanford_alpaca) [dataset](https://github.com/LEL-A/GerAlpacaDataCleaned).
24
+
25
+ Currently I have only converted it into **new k-quant method Q5_K_M**. I will gladly make more versions on request.
26
+
27
+ Other possible quantizations include: q2_K, q3_K_S, q3_K_M, q3_K_L, q4_K_S, q4_K_M, q5_K_S, q5_K_M, q6_K
28
+
29
+ A f-16 version could be found here: [nikuya3/alpaca-lora-7b-german-base-51k-ggml](https://huggingface.co/nikuya3/alpaca-lora-7b-german-base-51k-ggml)
30
+
31
+ Compatible with llama.cpp, but also with:
32
+
33
+ - text-generation-webui
34
+ - KoboldCpp
35
+ - ParisNeo/GPT4All-UI
36
+ - llama-cpp-python
37
+ - ctransformers
38
+
39
+
40
+
41
+ ### Prompt format
42
+
43
+ Since this model is based on alpaca dataset, the right prompt formatting should look like this:
44
+
45
+ ```
46
+ Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.
47
+
48
+ ### Instruction:
49
+ {instruction}
50
+
51
+ ### Input:
52
+ {input}
53
+
54
+ ### Response:
55
+ ```
56
+
57
+
58
+ Or without addiotional input:
59
+
60
+
61
+ ```
62
+
63
+ Below is an instruction that describes a task. Write a response that appropriately completes the request.
64
+
65
+ ### Instruction:
66
+ {instruction}
67
+
68
+ ### Response:
69
+ ```
70
+
71
+
72
+ ### That's it!
73
+
74
+
75
+ If you have any further questions, feel free to contact me or start a discussion