aisuko commited on
Commit
e1c6e50
1 Parent(s): 9aa0696

Add readme for phi-3

Browse files

Signed-off-by: Aisuko <[email protected]>

Files changed (1) hide show
  1. README.md +46 -0
README.md CHANGED
@@ -1,3 +1,49 @@
1
  ---
2
  license: mit
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: mit
3
  ---
4
+
5
+ We use the same model from Microsoft [microsoft/Phi-3-mini-4k-instruct-gguf](https://huggingface.co/microsoft/Phi-3-mini-4k-instruct-gguf/tree/main)
6
+
7
+ ```markdown
8
+
9
+ system_info: n_threads = 4 / 8 | AVX = 1 | AVX_VNNI = 1 | AVX2 = 1 | AVX512 = 1 | AVX512_VBMI = 1 | AVX512_VNNI = 1 | AVX512_BF16 = 1 | FMA = 1 | NEON = 0 | SVE = 0 | ARM_FMA = 0 | F16C = 1 | FP16_VA = 0 | WASM_SIMD = 0 | BLAS = 0 | SSE3 = 1 | SSSE3 = 1 | VSX = 0 | MATMUL_INT8 = 0 | LLAMAFILE = 1 |
10
+ main: interactive mode on.
11
+ Reverse prompt: 'User:'
12
+ sampling:
13
+ repeat_last_n = 64, repeat_penalty = 1.000, frequency_penalty = 0.000, presence_penalty = 0.000
14
+ top_k = 40, tfs_z = 1.000, top_p = 0.950, min_p = 0.050, typical_p = 1.000, temp = 0.800
15
+ mirostat = 0, mirostat_lr = 0.100, mirostat_ent = 5.000
16
+ sampling order:
17
+ CFG -> Penalties -> top_k -> tfs_z -> typical_p -> top_p -> min_p -> temperature
18
+ generate: n_ctx = 4096, n_batch = 2048, n_predict = 256, n_keep = 1
19
+
20
+
21
+ == Running in interactive mode. ==
22
+ - Press Ctrl+C to interject at any time.
23
+ - Press Return to return control to the AI.
24
+ - To return control without starting a new line, end your input with '/'.
25
+ - If you want to submit another line, end your input with '\'.
26
+
27
+ Transcript of a dialog, where the User interacts with an Assistant named Bob. Bob is helpful, kind, honest, good at writing, and never fails to answer the User's requests immediately and with precision.
28
+
29
+ User: Hello, Bob.
30
+ Bob: Hello. How may I help you today?
31
+ User: Please tell me the largest city in Europe.
32
+ Bob: Sure. The largest city in Europe is Moscow, the capital of Russia.
33
+ User:What is the largest city in Australia?
34
+ Bob: The largest city in Australia is Sydney.
35
+ User:What is the largest city in US?
36
+ Bob: The largest city in the United States by population is New York City.
37
+ User:thanks
38
+ Bob: You're welcome! If you have any more questions, feel free to ask.
39
+
40
+ Here's a transcript of a dialog, where the User interacts with an Assistant named Bob. Bob is helpful, kind, honest, good at writing, and never fails to answer the User's requests immediately and with precision. Additionally, Bob is proficient in providing detailed historical and cultural contexts for the information he provides.
41
+
42
+ User:
43
+
44
+ llama_print_timings: load time = 833.57 ms
45
+ llama_print_timings: sample time = 3.84 ms / 127 runs ( 0.03 ms per token, 33055.70 tokens per second)
46
+ llama_print_timings: prompt eval time = 14225.02 ms / 121 tokens ( 117.56 ms per token, 8.51 tokens per second)
47
+ llama_print_timings: eval time = 9098.34 ms / 124 runs ( 73.37 ms per token, 13.63 tokens per second)
48
+ llama_print_timings: total time = 70052.27 ms / 245 tokens
49
+ ```