English
LLM
BELLE
benleader commited on
Commit
de1720f
1 Parent(s): be393fd

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -10,7 +10,7 @@ tags:
10
 
11
  lyraBELLE is currently the **fastest BELLE model** available. To the best of our knowledge, it is the **first accelerated version of BELLE**.
12
 
13
- The inference speed of lyraBELLE has achieved **3x+** acceleration upon the original version.
14
 
15
  Among its main features are:
16
 
@@ -20,7 +20,7 @@ Among its main features are:
20
  Note that:
21
  **Some interface/code were set for future uses(see demo below).**
22
 
23
- - **int8 mode**: not supported yet, please always set it to 0
24
  - **data type**: only `fp16` available.
25
 
26
 
@@ -34,7 +34,7 @@ Note that:
34
  - percision:fp16
35
  - batch size:64
36
  - language: chinese, keep same in a batch.
37
- - do_sample: True, model generate slightly different answser to same question.
38
 
39
 
40
  |version|speed|
 
10
 
11
  lyraBELLE is currently the **fastest BELLE model** available. To the best of our knowledge, it is the **first accelerated version of BELLE**.
12
 
13
+ The inference speed of lyraBELLE has achieved **3.3x+** acceleration upon the original version.
14
 
15
  Among its main features are:
16
 
 
20
  Note that:
21
  **Some interface/code were set for future uses(see demo below).**
22
 
23
+ - **int8 mode**: not supported yet, please always set it at 0
24
  - **data type**: only `fp16` available.
25
 
26
 
 
34
  - percision:fp16
35
  - batch size:64
36
  - language: chinese, keep same in a batch.
37
+ - do_sample: True, model generate slightly different answser to the same question.
38
 
39
 
40
  |version|speed|