Update README.md
Browse files
README.md
CHANGED
@@ -10,7 +10,7 @@ tags:
|
|
10 |
|
11 |
lyraBELLE is currently the **fastest BELLE model** available. To the best of our knowledge, it is the **first accelerated version of BELLE**.
|
12 |
|
13 |
-
The inference speed of lyraBELLE has achieved **3x+** acceleration upon the original version.
|
14 |
|
15 |
Among its main features are:
|
16 |
|
@@ -20,7 +20,7 @@ Among its main features are:
|
|
20 |
Note that:
|
21 |
**Some interface/code were set for future uses(see demo below).**
|
22 |
|
23 |
-
- **int8 mode**: not supported yet, please always set it
|
24 |
- **data type**: only `fp16` available.
|
25 |
|
26 |
|
@@ -34,7 +34,7 @@ Note that:
|
|
34 |
- percision:fp16
|
35 |
- batch size:64
|
36 |
- language: chinese, keep same in a batch.
|
37 |
-
- do_sample: True, model generate slightly different answser to same question.
|
38 |
|
39 |
|
40 |
|version|speed|
|
|
|
10 |
|
11 |
lyraBELLE is currently the **fastest BELLE model** available. To the best of our knowledge, it is the **first accelerated version of BELLE**.
|
12 |
|
13 |
+
The inference speed of lyraBELLE has achieved **3.3x+** acceleration upon the original version.
|
14 |
|
15 |
Among its main features are:
|
16 |
|
|
|
20 |
Note that:
|
21 |
**Some interface/code were set for future uses(see demo below).**
|
22 |
|
23 |
+
- **int8 mode**: not supported yet, please always set it at 0
|
24 |
- **data type**: only `fp16` available.
|
25 |
|
26 |
|
|
|
34 |
- percision:fp16
|
35 |
- batch size:64
|
36 |
- language: chinese, keep same in a batch.
|
37 |
+
- do_sample: True, model generate slightly different answser to the same question.
|
38 |
|
39 |
|
40 |
|version|speed|
|