Add korean kenLMs
Browse filesFollowing the comment described in #2, I have prepared korean kenlms using [bigscience/data_tooling](https://github.com/bigscience-workshop/data_tooling/blob/master/kenlm_training/train_all.sh)
- wikipedia/ko.arpa.bin +3 -0
- wikipedia/ko.sp.model +3 -0
- wikipedia/ko.sp.vocab +3 -0
wikipedia/ko.arpa.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e45f3180ef205bd2cb0ac36d6c7e53117daa3b9e284d4e27bda1a23061130cb5
|
| 3 |
+
size 1908032350
|
wikipedia/ko.sp.model
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3fd02949c049a25e2689511c8d711bdb9e456fc09634e114283fef392583f7d9
|
| 3 |
+
size 952339
|
wikipedia/ko.sp.vocab
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b356c98232054e04090bec38768434f1dd6b6ebcc0ed615e36bc10501b03cfbf
|
| 3 |
+
size 750282
|