<commit_before>korean [![Build Status](https://travis-ci.org/atomaths/korean.png)](https://travis-ci.org/atomaths/korean)
======
korean Go package is just a wrapper in which EUC-KR, encoder, decoder in code.google.com/p/go.text/encoding/korean package.

Installation
============

```bash
$ go get github.com/atomaths/korean
```

Usage
=====

```Go
import "github.com/atomaths/korean"
```

```Go
src := "\xb9\xe6\xb0\xa1\xb9\xe6\xb0\xa1\x20\xb0\xed\xc6\xdb"
dst, _ := korean.UTF8([]byte(s))
fmt.Println(string(dst)) // Output: 방가방가 고퍼
```

```Go
src := "방가방가 고퍼"
dst, _ = korean.EUCKR([]byte(src))
for _, v := range dst {
        fmt.Printf("\\x%x", v)
        // Output: \xb9\xe6\xb0\xa1\xb9\xe6\xb0\xa1\x20\xb0\xed\xc6\xdb
}
```
<commit_msg>fix to correct ci string<commit_after>korean [![Build Status](https://travis-ci.org/atomaths/korean.png?branch=master)](https://travis-ci.org/atomaths/korean)
======
korean Go package is just a wrapper in which EUC-KR, encoder, decoder in code.google.com/p/go.text/encoding/korean package.

Installation
============

```bash
$ go get github.com/atomaths/korean
```

Usage
=====

```Go
import "github.com/atomaths/korean"
```

```Go
src := "\xb9\xe6\xb0\xa1\xb9\xe6\xb0\xa1\x20\xb0\xed\xc6\xdb"
dst, _ := korean.UTF8([]byte(s))
fmt.Println(string(dst)) // Output: 방가방가 고퍼
```

```Go
src := "방가방가 고퍼"
dst, _ = korean.EUCKR([]byte(src))
for _, v := range dst {
        fmt.Printf("\\x%x", v)
        // Output: \xb9\xe6\xb0\xa1\xb9\xe6\xb0\xa1\x20\xb0\xed\xc6\xdb
}
```

{'fraction_non_alphanumeric': 0.22898742554599602, 'fraction_numerical': 0.03309066843150232, 'mean_word_length': 3.769716088328076, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 4, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '6449023', 'n_tokens_mistral': 719, 'n_tokens_neox': 684, 'n_words': 104}