Building a Hongkongese Word Segmenter
In my previous story, I evaluated the performance of several NLP systems against Hong Kong data. One of the top performers is the CKIP Transformers. It is an interesting system, because it was built from fine-tuning a large language model (LLM) for the word segmentation task. The CKIP models are…
Building a Hongkongese Word Segmenter In my previous story, I evaluated the performance of several NLP systems against Hong Kong data. One of the top performers is the CKIP Transformers. It is an interesting system, because it was built from fine-tuning a large language model (LLM) for the word segmentation task. The CKIP models are… nlp
Building Hongkongese Word Segmenter previous story evaluated performance several NLP system Hong Kong data One top performer CKIP Transformers interesting system built finetuning large language model LLM word segmentation task CKIP model are… nlp