Sungwoo Oh

sackoh

AI & ML interests

None yet

Recent Activity

Organizations

Posts 1

view post
Post
693
πŸš€ Release of open-source Korean LLM: GECKO-7B

I am delighted to share my recent project, GECKO, a bilingual large language model for Korean and English πŸ‡°πŸ‡·πŸ‡ΊπŸ‡Έ. This initiative was inspired by the lack of resources for Korean large language models.

@donggyukimc and I wrote the technical report to share our insights and experiences of developing our model. While our model may not achieve sate-of-the-art performance on all benchmarks, it shows modest results with a relatively small amount of pretrained tokens.

I hope GECKO contribute to the open-source community, offering resources that can built upon and improved. I believe that through collaboration and shared knowledge, we can advance the capabilities and accessibility of large language models for Korean and other low-resource languages.

πŸ€— Model: kifai/GECKO-7B
πŸ“„ Technical Report: https://arxiv.org/pdf/2405.15640