|
--- |
|
title: README |
|
emoji: 🐢 |
|
colorFrom: blue |
|
colorTo: green |
|
sdk: static |
|
pinned: false |
|
--- |
|
|
|
# Mukayese: Turkish NLP Strikes Back |
|
|
|
Turkish Natural Language Processing is left behind in developing state-of-the-art systems due to a lack of organized benchmarks and baselines. We fill this gap with __Mukayese__ (Turkish word for "comparison/benchmarking"), an extensive set of datasets and benchmarks for several Turkish NLP tasks. All of the datasets and code have been made public in this repository. |
|
|
|
--- |
|
## Updates |
|
|
|
- (22/03/2022) Summarization models are online on Huggingface! |
|
- (25/02/2022) Datasets have been made available through pre-release [v0.0.1](https://github.com/alisafaya/mukayese/releases/tag/v0.0.1) |
|
|
|
--- |
|
## What to do with Mukayese ? |
|
|
|
With Mukayese, researchers of Turkish NLP will be able to: |
|
|
|
- Compare the performance of existing methods in leaderboards. |
|
- Access existing implementations of NLP baselines. |
|
- Evaluate their own methods on the relevant test datasets. |
|
- Submit their own work to be enlisted in our leaderboards. |
|
|
|
## Mukayese's Mission |
|
|
|
The most important goal of Mukayese is to standardize the comparison and evaluation of Turkish NLP methods. As a result of the lack of a platform for benchmarking, Turkish NLP researchers struggle with comparing their models to the existing ones. |
|
|
|
|
