---
title: README
emoji: 🐢
colorFrom: blue
colorTo: green
sdk: static
pinned: false
---

# Mukayese: Turkish NLP Strikes Back

Turkish Natural Language Processing is left behind in developing state-of-the-art systems due to a lack of organized benchmarks and baselines. We fill this gap with __Mukayese__ (Turkish word for "comparison/benchmarking"), an extensive set of datasets and benchmarks for several Turkish NLP tasks. All of the datasets and code have been made public in this repository.

--- 
## Updates

- (22/03/2022) Summarization models are online on Huggingface!
- (25/02/2022) Datasets have been made available through pre-release [v0.0.1](https://github.com/alisafaya/mukayese/releases/tag/v0.0.1)

---
## What to do with Mukayese ?

With Mukayese, researchers of Turkish NLP will be able to:

 - Compare the performance of existing methods in leaderboards.
 - Access existing implementations of NLP baselines.
 - Evaluate their own methods on the relevant test datasets.
 - Submit their own work to be enlisted in our leaderboards.

## Mukayese's Mission

The most important goal of Mukayese is to standardize the comparison and evaluation of Turkish NLP methods. As a result of the lack of a platform for benchmarking, Turkish NLP researchers struggle with comparing their models to the existing ones.