<commit_before>---
layout: post
title: Detecting Machine Translation
---

Code and dataset available on the project [Github](https://github.com/Joao-M-Almeida/JEECUnbabelChallenge).<commit_msg>Work on the Unbabel post<commit_after>---
layout: post
title: Detecting Machine Translation
---
### TL;DR
 I and <NAME> decided to participate on the JEEC/Unbabel Machine Translation Detection Challenge, we ended in 4th place. The Code and dataset are available on the project [Github](https://github.com/Joao-M-Almeida/JEECUnbabelChallenge).

### The Challenge


At the [JEEC16](http://jeec.tecnico.pt/jeec16/) (a Electrical and Computer Engineering event organized by the students at [Técnico](http://tecnico.ulisboa.pt)) conference [Unbabel](https://unbabel.com/) (a Portuguese startup that does human powered machine translation) went to give a talk and proposed a challenge to the students attending. I and <NAME> decided to participate.

The __goal__ of the challenge was, given a dataset, to create a model that would distinguish between human translated and machine translated.


### Final Results:
  Voting Classifier based on LDA, LogisticRegression and AdaBoost with Dimensionality reduction by Pricinpal component analysis achieved a cross validation score of (55.0 +/- 1.6)% and a final result of 57.8%.

#### Global Results:
1. <NAME>: 59.72%
2. <NAME>: 59.22%
3. <NAME>, <NAME>: 58.39%
4. __<NAME>, <NAME>: 57.80%__
5. <NAME>, <NAME>: 56.34%
6. <NAME>: 55.62%
7. <NAME>, <NAME>: 51.77%
8. <NAME>, <NAME>: 50.25%
9. <NAME>: 47.86%
10. <NAME>: 47.61%
11. <NAME>: 45.56%
12. <NAME>: 40.43%
13. <NAME>, <NAME>: 0.00% (file missing results)
{'fraction_non_alphanumeric': 0.13329275715155203, 'fraction_numerical': 0.049300060864272674, 'mean_word_length': 4.461794019933555, 'pattern_counts': {'":': 0, '<': 24, '<?xml version=': 0, '>': 24, 'https://': 3, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5994456', 'n_tokens_mistral': 582, 'n_tokens_neox': 510, 'n_words': 204}