<commit_before>---
layout: model
title: Hebrew Lemmatizer
author: <NAME>
name: lemma
date: 2020-12-09
tags: [lemmatizer, he, open_source]
article_header:
  type: cover
use_language_switcher: "Python-Scala-Java"
---

## Description

This model uses context and language knowledge to assign all forms and inflections of a word to a single root. This enables the pipeline to treat the past and present tense of a verb, for example, as the same word instead of two completely different words. The lemmatizer takes into consideration the context surrounding a word to determine which root is correct when the word form alone is ambiguous.

{:.btn-box}
<button class="button button-orange" disabled>Live Demo</button>
[Open in Colab](https://colab.research.google.com/github/JohnSnowLabs/spark-nlp-workshop/blob/b2eb08610dd49d5b15077cc499a94b4ec1e8b861/jupyter/annotation/english/model-downloader/Create%20custom%20pipeline%20-%20NerDL.ipynb){:.button.button-orange.button-orange-trans.co.button-icon}
[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/lemma_he_2.7.0_2.4_1607522684355.zip){:.button.button-orange.button-orange-trans.arr.button-icon}

## How to use

Use as part of a pipeline after tokenisation.<commit_msg>[skip_ci] new metadata lines added to 14.file 2020-12-09-lemma_he.md<commit_after>---
layout: model
title: Hebrew Lemmatizer
author: <NAME>
name: lemma
date: 2020-12-09
task: Lemmatization
language: he
edition: Spark NLP 2.7.0
tags: [lemmatizer, he, open_source]
article_header:
  type: cover
use_language_switcher: "Python-Scala-Java"
---

## Description

This model uses context and language knowledge to assign all forms and inflections of a word to a single root. This enables the pipeline to treat the past and present tense of a verb, for example, as the same word instead of two completely different words. The lemmatizer takes into consideration the context surrounding a word to determine which root is correct when the word form alone is ambiguous.

{:.btn-box}
<button class="button button-orange" disabled>Live Demo</button>
[Open in Colab](https://colab.research.google.com/github/JohnSnowLabs/spark-nlp-workshop/blob/b2eb08610dd49d5b15077cc499a94b4ec1e8b861/jupyter/annotation/english/model-downloader/Create%20custom%20pipeline%20-%20NerDL.ipynb){:.button.button-orange.button-orange-trans.co.button-icon}
[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/lemma_he_2.7.0_2.4_1607522684355.zip){:.button.button-orange.button-orange-trans.arr.button-icon}

## How to use

Use as part of a pipeline after tokenisation.
{'fraction_non_alphanumeric': 0.10165575664227955, 'fraction_numerical': 0.05121293800539083, 'mean_word_length': 5.4148148148148145, 'pattern_counts': {'":': 0, '<': 9, '<?xml version=': 0, '>': 9, 'https://': 4, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 4, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5555044', 'n_tokens_mistral': 927, 'n_tokens_neox': 829, 'n_words': 238}