<commit_before><!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html lang="en-GB" xml:lang="en-GB" xmlns="http://www.w3.org/1999/xhtml">
  <head>
    <meta http-equiv="content-type" content="text/html; charset=utf-8"/>
    <title>Irish UD</title>
    <link rel="root" href=""/> <!-- for JS -->
    <link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/font-awesome/4.4.0/css/font-awesome.min.css">
    <link rel="stylesheet" type="text/css" href="../css/jquery-ui-redmond.css"/>
    <link rel="stylesheet" type="text/css" href="../css/style.css"/>
    <link rel="stylesheet" type="text/css" href="../css/style-vis.css"/>
    <link rel="stylesheet" type="text/css" href="../css/hint.css"/>
    <script type="text/javascript" src="../lib/ext/head.load.min.js"></script>
    <script type="text/javascript" src="../lib/ext/jquery.timeago.js"></script>
    <script src="https://cdnjs.cloudflare.com/ajax/libs/anchor-js/3.2.2/anchor.min.js"></script>
    <script>document.addEventListener("DOMContentLoaded", function(event) {anchors.add();});</script>
    <!-- Set up this custom Google search at https://cse.google.com/cse/business/settings?cx=001145188882102106025:dl1mehhcgbo -->
    <script>
      (function() {
        var cx = '001145188882102106025:dl1mehhcgbo';
        var gcse = document.createElement('script');
        gcse.type = 'text/javascript';
        gcse.async = true;
        gcse.src = 'https://cse.google.com/cse.js?cx=' + cx;
        var s = document.getElementsByTagName('script')[0];
        s.parentNode.insertBefore(gcse, s);
      })();
    </script>
<!--     <link rel="shortcut icon" href="favicon.ico"/> -->


  </head>
  <body>
    <div id="main" class="center">

      <div id="hp-header">
        <table width="100%"><tr><td width="50%">
          <span class="header-text"><a href="http://universaldependencies.org/#language-ga">home</a></span>

          <span class="header-text"><a href="https://github.com/universaldependencies/docs/edit/pages-source/_ga/template-index.md" target="#">edit page</a></span>
          <span class="header-text"><a href="https://github.com/universaldependencies/docs/issues">issue tracker</a></span>
        </td><td>
          <gcse:search></gcse:search>
        </td></tr></table>
      </div>

      <hr/>

      
      <div class="v2complete">
	This page pertains to UD version 2.
      </div>
      

      <div id="content">
	<noscript>
	  <div id="noscript">
	    It appears that you have Javascript disabled.
	    Please consider enabling Javascript for this page to see the visualizations.
	  </div>
	</noscript>

          <h1 id="ud-for-irish-">UD for Irish <span class="flagspan"><img class="flag" src="../../flags/svg/AQ.svg" /></span></h1>

<h2 id="tokenization-and-word-segmentation">Tokenization and Word Segmentation</h2>

<p>In Irish, in general, words are delimited by whitespace characters. Description of exceptions follows:</p>

<ul>
  <li>
    <p>Some punctuation marks are attached to a neighbouring word. The word and the punctuation mark are taken together as one token. For example,  <em>D’</em>  (contraction for <em>do</em> in <em>d’ith</em> “ate”), <em>b’</em> (in <em>b’fhearr</em> “would prefer”) and <em>O’</em> (in surnames) are recognised as single tokens. Abbreviations surch as <em>srl.</em> “etc.” or <em>i.n.</em> “p.m.” are also recognised as one token.</p>
  </li>
  <li>
    <p>Note that compound prepositions (<em>os_cionn</em> “above”, <em>in_aice</em> “beside”, etc)  are split into two tokens for UD v2, as are some placenames that the tagger recognises (e.g. <em>Cill_Dara</em>) or a limited number of mwes (<em>chomh_fada_is</em> “as long as; <em>cé_is_moite</em> “except for”). 
The Irish POS-tagger used in the Irish Dependency Treebank retains these as single tokens and so must be mapped accordingly.</p>
  </li>
</ul>

<h2 id="morphology">Morphology</h2>

<h3 id="pos-tags">POS Tags</h3>

<p>The UD part-of-speech (POS) tagset is an extension of the The Google Universal POS tagset (Petrov
et al., 2012) and contains 17 POS tags. 
The tags for the Irish Dependency Treebank is based on the PAROLE Morphosyntactic Tagset (ITÉ,
2002).</p>

<p>(Table to be inserted here) A mapping from this tagest to the UD tagset for use in the IUDT is given in: Lynn, Teresa and <NAME>, <em>Universal Dependencies for Irish</em> In Proceedings of the 2nd Celtic Language Technology Workshop 2016, Paris, France.</p>

<p>The following is a summary of some specific/ unintuitive choices made to map Irish data conform to Universal POS tags for UDv2:</p>

<ul>
  <li>The AUX tag is used for the Copula only. All other verbs (including substantive verb <em>bí</em> “to be” are tagged as VERB).</li>
  <li>Verbal adjectives are tagged as ADJ</li>
  <li>The following particles are tagged as PART: adverbial (<em>go mall</em>), verbal (<em>ná déan</em>), vocative (<em>a Sheosamh</em>), comparative (níos déanaí), superlative (<em>is déanaí</em>), numeral (<em>a haon</em>), relative (<em>a chonaic sé</em>), infinitive (<em>a dhéanamh</em>), degree (_a luaithe), name (Seosamh Mac Grianna)</li>
  <li>Verbal nouns are tagged as NOUN</li>
  <li><em>ag</em> in use with verbal nouns to form a gerund in progressive aspectual phrases are tagged as ADP</li>
  <li>demonstrative pronouns are tagged as PRON (<em>sin an fadhb</em>, <em>Thug sé sin faoi deara</em>)</li>
  <li>demonstrative determiners, on the other hand, are tagged as DET along with all other determiners (<em>an leabhar sin</em>)</li>
</ul>

<hr />

<h3 id="features">Features</h3>

<p>*</p>

<hr />
<p><strong>Instruction</strong>: Describe inherent and inflectional features for major word classes (at least NOUN and VERB). Describe other noteworthy features. Include links to language-specific feature definitions if any.</p>

<hr />

<h2 id="syntax">Syntax</h2>

<p>*</p>

<hr />
<p><strong>Instruction</strong>: Give criteria for identifying core arguments (subjects and objects), and describe the range of copula constructions in nonverbal clauses. List all subtype relations used. Include links to language-specific relations definitions if any.</p>

<hr />

<h2 id="treebanks">Treebanks</h2>

<p>There are <a href="../treebanks/LCODE-comparison.html">N</a> LANGUAGE UD treebanks:</p>

<ul>
  <li><a href="../treebanks/LCODE_a/index.html">LANGUAGE-A</a></li>
  <li><a href="../treebanks/LCODE_b/index.html">LANGUAGE-B</a></li>
</ul>

<hr />
<p><strong>Instruction</strong>: Treebank-specific pages are generated automatically from the README file in the treebank repository and
from the data in the latest release. Link to the respective <code class="highlighter-rouge">*-index.html</code> page in the <code class="highlighter-rouge">treebanks</code> folder, using the language code
and the treebank code in the file name.</p>

<hr />


      </div><commit_msg>autogenerated by https://github.com/spyysalo/jekyll-hook<commit_after><!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html lang="en-GB" xml:lang="en-GB" xmlns="http://www.w3.org/1999/xhtml">
  <head>
    <meta http-equiv="content-type" content="text/html; charset=utf-8"/>
    <title>Irish UD</title>
    <link rel="root" href=""/> <!-- for JS -->
    <link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/font-awesome/4.4.0/css/font-awesome.min.css">
    <link rel="stylesheet" type="text/css" href="../css/jquery-ui-redmond.css"/>
    <link rel="stylesheet" type="text/css" href="../css/style.css"/>
    <link rel="stylesheet" type="text/css" href="../css/style-vis.css"/>
    <link rel="stylesheet" type="text/css" href="../css/hint.css"/>
    <script type="text/javascript" src="../lib/ext/head.load.min.js"></script>
    <script type="text/javascript" src="../lib/ext/jquery.timeago.js"></script>
    <script src="https://cdnjs.cloudflare.com/ajax/libs/anchor-js/3.2.2/anchor.min.js"></script>
    <script>document.addEventListener("DOMContentLoaded", function(event) {anchors.add();});</script>
    <!-- Set up this custom Google search at https://cse.google.com/cse/business/settings?cx=001145188882102106025:dl1mehhcgbo -->
    <script>
      (function() {
        var cx = '001145188882102106025:dl1mehhcgbo';
        var gcse = document.createElement('script');
        gcse.type = 'text/javascript';
        gcse.async = true;
        gcse.src = 'https://cse.google.com/cse.js?cx=' + cx;
        var s = document.getElementsByTagName('script')[0];
        s.parentNode.insertBefore(gcse, s);
      })();
    </script>
<!--     <link rel="shortcut icon" href="favicon.ico"/> -->


  </head>
  <body>
    <div id="main" class="center">

      <div id="hp-header">
        <table width="100%"><tr><td width="50%">
          <span class="header-text"><a href="http://universaldependencies.org/#language-ga">home</a></span>

          <span class="header-text"><a href="https://github.com/universaldependencies/docs/edit/pages-source/_ga/template-index.md" target="#">edit page</a></span>
          <span class="header-text"><a href="https://github.com/universaldependencies/docs/issues">issue tracker</a></span>
        </td><td>
          <gcse:search></gcse:search>
        </td></tr></table>
      </div>

      <hr/>

      
      <div class="v2complete">
	This page pertains to UD version 2.
      </div>
      

      <div id="content">
	<noscript>
	  <div id="noscript">
	    It appears that you have Javascript disabled.
	    Please consider enabling Javascript for this page to see the visualizations.
	  </div>
	</noscript>

          <h1 id="ud-for-irish-">UD for Irish <span class="flagspan"><img class="flag" src="../../flags/svg/AQ.svg" /></span></h1>

<h2 id="tokenization-and-word-segmentation">Tokenization and Word Segmentation</h2>

<p>In Irish, in general, words are delimited by whitespace characters. Description of exceptions follows:</p>

<ul>
  <li>
    <p>Some punctuation marks are attached to a neighbouring word. The word and the punctuation mark are taken together as one token. For example,  <em>D’</em>  (contraction for <em>do</em> in <em>d’ith</em> “ate”), <em>b’</em> (in <em>b’fhearr</em> “would prefer”) and <em>O’</em> (in surnames) are recognised as single tokens. Abbreviations surch as <em>srl.</em> “etc.” or <em>i.n.</em> “p.m.” are also recognised as one token.</p>
  </li>
  <li>
    <p>Note that compound prepositions (<em>os_cionn</em> “above”, <em>in_aice</em> “beside”, etc)  are split into two tokens for UD v2, as are some placenames that the tagger recognises (e.g. <em>Cill_Dara</em>) or a limited number of mwes (<em>chomh_fada_is</em> “as long as; <em>cé_is_moite</em> “except for”).</p>
  </li>
</ul>

<p>The Irish POS-tagger used in the Irish Dependency Treebank retains these as single tokens and so must be mapped accordingly as the treebanks develop concurrently.</p>

<h2 id="morphology">Morphology</h2>

<h3 id="pos-tags">POS Tags</h3>

<p>The UD part-of-speech (POS) tagset is an extension of the The Google Universal POS tagset (Petrov
et al., 2012) and contains 17 POS tags. 
The tags for the Irish Dependency Treebank is based on the PAROLE Morphosyntactic Tagset (ITÉ,
2002).</p>

<p>(Table to be inserted here) A mapping from this tagest to the UD tagset for use in the IUDT is given in: <NAME> and <NAME>, <em>Universal Dependencies for Irish</em> In Proceedings of the 2nd Celtic Language Technology Workshop 2016, Paris, France.</p>

<p>The following is a summary of some specific/ unintuitive choices made to map Irish data conform to Universal POS tags for UDv2:</p>

<ul>
  <li>The AUX tag is used for the Copula only. All other verbs (including substantive verb <em>bí</em> “to be” are tagged as VERB).</li>
  <li>Verbal adjectives are tagged as ADJ</li>
  <li>The following particles are tagged as PART: adverbial (<em>go mall</em>), verbal (<em>ná déan</em>), vocative (<em>a Sheosamh</em>), comparative (níos déanaí), superlative (<em>is déanaí</em>), numeral (<em>a haon</em>), relative (<em>a chonaic sé</em>), infinitive (<em>a dhéanamh</em>), degree (_a luaithe), name (Seosamh Mac Grianna)</li>
  <li>Verbal nouns are tagged as NOUN</li>
  <li><em>ag</em> in use with verbal nouns to form a gerund in progressive aspectual phrases are tagged as ADP</li>
  <li>demonstrative pronouns are tagged as PRON (<em>sin an fadhb</em>, <em>Thug sé sin faoi deara</em>)</li>
  <li>demonstrative determiners, on the other hand, are tagged as DET along with all other determiners (<em>an leabhar sin</em>)</li>
</ul>

<hr />

<h3 id="features">Features</h3>

<hr />

<p>Inflection in Irish mainly occurs through suffixation, but initial mutation through lenition and eclipsis is also common. Lenition is a phonological change that softens or weakens the articulation of a consonant. The eclipsis process renders voiced segments as nasalised and voiceless segments as being voiced (Stenson, 1981, p.18). A prominent feature of Irish which influences inflection, is the existence of two sets of consonants,
referred to as “broad” and “slender” consonants. Consonants can be slenderised by accompanying the consonant with a slender vowel, either <em>e</em> or <em>i</em>. Broadening occurs through the use of broad vowels; <em>a</em>, <em>o</em> or <em>u</em>. In general, there needs to be vowel harmony (slender or broad) between stem endings and the initial vowel in a suffix.</p>

<ul>
  <li><em>buail</em> “hit”  <em>ag bualadh na liathróide</em> “hitting the ball” (Verbal Noun)</li>
  <li><em>buail</em> “hit”  <em>buaileadh an liathróid</em> “the ball was hit” (Impersonal Form)</li>
</ul>

<h4 id="verbs">VERBS</h4>

<p>Verbs inflect for number and person, as well as mood and tense. Verbs can incorporate their subject, inflecting for person and number through suffixation. Such forms are referred to as synthetic verb forms. Most verbs tend to incorporate a subject when it is first person singular or plural. These synthetic forms are generally restricted to the Present Tense, Imperfect Tense, Conditional Mood and Imperative Mood.</p>

<ul>
  <li><em>scríobh</em> “write”</li>
  <li><em>scríobhaim</em> “I write”</li>
  <li><em>scríobhfaimid</em> “we will write”</li>
</ul>

<p>Tense is also marked by lenition on some verb forms:</p>
<ul>
  <li><em>dún</em> “close”</li>
  <li><em>dhún mé</em> “I closed”</li>
  <li>dhúnfainn “I would close”</li>
</ul>

<p>Lenition occurs after the negative particle ní:</p>
<ul>
  <li><em>tugaim</em> “I give”</li>
  <li><em>ní thugaim</em> “I do not give”</li>
  <li><em>tabharfaidh mé</em> “I will give”</li>
  <li><em>ní thabharfaidh mé</em> “I will not give”</li>
</ul>

<p>Eclipsis (initial mutation) occurs following clitics such as interrogative particles (an, nach); complementisers (go, nach); and relativisers (a, nach) (Stenson, 1981,pp. 21-26).</p>

<ul>
  <li><em>an dtuigeann sé?</em> “does he understand?”</li>
  <li><em>nach dtuigeann sé</em> “that he does not understand”.</li>
  <li><em>go dtabharfadh sé</em> “that he would give”</li>
</ul>

<h4 id="nouns">NOUNS</h4>

<hr />

<h2 id="syntax">Syntax</h2>

<p>*</p>

<hr />
<p><strong>Instruction</strong>: Give criteria for identifying core arguments (subjects and objects), and describe the range of copula constructions in nonverbal clauses. List all subtype relations used. Include links to language-specific relations definitions if any.</p>

<hr />

<h2 id="treebanks">Treebanks</h2>

<p>There are <a href="../treebanks/LCODE-comparison.html">N</a> LANGUAGE UD treebanks:</p>

<ul>
  <li><a href="../treebanks/LCODE_a/index.html">LANGUAGE-A</a></li>
  <li><a href="../treebanks/LCODE_b/index.html">LANGUAGE-B</a></li>
</ul>

<hr />
<p><strong>Instruction</strong>: Treebank-specific pages are generated automatically from the README file in the treebank repository and
from the data in the latest release. Link to the respective <code class="highlighter-rouge">*-index.html</code> page in the <code class="highlighter-rouge">treebanks</code> folder, using the language code
and the treebank code in the file name.</p>

<hr />


      </div>
{'fraction_non_alphanumeric': 0.16200632401264803, 'fraction_numerical': 0.01364002728005456, 'mean_word_length': 4.015547263681592, 'pattern_counts': {'":': 0, '<': 510, '<?xml version=': 0, '>': 510, 'https://': 13, 'lorem ipsum': 0, 'www.': 4, 'xml': 4}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5794078', 'n_tokens_mistral': 5790, 'n_tokens_neox': 5422, 'n_words': 1638}