<commit_before><!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html lang="en-GB" xml:lang="en-GB" xmlns="http://www.w3.org/1999/xhtml">
  <head>
    <meta http-equiv="content-type" content="text/html; charset=utf-8"/>
    <title>UD version 2</title>
    <link rel="root" href=""/> <!-- for JS -->
    <link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/font-awesome/4.4.0/css/font-awesome.min.css">
    <link rel="stylesheet" type="text/css" href="../css/jquery-ui-redmond.css"/>
    <link rel="stylesheet" type="text/css" href="../css/style.css"/>
    <link rel="stylesheet" type="text/css" href="../css/style-vis.css"/>
    <link rel="stylesheet" type="text/css" href="../css/hint.css"/>
    <script type="text/javascript" src="../lib/ext/head.load.min.js"></script>
    <script type="text/javascript" src="../lib/ext/jquery.timeago.js.js"></script>
<!--     <link rel="shortcut icon" href="favicon.ico"/> -->


  </head>
  <body>
    <div id="main" class="center">

      <div id="hp-header">
	
          <span class="header-text"><a href="http://universaldependencies.org/#language-v2">home</a></span>
          <span class="header-text"><a href="http://universaldependencies.org/v2/v2">v2/v2</a></span>
          <span class="header-text"><a href="https://github.com/universaldependencies/docs/edit/pages-source/_v2/index.md" target="#">edit page</a></span>
          <span class="header-text"><a href="https://github.com/universaldependencies/docs/issues">issue tracker</a></span>
      </div>

      <hr/>

      <div id="content">
	<noscript>
	  <div id="noscript">
	    It appears that you have Javascript disabled.
	    Please consider enabling Javascript for this page to see the visualizations.
	  </div>
	</noscript>

          <h1 id="ud-version-2">UD version 2</h1>

<p>This is the entry point for pages where we prepare version 2 of the universal guidelines.
It is not a clone of the <a href="../index.html">main documentation</a>. The relevant documentation pages should be referenced from here,
their modification proposed and discussed here, and later copied to the documentation.</p>

<p>Deadlines:</p>

<ul>
  <li>2016-09-01: Draft guidelines made available for feedback</li>
  <li>2016-10-01: Guidelines fixed for next release</li>
  <li>2016-11-01: Data freeze for next release</li>
</ul>

<p>Some quick links:</p>

<ul>
  <li><a href="https://github.com/UniversalDependencies/docs/issues?utf8=%E2%9C%93&amp;q=is%3Aissue%20is%3Aopen%20milestone%3A%22universal%20v2%22">Issue tracker, universal v2 filter</a></li>
  <li><a href="../uppsala.html">Uppsala meeting</a></li>
</ul>

<h2 id="the-main-issues">The main issues</h2>

<ol>
  <li><strong><a href="core_dependents.html">Core dependents.</a></strong>
The distinction between core dependents and the rest is fundamental to the whole taxonomy.
Having specific and cross-linguistically consistent guidelines for core dependents is therefore
crucial for putting the whole enterprise on a solid footing. This involves clarifying the
treatment of (among other things) double objects, reflexives, expletives, copula constructions
and valency-changing operations.
Relevant reports from the Uppsala meeting includes:
<a href="../2015-08-23-uppsala/copula.html">copula</a>,
<a href="../2015-08-23-uppsala/clitics.html">clitics</a>.</li>
  <li><strong><a href="functional_dependents.html">Functional labels.</a></strong>
Crosslinguistic guidelines for the use of the functional labels such as <code>aux</code>, <code>det</code>, <code>cop</code>.
There is currently a lot of variation around this.
Representing lexical heads promotes crosslinguistic parallelism, but only if we can agree on what lexical heads <em>are</em>.</li>
  <li><strong><a href="tokenization.html">Tokenization</a></strong> (or perhaps better, word segmentation).
We need to be able to handle the whole spectrum from multitoken words in Vietnamese to multiword
tokens in Turkish. Ideally, we should also set up more substantial criteria for when to split<commit_msg>autogenerated by https://github.com/spyysalo/jekyll-hook<commit_after><!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html lang="en-GB" xml:lang="en-GB" xmlns="http://www.w3.org/1999/xhtml">
  <head>
    <meta http-equiv="content-type" content="text/html; charset=utf-8"/>
    <title>UD version 2</title>
    <link rel="root" href=""/> <!-- for JS -->
    <link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/font-awesome/4.4.0/css/font-awesome.min.css">
    <link rel="stylesheet" type="text/css" href="../css/jquery-ui-redmond.css"/>
    <link rel="stylesheet" type="text/css" href="../css/style.css"/>
    <link rel="stylesheet" type="text/css" href="../css/style-vis.css"/>
    <link rel="stylesheet" type="text/css" href="../css/hint.css"/>
    <script type="text/javascript" src="../lib/ext/head.load.min.js"></script>
    <script type="text/javascript" src="../lib/ext/jquery.timeago.js.js"></script>
<!--     <link rel="shortcut icon" href="favicon.ico"/> -->


  </head>
  <body>
    <div id="main" class="center">

      <div id="hp-header">
	
          <span class="header-text"><a href="http://universaldependencies.org/#language-v2">home</a></span>
          <span class="header-text"><a href="http://universaldependencies.org/v2/v2">v2/v2</a></span>
          <span class="header-text"><a href="https://github.com/universaldependencies/docs/edit/pages-source/_v2/index.md" target="#">edit page</a></span>
          <span class="header-text"><a href="https://github.com/universaldependencies/docs/issues">issue tracker</a></span>
      </div>

      <hr/>

      <div id="content">
	<noscript>
	  <div id="noscript">
	    It appears that you have Javascript disabled.
	    Please consider enabling Javascript for this page to see the visualizations.
	  </div>
	</noscript>

          <h1 id="ud-version-2">UD version 2</h1>

<p>This is the entry point for pages where we prepare version 2 of the universal guidelines.
It is not a clone of the <a href="../index.html">main documentation</a>. The relevant documentation pages should be referenced from here,
their modification proposed and discussed here, and later copied to the documentation.</p>

<p>Deadlines:</p>

<ul>
  <li>2016-09-01: Draft guidelines made available for feedback</li>
  <li>2016-10-01: Guidelines fixed for next release</li>
  <li>2016-11-01: Data freeze for next release</li>
</ul>

<p>Some quick links:</p>

<ul>
  <li><a href="https://github.com/UniversalDependencies/docs/issues?utf8=%E2%9C%93&amp;q=is%3Aissue%20is%3Aopen%20milestone%3A%22universal%20v2%22">Issue tracker, universal v2 filter</a></li>
  <li><a href="../uppsala.html">Uppsala meeting</a></li>
</ul>

<h2 id="the-main-issues">The main issues</h2>

<ol>
  <li><strong><a href="core_dependents.html">Core dependents.</a></strong>
The distinction between core dependents and the rest is fundamental to the whole taxonomy.
Having specific and cross-linguistically consistent guidelines for core dependents is therefore
crucial for putting the whole enterprise on a solid footing. This involves clarifying the
treatment of (among other things) double objects, reflexives, expletives, copula constructions
and valency-changing operations.
Relevant reports from the Uppsala meeting includes:
<a href="../2015-08-23-uppsala/copula.html">copula</a>,
<a href="../2015-08-23-uppsala/clitics.html">clitics</a>.</li>
  <li><strong><a href="function_dependents.html">Functional labels.</a></strong>
Crosslinguistic guidelines for the use of the functional labels such as <code>aux</code>, <code>det</code>, <code>cop</code>.
There is currently a lot of variation around this.
Representing lexical heads promotes crosslinguistic parallelism, but only if we can agree on what lexical heads <em>are</em>.</li>
  <li><strong><a href="tokenization.html">Tokenization</a></strong> (or perhaps better, word segmentation).
We need to be able to handle the whole spectrum from multitoken words in Vietnamese to multiword
tokens in Turkish. Ideally, we should also set up more substantial criteria for when to split
{'fraction_non_alphanumeric': 0.16392844103687476, 'fraction_numerical': 0.02166240720457588, 'mean_word_length': 4.3122171945701355, 'pattern_counts': {'":': 0, '<': 215, '<?xml version=': 0, '>': 215, 'https://': 9, 'lorem ipsum': 0, 'www.': 4, 'xml': 4}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '6148692', 'n_tokens_mistral': 2757, 'n_tokens_neox': 2564, 'n_words': 691}