<commit_before>---
layout: page
title: Roadmap
description: Apache SystemML Roadmap
group: nav-right
---
<!--
{% comment %}
Licensed to the Apache Software Foundation (ASF) under one or more
contributor license agreements.  See the NOTICE file distributed with
this work for additional information regarding copyright ownership.
The ASF licenses this file to you under the Apache License, Version 2.0
(the "License"); you may not use this file except in compliance with
the License.  You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
{% endcomment %}
-->

<!-- Hero  -->
<section class="full-stripe full-stripe--subpage-header clear-header">
  <div class="ml-container ml-container--horizontally-center">
    <div class="col col-12 content-group content-group--center-content content-group--center-align">
      <h1>{{ site.data.project.name }} Roadmap</h1>
    </div>
  </div>
</section>


<section class="full-stripe full-stripe--alternate">
  <div class="ml-container ml-container--narrow content-group">
    <div class="col col-12">
      <h2>Next {{ site.data.project.shortname }} 0.11.x</h2>
      <ul>
        <li>
          Features
          <ul>
            <li>SystemML frames</li>
            <li>New MLContext API</li>
            <li>Transform functions based on SystemML frames</li>
          </ul>
        </li>
        <li>Bug Fixes</li>
        <li>
          Experimental Features / Algorithms
          <ul>
            <li>New built-in functions for deep learning (convolution and pooling)</li>
            <li>Deep learning library (DML bodied functions)</li>
            <li>Python DSL Integration</li>
            <li>GPU Support</li>
            <li>Compressed Linear Algebra</li>
            <li>
              New Algorithms
              <ul>
                <li>Lasso</li>
                <li>kNN</li>
                <li>Lanczos</li>
                <li>PPCA</li>
                <li>Deep Learning: CNN (Lenet), RBM</li>
              </ul>
            </li>
          </ul>
        </li>
      </ul>
    </div>

    <div class="col col-12">
      <h2>Planned for Future SystemML 1.0</h2>
      <ul>
        <li>Rigorous Performance and Scalability Testing (Bug Fixes)</li>
        <li>Remove Deprecated APIs</li>
        <li>Remove Deprecated Functions</li>
      </ul>
    </div>

    <div class="col col-12">
      <h2>Planned for Future Releases</h2>
      <ul>
        <li>Completion of Prior Experimental Features</li>
        <li>New Algorithms: Non-linear SVMs, Solvers, Decomposition, Inversion, etc.</li>
        <li>DSLs (e.g. Scala, Python) and Common DSL Architecture</li>
        <li>R Interfaces: R DSL and R Wrappers</li>
        <li>Native Zeppelin Notebook Support</li>
        <li>Code Generation</li>
        <li>Sum Product Optimizations</li>
        <li>Tree-based Data Structures</li>
        <li>Global Dataflow Optimizations</li>
      </ul>
    </div>

    <div class="col col-12">
      <h2>Prior Releases</h2>
      <ul>
        <li>
          SystemML 0.10.0-incubating (<a href="https://github.com/apache/incubator-systemml-website/blob/master/0.10.0-incubating/release_notes.md">released in June, 2016</a>)
          <ul>
            <li>Different types of Spark Matrix Blocks: MCSR, CSR, COO</li>
            <li>SystemML Frame support in JMLC/CP</li>
            <li>Initial Deep Learning support</li>
            <li>API/Scripts: parser error handling, SystemML configuration handling,</li>
          </ul>
        </li>
        <li>
          Include Algorithms in SystemML jar, print matrix
          <ul>
            <li>New fused operator: wdivmm with variations</li>
            <li>Performance Features: cache-conscious operations, more multithreaded</li>
          </ul>
        </li>
        <li>
          Operations, New Simplications Rewrites
          <ul>
            <li>New Algorithms: kNN</li>
            <li>Documentation: javadocs, Jupyter/Zeppeling notebook examples</li>
          </ul>
        </li>
      </ul>

      <ul>
        <li>
          SystemML 0.9.0-incubating (<a href="https://github.com/apache/incubator-systemml-website/blob/master/0.9.0-incubating/release_notes.md">released in Jan, 2016</a>)
          <ul>
            <li>Improvements to MLContext and MLPipeline wrappers</li>
            <li>New converter utilities for RDDs and DataFrames)</li>
            <li>New Optimizations for Spark Backend, e.g. eager RDD caching and</li>
          </ul>
        </li><commit_msg>[MINOR] Move 0.11 roadmap to release section<commit_after>---
layout: page
title: Roadmap
description: Apache SystemML Roadmap
group: nav-right
---
<!--
{% comment %}
Licensed to the Apache Software Foundation (ASF) under one or more
contributor license agreements.  See the NOTICE file distributed with
this work for additional information regarding copyright ownership.
The ASF licenses this file to you under the Apache License, Version 2.0
(the "License"); you may not use this file except in compliance with
the License.  You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
{% endcomment %}
-->

<!-- Hero  -->
<section class="full-stripe full-stripe--subpage-header clear-header">
  <div class="ml-container ml-container--horizontally-center">
    <div class="col col-12 content-group content-group--center-content content-group--center-align">
      <h1>{{ site.data.project.name }} Roadmap</h1>
    </div>
  </div>
</section>


<section class="full-stripe full-stripe--alternate">
  <div class="ml-container ml-container--narrow content-group">
    <div class="col col-12">
      <h2>Planned for Future SystemML 1.0</h2>
      <ul>
        <li>Rigorous Performance and Scalability Testing (Bug Fixes)</li>
        <li>Remove Deprecated APIs</li>
        <li>Remove Deprecated Functions</li>
      </ul>
    </div>

    <div class="col col-12">
      <h2>Planned for Future Releases</h2>
      <ul>
        <li>Completion of Prior Experimental Features</li>
        <li>New Algorithms: Non-linear SVMs, Solvers, Decomposition, Inversion, etc.</li>
        <li>DSLs (e.g. Scala, Python) and Common DSL Architecture</li>
        <li>R Interfaces: R DSL and R Wrappers</li>
        <li>Native Zeppelin Notebook Support</li>
        <li>Code Generation</li>
        <li>Sum Product Optimizations</li>
        <li>Tree-based Data Structures</li>
        <li>Global Dataflow Optimizations</li>
      </ul>
    </div>

    <div class="col col-12">
      <h2>Prior Releases</h2>
      <ul>
        <li>
          <strong>SystemML 0.11.0-incubating (<a href="https://github.com/apache/incubator-systemml-website/blob/master/0.11.0-incubating/release_notes.md">released in November, 2016</a>)</strong>
          <ul>
            <li>SystemML frames</li>
            <li>New MLContext API</li>
            <li>Transform functions based on SystemML frames</li>
          </ul>
        </li>
        <li>
          Experimental Features / Algorithms
          <ul>
            <li>New built-in functions for deep learning (convolution and pooling)</li>
            <li>Deep learning library (DML bodied functions)</li>
            <li>Python DSL Integration</li>
            <li>GPU Support</li>
            <li>Compressed Linear Algebra</li>
          </ul>
        </li>
        <li>
          New Algorithms
          <ul>
            <li>Lasso</li>
            <li>kNN</li>
            <li>Lanczos</li>
            <li>PPCA</li>
          </ul>
        </li>
        <li>
          Deep Learning Algorithms
          <ul>
            <li>CNN (Lenet)</li>
            <li>RBM</li>
          </ul>
        </li>
      </ul>

      <ul>
        <li>
          <strong>SystemML 0.10.0-incubating (<a href="https://github.com/apache/incubator-systemml-website/blob/master/0.10.0-incubating/release_notes.md">released in June, 2016</a>)</strong>
          <ul>
            <li>Different types of Spark Matrix Blocks: MCSR, CSR, COO</li>
            <li>SystemML Frame support in JMLC/CP</li>
            <li>Initial Deep Learning support</li>
            <li>API/Scripts: parser error handling, SystemML configuration handling,</li>
          </ul>
        </li>
        <li>
          Include Algorithms in SystemML jar, print matrix
          <ul>
            <li>New fused operator: wdivmm with variations</li>
            <li>Performance Features: cache-conscious operations, more multithreaded</li>
          </ul>
        </li>
        <li>
          Operations, New Simplications Rewrites
          <ul>
            <li>New Algorithms: kNN</li>
            <li>Documentation: javadocs, Jupyter/Zeppeling notebook examples</li>
          </ul>
        </li>
      </ul>

      <ul>
        <li>
          <strong>SystemML 0.9.0-incubating (<a href="https://github.com/apache/incubator-systemml-website/blob/master/0.9.0-incubating/release_notes.md">released in Jan, 2016</a>)</strong>
          <ul>
            <li>Improvements to MLContext and MLPipeline wrappers</li>
            <li>New converter utilities for RDDs and DataFrames)</li>
            <li>New Optimizations for Spark Backend, e.g. eager RDD caching and</li>
          </ul>
        </li>
{'fraction_non_alphanumeric': 0.12322902864132097, 'fraction_numerical': 0.011211905004586688, 'mean_word_length': 2.225509533201841, 'pattern_counts': {'":': 0, '<': 295, '<?xml version=': 0, '>': 295, 'https://': 5, 'lorem ipsum': 0, 'www.': 2, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5854330', 'n_tokens_mistral': 3092, 'n_tokens_neox': 2918, 'n_words': 843}