CNTK: Microsoft's Open Source Deep Learning Toolkit
This tutorial will introduce the Computational Network Toolkit, or CNTK, Microsoft's cutting edge open source deep learning toolkit for Windows and Linux. CNTK is a powerful computation graph based deep learning toolkit for training and evaluating deep neural networks. Microsoft product groups use CNTK, for example to create the Cortana speech models and web ranking. CNTK supports feed forward, convolutional, and recurrent networks for speech, image, and text workloads, also in combination. Popular network types are supported either natively (convolution) or can be described as a CNTK configuration (LSTM, sequence to sequence) CNTK scales to multiple GPU servers and is designed around efficiency. The tutorial will give an overview of CNTK's general architecture and describe the specific methods and algorithms used for automatic differentiation, recurrent loop inference and execution, memory sharing, on the fly randomization of large corpora, and multi server parallelization. We will then show how typical uses looks like for relevant tasks like image recognition, sequence to sequence modeling, and speech recognition.
KDD