Big Learning and Deep Neural Networks
More data and compute resources opens the way to "big learning" that is, scaling up machine learning to large data sets and complex problems. In order to solve these new problems, we need to identify the complex dependencies that interrelate inputs and outputs [1] Achieving this goal requires powerful algorithms in terms of both representational power and ability to absorb and distill information from large data flows. More and more it becomes apparent that neural networks provide an excellent toolset to scale learning. This holds true for simple linear systems as well as today's grand challenges where the underlying application problem requires high nonlinearity and complex structured representations.
Neural Networks: Tricks of the Trade