There have been rapid advances in artificial intelligence (AI) and
machine learning (ML) in the last decade. The breakthrough has largely
been built upon the construction of larger datasets and the design of
complex neural networks. Representative neural networks include the
convolutional neural network (CNN) [1]}, the recurrent
neural network (RNN), [2]}, [3]}, [4]} the long short-term memory
network (LSTM) [5]}, [6]}, [7]},
etc. Deep neural networks (DNNs) have attracted a lot of attention from
academia and industry since its resurgence in 2012
[8]}. As networks become larger and deeper, this
discipline is named deep learning (DL) [9]}. DL has made
great impacts in various application domains, include computer vision,
natural language processing, autonomous driving, robotics navigation,
etc.
