The architecture of the Convolutional Neural Network (CNN) is inspired by the biological visual system presented in [1]}. Following the natural visual recognition mechanism proposed by Hubel and Wiesel [1]}, Neocognitron [3]} is regarded as the first hierarchical, position-invariant model for pattern recognition [4]} which can be considered as the predecessor of CNN [5]}. The architecture of CNN can be divided into two main stages: one is Feature Extraction (FE) network and the other is a classification based on the feature maps extracted in the first stage.
