
What is the role of nonlinear activation [1]}?

What are individual roles played by the convolutional layers and
the fully-connected (FC) layers [2]}?

Is there a guideline in the network architecture design
[2]}?

Is it possible to avoid the expensive backpropagation optimization
process in filter weight determination [4]}, [2]}, [6]}?

