In this layer, the filter convolves over the input by performing element wise multiplication and summing all the values. A very important note is that depth of the filter is always same as depth of the input given to this layer. The computational cost for traditional convolution layer is \(M \times D_k^2 \times D_p^2 \times N\)  [1]}.
<FIGURE><TABLE>