In our work we overcome these challenges by proposing a comprehensive pruning strategy that performs both width-wise (filters) as well as depth-wise (layers, branch, blocks) pruning in an online manner. For width-wise pruning we utilize the idea of filter pruning [1]}, [2]} whereas for depth-wise pruning we proposed layer, branch and block pruning schemes. The main contributions of our work are as follows:
