Amongst various pruning techniques, we focus on the class of methods where pruned networks do not undergo retraining. A fairly recent work in this category [1]} empirically investigates a node pruning technique where a diverse subset of nodes are preserved in a given layer using DPP [2]}, [3]}. In the first part of this paper we provide theoretical guarantees for their empirical observations.
