For now just observe that if all α-values are set to 0.25 (or any other constant), we obtain hard parameter sharing<cite> (Caruana 1993)</cite> , which is equivalent to a heavy L 0 matrix regularizer.