Where \(E_{i}\)  is the entropy for a given neuron \(i\) , \(j\)  is a neuron with a non-zero weight connected to neuron \(i\) , and \(K\) , the degree of \(i\) , is the number of non-zero connections to neuron \(i\) . The mutual information given by an input is analogous to a decrease in entropy after a stimulus is presented([1]}).
