Derivative of the off-diagonal $L_1$ matrix norm We define the off-diagonal $L_1$ norm of a matrix as follows: for any $A\in \mathcal{M}_{n,n}$, $$\|A\|_1^{\text{off}} = \sum_{i\ne j}|a_{ij}|.$$
So what is $$\frac{\partial \|A\|_1^{\text{off}}}{\partial A}\;?$$

$
\def\p{\partial}
\def\L{\left}\def\R{\right}\def\LR#1{\L(#1\R)}
\def\t#1{\operatorname{Tr}\LR{#1}}
\def\s#1{\operatorname{sign}\LR{#1}}
\def\g#1#2{\frac{\p #1}{\p #2}}
$Use the element-wise sign() function to define the matrix
$\,S = \s{X}.\;$
The gradient and differential of the Manhattan norm can be written as
$$\eqalign{
\g{\|X\|_1}{X} &= S \quad\iff\quad d\|X\|_1 = S:dX \\
}$$
Suppose that $X$ itself is defined in terms of another matrix $A$
$$\eqalign{
F &= (J-I), \qquad 
X &= F\odot A, \qquad
S &= \s{F\odot A} \\
}$$
where $J$ is the all-ones matrix, $I$ is the identity, and $(\odot)$ is the Hadamard product.
$\big($ Note that $X$ is composed of the off-diagonal elements of $A\,\big)$
Substituting into the known differential yields the desired gradient
$$\eqalign{
&\quad d\|X\|_1 = S:dX = S:(F\odot dA) = (F\odot S):dA \\
&\boxed{\;\g{\|X\|_1}{A} = F\odot S\;}
\\
}$$
where $(:)$ denotes the Frobenius product, which is a convenient notation for the trace
$$\eqalign{
A:B &= \sum_{i=1}^m\sum_{j=1}^n A_{ij}B_{ij} \;=\; \t{A^TB} \\
A:A &= \big\|A\big\|^2_F \\
}$$
and which commutes with the Hadamard product
$$\eqalign{
A:(B\odot C) &= \sum_{i=1}^m\sum_{j=1}^n A_{ij}B_{ij}C_{ij} \\
  &= (A\odot B):C \\\\
}$$

NB: The gradient above is not defined for any element of $X$ equal to zero, because the sign() function itself is discontinuous at zero.
