Two generalizations of the Butterfly Theorem

Abstract: We establish two direct extensions to the Butterfly Theorem on the cyclic quadrilateral along with the proofs using the projective method and analytic geometry of the Cartesian coordinate system.

\section{Introduction}

We repeat the Butterfly Theorem expressed with the chord of the circle; see \cite{1,2,3,4,4a,4b}. This is an interesting and important theorem of plane Euclidean geometry. This classic theorem also has a lot of solutions; see \cite{1,2,3,4,4b}. Previously, the first author of this article also contributed a new proof to this theorem in \cite{5a}.

\begin{theorem}[Butterfly Theorem]Let $M$ be the midpoint of a chord $AB$ of a circle $\omega$, through $M$ two other chords $CD$ and $EF$ of $\omega$ are drawn. If $C$ and $F$ are on opposite sides of $AB$, and $CF$, $DE$ intersect $AB$ at $G$ and $H$ respectively, then $M$ is also the midpoint of $GH$.
\end{theorem}
\begin{figure}[htbp]
	\begin{center}\scalebox{0.7}{\includegraphics{Figure7729a.pdf}}\end{center}
	\label{fig00}
	\caption{Butterfly Theorem for chord of circle}
\end{figure}

If $O$ is the center of $\omega$, the condition $M$ is the midpoint of $AB$ and can be changed into $AB$ is perpendicular to $OM$. Based on this property we may have a different version of Butterfly Theorem as follows

\begin{theorem}[Butterfly Theorem for cyclic quadrilateral]\label{thm0}Let $ABCD$ be a quadrilateral inscribed in circle $\omega$. Let $O$ be the center of $\omega$. Diagonals $AC$ and $BD$ meet at $P$. Perpendicular line from $P$ to $OP$ meets the side line $AB$ and $CD$ at $Q$ and $R$, respectively. Then, $P$ is the midpoint of $QR$.
\end{theorem}
\begin{figure}[htbp]
	\begin{center}\scalebox{0.7}{\includegraphics{Figure7729.pdf}}\end{center}\label{fig0}
	\caption{Butterfly Theorem for cyclic quadrilateral}
\end{figure}

The Butterfly Theorem has a lot of extensions and generalizations, see \cite{4b,4c,6,7,8,9}. In this paper, we shall generalize the Theorem \ref{thm0} by replacing the cyclic quadrilateral into any quadrilateral. We shall have two generalizations of Theorem \ref{thm0} by this way. Where the quadrilateral is cyclic, we obtain Theorem \ref{thm0}. We also refer to the name as well as the properties of Quadrangle, Quadrilateral, and Quadrigon in \cite {4d,4e}.

\begin{theorem}[The first generalization of Butterfly Theorem]\label{thm1}Let $ABCD$ be an arbitrary quadrilateral. Diagonals $AC$ and $BD$ meet at $P$. Let $O_a$, $O_b$, $O_c$, and $O_d$ be the circumcenters of the triangles $BCD$, $CDA$, $DAB$, and $ABC$, respectively. Let $M$ and $N$ be the midpoints of segments $O_aO_c$ and $O_bO_d$, respectively. The perpendicular lines from $P$ to $MN$ meets lines $AB$ and $CD$ at $Q$ and $R$, respectively. Then, $P$ is the midpoint of $QR$.
\end{theorem}
\begin{figure}[htbp]
	\begin{center}\scalebox{0.7}{\includegraphics{Figure6916a.pdf}}\end{center}
	\label{fig1}
	\caption{The first generalization of Butterfly Theorem}
\end{figure}

\begin{theorem}[The second generalization of Butterfly Theorem]\label{thm2}Let $ABCD$ be an arbitrary quadrilateral. Diagonals $AC$ and $BD$ meet at $P$. Perpendicular bisectors of two segments $AC$ and $BD$ meet at $X$. Perpendicular bisectors of two segments $AB$ and $CD$ meet at $Y$. Perpendicular bisectors of two segments $AD$ and $BC$ meet at $Z$. Construct a parallelogram $XYWZ$. Perpendicular line to $PW$ passes through $P$ which meets the sides $AD$ and $BC$ at $Q$ and $R$, respectively. Then, $P$ is the midpoint of $QR$.
\end{theorem}
\begin{figure}[htbp]
	\begin{center}\scalebox{0.7}{\includegraphics{Figure7422a.pdf}}\end{center}
	\label{fig2}
	\caption{The second generalization of Butterfly Theorem}
\end{figure}
We give two proofs to both Theorem \ref{thm1} and Theorem \ref{thm2}. One of which is an elegant proof using projective geometry. For the remaining solutions, we use analytic geometry of the Cartesian coordinate system, if we have chosen the appropriate coordinate system, then we prove both theorems by other concise numerical methods. Obviously, the selection of the appropriate axis system is also a very interesting illustration showing the power of using the Cartesian coordinate system in proving complex geometrical theorems without using powerful tools of the number. The idea of Ren\'e Descartes in coordinate geometry is really very great; see \cite{0,0a}.

\section{Proofs of Theorems}

For the first proof of Theorem \ref{thm1}, we shall use the following lemmas

\begin{lemma}[AMM Problem 12147 \cite{4}]\label{lem1}$ABCD$ is an arbitrary quadrilateral. Perpendicular bisectors of $AB$, $CD$ meet at $X$ and the perpendicular bisectors of $BC$, $DA$ meet at $Y$. Then $XY$ is perpendicular to the Newton line of $ABCD$.
\end{lemma}

\begin{lemma}\label{lem2}Let $ABCD$ and $PQRS$ be two quadrilaterals in the plane such that $PQ\perp AB$, $QR \perp BC$, $RS \perp CD$, $SP \perp DA$, $PR \perp BD$, $SQ\perp AC$, and $PR\perp BD$. Let $J$ be the intersection point of lines $PQ$ and $RS$. Let $K$ be the intersection point of lines $QR$ and $SP$. Then, $JK$ is perpendicular to the Newton line of $ABCD$.
\end{lemma}

\begin{proof}[The first proof of Theorem \ref{thm1}]Let $F \equiv BC \cap DA$ and $G \equiv CD \cap AB$. Since $AB \perp O_cO_d$, $BC \perp O_dO_a$, $CD \perp O_aO_b$, $DA \perp O_bO_c$, $BD \perp O_aO_c$, and $AC\perp O_bO_d$ then using Lemma \ref{lem2} on quadrilateral $O_aO_bO_cO_d$, we get that $GF$ is perpendicular to its Newton line $MN$ so that $QR \parallel FG$. Since $F(P,A;B,G)=F(P,R;Q,G)=-1$ and $QR \parallel FG$, it follows that $P$ is midpoint of $QR$ (following the properties of harmonic pencil in \cite{3}). We complete the solution.
\end{proof}

We shall use the Cartesian coordinate system for the second proof of Theorem \ref{thm1}.
\begin{figure}[htbp]
	\begin{center}\scalebox{0.7}{\includegraphics{Figure7727.pdf}}\end{center}
	\label{fig6}
	\caption{The second proof of Theorem \ref{thm1} using Cartesian coordinate system}
\end{figure}
\begin{proof}[The second proof of Theorem \ref{thm1}]Choosing Cartesian coordinate system such that $P(0,0)$, $A(a,0)$, $B(b,kb)$, $C(c,0)$, and $D(d,kd)$, it is easily seen that $P$ is intersection of two diagonals $AC$ and $BD$. We now compute the coordinates of some points.

Circumcenter $O_a$ of triangle $BCD$ is intersection of perpendicular bisector of $BC$, $BD$
\begin{equation}\label{eq1}
O_a = \left(\frac{b d k^{2} + b d + c^{2}}{2 c}, \frac{b c k^{2} + b c - b d k^{2} - b d - c^{2} + c d k^{2} + c d}{2 c k} \right).
\end{equation}
Circumcenter $O_b$ of triangle $CDA$ is intersection of perpendicular bisector of $CD$, $CA$
\begin{equation}\label{eq2}
O_b = \left(\frac{a+c}{2}, \frac{a c - a d - c d + d^{2} k^{2} + d^{2}}{2 d k} \right).
\end{equation}
Circumcenter $O_c$ of triangle $DAB$ is intersection of perpendicular bisector of $DA$, $DB$
\begin{equation}\label{eq3}
O_c = \left(\frac{a^{2} + b d k^{2} + b d}{2 a}, \frac{-a^{2} + a b k^{2} + a b + a d k^{2} + a d - b d k^{2} - b d}{2 a k} \right).
\end{equation}
Circumcenter $O_d$ of triangle $ABC$ is intersection of perpendicular bisector of $AB$, $AC$
\begin{equation}\label{eq4}
O_d = \left(\frac{a+c}{2}, \frac{-a b + a c + b^{2} k^{2} + b^{2} - b c}{2 b k} \right).
\end{equation}
From \eqref{eq1}, \eqref{eq2}, \eqref{eq3}, and \eqref{eq4}, midpoints $M$ and $N$ of $O_aO_c$ and $O_bO_d$, respectively, have the coordinates
\begin{equation}\label{eq5}M = \left(\frac{a^{2} c + a b d k^{2} + a b d + a c^{2} + b c d k^{2} + b c d}{4 a c}, \frac{\splitfrac{-a^{2} c + 2 a b c k^{2} + 2 a b c - a b d k^{2} - a b d}{ - a c^{2} + 2 a c d k^{2} + 2 a c d - b c d k^{2} - b c d}}{4 a c k} \right),
\end{equation}
\begin{equation}\label{eq6}N = \left(\frac{a + c}{2}, \frac{a b c - 2 a b d + a c d + b^{2} d k^{2} + b^{2} d - 2 b c d + b d^{2} k^{2} + b d^{2}}{4 b d k} \right).
\end{equation}
From \eqref{eq5} and \eqref{eq6}, the perpendicular from $P(0,0)$ to line $MN$ has equation
\begin{equation}\label{eq7}y = \frac{-a b d k - b c d k}{a b c - a b d + a c d - b c d} x.
\end{equation}
Lines $BC$ and $AD$ have equation
\begin{equation}\label{eq8}
(AB):\ y = a b \frac{k}{a - b} - b k \frac{x}{a - b}.
\end{equation}
\begin{equation}\label{eq9}
(CD):\ y = c d \frac{k}{c - d} - d k \frac{x}{c - d}.
\end{equation}
From \eqref{eq7}, \eqref{eq8}, and \eqref{eq9}, we obtain the intersection $Q$ and $R$ of the perpendicular from $P$ to line $MN$ with the lines $AB$ and $CD$, respectively, have the coordinates
\begin{equation}\label{eq10}
Q = \left(\frac{-a b c + a b d - a c d + b c d}{a d - b c}, \frac{a b d k + b c d k}{a d - b c} \right),\end{equation}
\begin{equation}\label{eq11}
R = \left(\frac{a b c - a b d + a c d - b c d}{a d - b c}, \frac{-a b d k - b c d k}{a d - b c} \right).\end{equation}
Finally, from \eqref{eq10} and \eqref{eq11}, we easily check $P$ is the midpoint of $QR$. This completes the second proof.
\end{proof}

Using the Cartesian coordinate system again, we give proof of Theorem \ref{thm2}.
\begin{figure}[htbp]
	\begin{center}\scalebox{0.7}{\includegraphics{Figure7728.pdf}}\end{center}
	\label{fig7}
	\caption{Proof of Theorem \ref{thm2} using Cartesian coordinate system}
\end{figure}
\begin{proof}[The first proof of Theorem \ref{thm2}]Choosing the Cartesian coordinate system such that $P(0,0)$, $A(a,0)$, $B(b,kb)$, $C(c,0)$, and $D(d,kd)$, we easily seen $P$ is intersection of two diagonals $AC$ and $BD$. We now compute the coordinates of some points.

Perpendicular bisectors of $AC$ and $BD$ meet at $X$ which has coordinates
\begin{equation}\label{eq12}X = \left(\frac{a+c}{2}, \frac{-a + bk^{2} + b - c + dk^{2} + d}{2k} \right).
\end{equation}
Perpendicular bisectors of $AB$ and $CD$ meet at $Y$ which has coordinates
\begin{equation}\label{eq13}Y = \left(\frac{a^{2}d - b^{2}dk^{2} - b^{2}d - bc^{2} + bd^{2}k^{2} + bd^{2}}{2ad - 2bc}, \frac{\splitfrac{a^{2}c - a^{2}d - ac^{2} + ad^{2}k^{2} + ad^{2} - b^{2}ck^{2}}{ - b^{2}c + b^{2}dk^{2} + b^{2}d + bc^{2} - bd^{2}k^{2} - bd^{2}}}{2adk - 2bck} \right).
\end{equation}
Perpendicular bisectors of $AD$ and $BC$ meet at $Z$ which has coordinates
\begin{equation}\label{eq14}Z = \left(\frac{a^{2}b + b^{2}dk^{2} + b^{2}d - bd^{2}k^{2} - bd^{2} - c^{2}d}{2ab - 2cd}, \frac{\splitfrac{-a^{2}b + a^{2}c + ab^{2}k^{2} + ab^{2} - ac^{2}- b^{2}dk^{2}}{ - b^{2}d + bd^{2}k^{2} + bd^{2} + c^{2}d - cd^{2}k^{2} - cd^{2}}}{2abk - 2cdk} \right).
\end{equation}
From \eqref{eq12}, \eqref{eq13}, and \eqref{eq14}, the vertex $W$ of parallelogram $XYWZ$ has coordinates
\begin{equation}\label{eq15}W = \left(f(a,b,c,d,k),g(a,b,c,d,k)\right)
\end{equation}
where
\begin{equation}\label{eq16}f(a,b,c,d,k)=\frac{\splitfrac{a^{3}bd - a^{2}bcd - ab^{3}dk^{2} - ab^{3}d + 2ab^{2}d^{2}k^{2} + 2ab^{2}d^{2} - abc^{2}d - abd^{3}k^{2}}{ - abd^{3} - b^{3}cdk^{2} - b^{3}cd + 2b^{2}cd^{2}k^{2} + 2b^{2}cd^{2} + bc^{3}d - bcd^{3}k^{2} - bcd^{3}}}{2a^{2}bd - 2ab^{2}c - 2acd^{2} + 2bc^{2}d},
\end{equation}
and
\begin{equation}\label{eq17}
g(a,b,c,d,k)=\frac{\begin{aligned}
&a^{3}bc - a^{3}bd + a^{3}cd - 2a^{2}bc^{2} + a^{2}bcd
- 2a^{2}c^{2}d - ab^{3}ck^{2}- ab^{3}c\\
&+ ab^{3}dk^{2} + ab^{3}d + ab^{2}cdk^{2} + ab^{2}cd - 2ab^{2}d^{2}k^{2}- 2ab^{2}d^{2} + abc^{3}\\
&+ abc^{2}d + abcd^{2}k^{2} + abcd^{2}+ abd^{3}k^{2}+ abd^{3} + ac^{3}d - acd^{3}k^{2} - acd^{3}\\
&+ b^{3}cdk^{2} + b^{3}cd- 2b^{2}cd^{2}k^{2} - 2b^{2}cd^{2} - bc^{3}d + bcd^{3}k^{2} + bcd^{3}\end{aligned}}{2a^{2}bdk - 2ab^{2}ck - 2acd^{2}k + 2bc^{2}dk}.
\end{equation}
From \eqref{eq15}, \eqref{eq16}, and \eqref{eq17}, we get equation of perpendicular line from $P$ to line $PW$ as follows
\begin{equation}\label{eq18}
y = \frac{-abdk - bcdk}{abc - abd + acd - bcd}x.
\end{equation}
Thus intersection points of this line with lines $AD$ and $BC$ have coordinates
\begin{equation}\label{eq19}
Q = \left(\frac{-abc + abd - acd + bcd}{ab - cd}, \frac{abdk + bcdk}{ab - cd} \right)
\end{equation}
and
\begin{equation}\label{eq20}
R = \left(\frac{abc - abd + acd - bcd}{ab - cd}, \frac{-abdk - bcdk}{ab - cd} \right).
\end{equation}
From \eqref{eq19} and \eqref{eq20}, we easily check $P$ is the midpoint of $QR$. This completes the proof.
\end{proof}

The second proof of Theorem \ref{thm2} is based on the idea of the first proof of Theorem \ref{thm1}. We need a lemma

\begin{lemma}\label{lem3}Let $ABCD$ be an arbitrary quadrilateral. Diagonals $AC$ and $BD$ meet at $P$. Let $O_a$, $O_b$, $O_c$, and $O_d$ be the circumcenters of the triangles $BCD$, $CDA$, $DAB$, and $ABC$, respectively. Let $M$ and $N$ be the midpoints of diagonals $AC$ and $BD$, respectively. Then, the circles with diameters $O_aO_c$, $O_bO_d$, and the circumcircle of triangle $PMN$ are coaxial.
\end{lemma}

\begin{proof}Like the second proof of Theorem \ref{thm1}, we choose Cartesian coordinate system such that $P(0,0)$, $A(a,0)$, $B(b,kb)$, $C(c,0)$, and $D(d,kd)$, we easily seen $P(0,0)$ is intersection of two diagonals $AC$ and $BD$, and midpoints $M\left(\frac{a+c}{2},0\right)$ and $N\left(\frac{b+d}{2},k\frac{b+d}{2}\right)$. We now compute the coordinates of some points.

Circumcenter $O_a$ of triangle $BCD$ is intersection of perpendicular bisector of $BC$, $BD$
	\begin{equation}\label{eq21}
		O_a = \left(\frac{b d k^{2} + b d + c^{2}}{2 c}, \frac{b c k^{2} + b c - b d k^{2} - b d - c^{2} + c d k^{2} + c d}{2 c k} \right).
	\end{equation}
	Circumcenter $O_b$ of triangle $CDA$ is intersection of perpendicular bisector of $CD$, $CA$
	\begin{equation}\label{eq22}
		O_b = \left(\frac{a+c}{2}, \frac{a c - a d - c d + d^{2} k^{2} + d^{2}}{2 d k} \right).
	\end{equation}
	Circumcenter $O_c$ of triangle $DAB$ is intersection of perpendicular bisector of $DA$, $DB$
	\begin{equation}\label{eq23}
		O_c = \left(\frac{a^{2} + b d k^{2} + b d}{2 a}, \frac{-a^{2} + a b k^{2} + a b + a d k^{2} + a d - b d k^{2} - b d}{2 a k} \right).
	\end{equation}
	Circumcenter $O_d$ of triangle $ABC$ is intersection of perpendicular bisector of $AB$, $AC$
	\begin{equation}\label{eq24}
		O_d = \left(\frac{a+c}{2}, \frac{-a b + a c + b^{2} k^{2} + b^{2} - b c}{2 b k} \right).
	\end{equation}
From this, note that power of point $W$ with respect to circle diameter $XY$ is the dot product
$$\mathcal{P}_{W/(XY)}=\overrightarrow{WX}\cdot \overrightarrow{WY}.$$
Using \eqref{eq21}, \eqref{eq22}, \eqref{eq23}, and \eqref{eq24}, we have the ratio of powers
\begin{equation}\label{eq25}
\frac{\mathcal{P}_{P/(O_AO_C)}}{\mathcal{P}_{P/(O_BO_D)}}=\frac{\overrightarrow{PO_A}\cdot\overrightarrow{PO_C}}{\overrightarrow{PO_B}\cdot\overrightarrow{PO_D}}=\frac{(k^2+1)bd}{ac}
\end{equation}
\begin{equation}\label{eq26}
	\frac{\mathcal{P}_{M/(O_AO_C)}}{\mathcal{P}_{M/(O_BO_D)}}=\frac{\overrightarrow{MO_A}\cdot\overrightarrow{MO_C}}{\overrightarrow{MO_B}\cdot\overrightarrow{MO_D}}=\frac{(k^2+1)bd}{ac}
\end{equation}
\begin{equation}\label{eq27}
	\frac{\mathcal{P}_{N/(O_AO_C)}}{\mathcal{P}_{N/(O_BO_D)}}=\frac{\overrightarrow{NO_A}\cdot\overrightarrow{NO_C}}{\overrightarrow{NO_B}\cdot\overrightarrow{NO_D}}=\frac{(k^2+1)bd}{ac}.
\end{equation}
Therefore,
\begin{equation}\label{eq28}\frac{\overrightarrow{PO_A}\cdot\overrightarrow{PO_C}}{\overrightarrow{PO_B}\cdot\overrightarrow{PO_D}}=\frac{\overrightarrow{MO_A}\cdot\overrightarrow{MO_C}}{\overrightarrow{MO_B}\cdot\overrightarrow{MO_D}}=\frac{\overrightarrow{NO_A}\cdot\overrightarrow{NO_C}}{\overrightarrow{NO_B}\cdot\overrightarrow{NO_D}}=\frac{(k^2+1)bd}{ac}=\frac{\overrightarrow{PB}\cdot\overrightarrow{PD}}{\overrightarrow{PA}\cdot\overrightarrow{PC}}.
\end{equation}
By property of ratio powers, we have the circles with diameters $O_aO_c$, $O_bO_d$, and the circumcircle of triangle $PMN$ are coaxial. This completes the proof.
\end{proof}

\begin{proof}[Second proof of Theorem \ref{thm2}]Letting $U \equiv AD \cap BC$ and $V \equiv AB \cap CD$. In order to prove that $P$ is midpoint of $QR$, we need to prove $QR \parallel UV$ (using harmonic pencil as in the first proof of Theorem \ref{thm1}) or in other words $PW \perp UV$. By homothety with center $X$ and factor $\frac{1}{2}$, this is equivalent to prove that the line joining the midpoints $P'$ and $K'$ of $XP$ and $XK$ is perpendicular to $UV$. From Lemma \ref{lem3}, we deduce that $K'$ falls on the Newton line of $O_AO_BO_CO_C$ and from Lemma \ref{lem3}, we know this Newton line is perpendicular to $UV$ from Lemma \ref{lem2}, which completes the proof.
\end{proof}

\begin{acknowledgements}We thank Chris van Tienhoven and his associates in \cite{4d,4e} for providing us with valuable knowledge about Quadrangle, Quadrilateral, and Quadrigon and how to categorize them.

We thank open math software Geogebra Geometry \cite{10a} and Sage Notebook \cite{10} for drawing and transforming algebraic expressions.
\end{acknowledgements}

History and Overview (math.HO); Metric Geometry (math.MG)


Matrices that commute with their derivative. On a letter from Schur to Wielandt

Abstract: We examine when a matrix whose elements are differentiable functions in one variable commutes with its derivative. This problem was discussed in a letter from Issai Schur to Helmut Wielandt written in 1934, which we found in Wielandt's Nachlass. We present this letter and its translation into English. The topic was rediscovered later and partial results were proved. However, there are many subtle observations in Schur's letter which were not obtained in later years. Using an algebraic setting, we put these into perspective and extend them in several directions. We present in detail the relationship between several conditions mentioned in Schur's letter and we focus in particular on the characterization of matrices called Type 1 by Schur. We also present several examples that demonstrate Schur's observations.

\section{Introduction}

What are the conditions that force a matrix  of differentiable  functions to commute with its elementwise derivative?
This problem, discussed in a letter from I. Schur to H. Wielandt \cite{Sch34}, has been
discussed in a large number of papers \cite{Ama54,Asc50,Asc52,BogC59,Die74,Eps63,Eru46,Gof81,Hel55,KotE82,
Kuz76,Mar65,Mar67,Par72,Pet79,Ros65,Sch52,Ter55}. However, these authors were unaware of Schur's letter and did not find some of its principal results.  A summary and a historical discussion of the problem and several extensions thereof are presented by Evard in \cite{Eva85,Eva95}, where the study of the topic is dated back to the 1940s and 1950s, but
Schur's letter shows that it already  appeared in Schur's lectures in the 1930s, if not earlier.

\if {
We do not  know which set of functions Schur had in mind,
whether Schur meant this to be the set of  analytic functions
or  meromorphic functions in one variable. He
may even have had the rational functions in one variable over the
complex numbers in mind. And we do not know which arguments Schur used to reach conclusions concerning matrices of small size at the end of his letter.  Though our arguments remain close to those of Schur, we will take an algebraic approach and discuss the results in Schur's letter in differential fields.
This is also the approach that was taken  in \cite{AdkEG93} and  in unpublished notes of Guralnick~\cite{Gur05}, where results related to ours using differential fields were discussed.
This approach has also been taken in

} \fi

The content of the paper is as follows.
In Section~\ref{letter} we present a facsimile of Schur's letter to
Wielandt and its English translation. In Section~\ref{sec:discussion} we discuss Schur's letter and we motivate our use of differential fields.
In Section~\ref{sec:prelim} we introduce our notation and reprove Frobenius result on Wronskians. In Section~\ref{sec:ct1} we discuss the results that characterize
the matrices of Type~1 in Schur's letter and in our main Section~\ref{sec:triandia} we discuss
the role  played by diagonalizability and triangularizability of the matrix  in the commutativity of the matrix and its derivative.
We also present several illustrative examples in Section~\ref{sec:exs}
and we state an open problem in Section~\ref{conclusion}.

\section{A letter from Schur to Wielandt}\label{letter}
Our paper deals with the following letter from Issai Schur to his PhD
student Helmut Wielandt. See the facsimile below.
\begin{figure}
\scalebox{.8}{\includegraphics{schur_brief_voll}}
 \vspace{0.5cm}
	\label{FigOne}
\end{figure}
\begin{figure}
\scalebox{.8}{\includegraphics{schur_brief_voll2}}
 \vspace{0.5cm}
	\label{FigTwo}
\end{figure}
\begin{figure}
\scalebox{.8}{\includegraphics{schur_brief_voll3}}
 \vspace{0.5cm}
	\label{FigThree}
\end{figure}
\begin{figure}
\scalebox{.8}{\includegraphics{schur_brief_voll4}}
 \vspace{0.5cm}
	\label{FigFour}
\end{figure}
Translated into English, the letter reads as follows:

{\it
Lieber Herr Doktor!\hfill Berlin, 21.7.34

You are perfectly right. Already for $3\leq n<6$
not every solution of the
equation $M M'=M'M$ has the form
\eq{1} M_1 =\sum_{\lambda} f_\lambda C_\lambda, \en
where the $C_\lambda$ are pairwise commuting constant matrices. One
must also consider the type
\eq{2} M_2=(f_\alpha g_\beta), \quad (\alpha,\beta=1,\ldots n), \en
where $f_1,\ldots f_n$, $ g_1,\ldots,g_n$ are arbitrary functions
that satisfy the conditions
$$ \sum_\alpha f_\alpha g_\alpha= \sum_\alpha f'_\alpha g_\alpha=0$$
and therefore also
$$ \sum_\alpha f_\alpha g'_\alpha=0.$$
In this case we obtain
$$ M^2 =M M'=M'M=0.$$
In addition we have the type
\eq{3} M_3=\phi E+M_2, \en
with $M_2$ of type (\ref{2}). \footnote{Note that $E$ here denotes the identity matrix.}
 From my old notes, which  I did not present correctly in my lectures,
it can be deduced that for $n<6$ every solution of $M M'=M'M$
can be completely decomposed by means of constant similarity
transformations into matrices of type (\ref{1}) and (\ref{3}).
Only from $n=6$ on there are also other cases.
This seems to be correct.
But I have not checked my rather laborious
computations (for $n=4$ and $n=5$).

I concluded in the following simple manner that one can restrict oneself to
the case where $M$ has only one characteristic root (namely $0$):  If $M$
has two different characteristic roots, then one can determine
a  rational  function  $N$ of $M$ for which $N^2=N$ but
not $N=\phi E$. Also $N$ commutes with $N'$. It follows from $N^2=N$
that $2NN'=N'$, thus $2N^2N'= 2NN'=NN'$. This yields
$2 NN'=N'=0$, i.e., $N$ is constant.

Now one can apply a constant similarity transformation to $M$ so that
instead of $N$ one achieves a matrix of the form
$$\mat{cc} E & 0 \\ 0 & 0 \rix.$$
This shows that $M$ can be decomposed  completely
by means of a constant
similarity transformation.

One is led to type (\ref{2}) by studying the case $M^2=0$, $\rank M=1$.
Already for $n=4$ also the cases $M^2=0$, $\rank M=2$, $M^3=0$ need to be
considered.

Type (\ref{1}) is completely characterized by the property
that $M,M',M'', \ldots $ are pairwise
commuting. This is not only necessary but also sufficient.
For, if among the $n^2$ coefficients $f_{\alpha \beta}$ of $M$ exactly
$r$ are linearly independent over the domain of constants,
then one can write
$$ M=f_1 C_1+\cdots +f_rC_r,$$
 ($C_s$  a constant matrix), where $f_1, \ldots, f_r$ satisfy no
 equation $\sum_{\alpha} \mbox{\rm const}\ f_\alpha=0$.
Then
$$ M^{(\nu)}= f_1^{(\nu)} C_1+ \cdots +f_r^{(\nu)} C_r,
\quad (\nu=1,\ldots,r-1).$$
Since the Wronskian determinant
$$\left |\mat{ccc} f_1 &\ldots& f_r \\
f_1' &\ldots& f_r'\\
 & \vdots & \rix\right |
 $$
 cannot vanish identically, one obtains equations of the form
$$ C_s=\sum_{\sigma=0}^{r-1} \phi_{s \sigma} M^{(\sigma)}.$$
If $M,M',M'', \ldots, M^{(r-1)}$ are pairwise
commuting, then the same is true also for
$C_1,\ldots C_r$ and thus $M$ is  of type (\ref{1}). This implies
furthermore that $M$ belongs to type (\ref{1}) if
$M^n$ is the highest\footnote{We think that Schur means \emph{lowest} here.} power of $M$ that equals $0$.
In the case $n=3$ one therefore only needs to consider type (\ref{2}).

\hfill With best regards

\hfill Yours, Schur
}

\bigskip

\section{Discussion of Schur's letter}\label{sec:discussion}

This letter was found in Helmut Wielandt's mathematical Nachlass when it was collected by  Heinrich Wefelscheid and Hans Schneider not long after Wielandt's death in 2001.  We may therefore safely assume that Schur's recent student Wielandt is the "Herr Doktor" to whom the letter is addressed. Schur's letter begins with a  reference to a previous  remark of Wielandt's which corrected an incorrect assertion by Schur. We can only guess at this sequence of events, but perhaps a clue is provided by Schur's reference to his notes  which he did not present correctly in his lectures. Could Wielandt have been in the audience and did he subsequently point out the error? And what was this error?  Very probably it was that every matrix of functions that commutes with its derivative is given by (1) (matrices called Type 1), for Schur now denies this and displays another type of matrix commuting with its derivative (called Type 2). He recalls that in his notes he claimed that for matrices of size 5 or less every such matrix is of Type 1, 2 or 3, where Type 3 is obtained from Type 2 by adding a scalar function times the identity. This is not correct because there is also the direct sum of a size 2 matrix of Type 1 and a size 3 matrix of Type 2, we prove this below.

We do not know why Schur was interested in the topic of matrices of functions that commute with their derivative, but
it is probably a safe guess that this question came up in the context of solving differential equations, at least this is
the motivation in many of the subsequent papers on this topic.

As one of the main results of his letter, Schur shows that an idempotent that commutes with its derivative is a constant matrix  and, without further explanation,  concludes that one can restrict oneself to matrices with a single eigenvalue. The latter  observation raises several questions. First,  Schur does not say which functions he has in mind. Second, his argument follows from a standard decomposition of a matrix by a similarity into a direct sum of matrices {\em provided that} the eigenvalues of the matrix are functions of the type considered.  But this is not true in general, for example the eigenvalues of a matrix of rational functions are algebraic functions.
We wonder whether Schur was aware of this difficulty and we shall return to it at the end of this section.

Then Schur shows a  matrix of size $n$ is of Type 1 if and only if it and its first $n-1$ derivatives are pairwise commutative. His proof is based on a result of Frobenius \cite{Fro1874} that a set of functions is linear independent over the constants if and only if their Wronskian determinant is nonzero. Frobenius, like Schur,  does  not explain what functions he has in mind. In fact,  Peano \cite{Pea1889} shows that there exist real differentiable functions that are linearly independent over the reals whose Wronskian is $0$. This is followed by Bocher \cite{Boc00} who shows that Frobenius' result  holds for analytic functions and investigates necessary and sufficient conditions in \cite{Boc01}. A good discussion of this topic can be found in \cite{BosD10}.

We conclude this section by explaining how our exposition has been influenced by some of the observation above. As we do not know what functions Schur and Frobenius had in mind, we follow \cite{AdkEG93} and some unpublished notes  of Guralnick \cite{Gur05} and set Schur's results and ours in terms of differential fields (which include the field of rational functions and the quotient field of analytic functions over the real or complex numbers).  Since we do not know how Schur concludes that it is enough to consider matrices with a single eigenvalue, we derive our results from  standard matrix decomposition (our Lemma \ref{decomp} below) which does not assume that all eigenvalues lie in the differential field under consideration.

 \section{Notation and preliminaries}\label{sec:prelim}

A {\em differential field} $\mathbb F$ is an (algebraic) field together
with an additional operation (the derivative), denoted by ${}'$ that satisfies $(a+b)' = a'
+ b'$ and $(ab)' = ab' + a'b$ for $a,b \in \mathbb F$. An element $a
\in \mathbb F$ is called a {\em constant} if $a' = 0$. It is easily
shown that the set of constants forms a subfield $\mathbb K$ of $\mathbb F$
with $1 \in \mathbb K$. Examples are provided by the rational functions over the real or complex numbers
and the meromorphic functions over the complex numbers.

In what follows we consider a (differential) field $\mathbb F$
and  matrices $M=[m_{i,j}]\in \mathbb F^{n,n}$.
The main condition that we want to analyze is when $M\in \mathbb F^{n,n}$
commutes with its derivative,
\begin{equation}\label{c1}
MM'=M'M.
\end{equation}
As  $M\in \mathbb F^{n,n}$, it has a minimal and a characteristic polynomial,  and $M$ is called {\em nonderogatory} if the characteristic polynomial is equal to the minimal  polynomial, otherwise it is called {\em derogatory}. See \cite{HorJ85}.

In Schur's letter the following
 three types of matrices are considered.
 %
\begin{definition}
Let $M\in \mathbb F^{n,n}$. Then $M$ is said to be of
\begin{itemize}
\item {\em Type 1\/} if
\[
M =\sum_{j=1}^{k} f_j C_j,
\]
where $f_j\in \mathbb F$, and $C_j\in \mathbb K^{n,n}$, for $j=1,\ldots,k$,
and the $C_j$ are pairwise commuting;
\item {\em Type 2\/} if
\[
M=f g^T,\
\]
with $f,g\in \mathbb F^{n}$, satisfying $f^Tg=f^Tg'=0$;
\item {\em Type 3\/} if
\[
M=hI+\widetilde M,
\]
with $h\in \mathbb F$ and $\widetilde M$ is of Type~2.
\end{itemize}
\end{definition}
Schur's letter also mentions the condition that all derivatives of $M$ commute, i.e.,
\begin{equation}\label{c6}
M^{(i)}M^{(j)}=M^{(j)}M^{(i)}\ \mbox{\rm for all nonnegative integers}\ i,j.
\end{equation}
To characterize the relationship between all these properties, we first recall
several results from Schur's letter and from classical algebra.
\begin{lemma} \label{insight} Let $\mathbb F$ be a differential field with field of constants
 $\mathbb K$. Let $N$ be an idempotent matrix in
$\mathbb {F}^{n,n}$ that commutes with $N'$. Then $N \in \mathbb K^{n,n}$.
\end{lemma}
\proof (See Schur's letter.) It follows from $N^2 = N$ that $2NN' =
N'$. Thus $2NN' =  2N^2N' = NN'$ and this implies that $0 = 2NN' = N'$.
\eproof
Another important tool in our analysis will be the following result which in its original form
is due to Frobenius~\cite{Fro1874}, see Section~\ref{sec:discussion}.
We phrase and prove the result in the context of differential fields.
\begin{theorem}\label{frob}
Consider a differential field $\mathbb F$ with field of constants $\mathbb K$. Then
$y_1,\ldots,y_r\in \mathbb F$ are linearly dependent over $\mathbb K$ if and only if the columns of the \emph{Wronski matrix}
\[
Y=\left[ \begin{array}{cccc} y_1 & y_2 & \dots & y_r \\
                         y_1' & y_2' &\dots & y_r'\\
                         \vdots & \vdots & \ddots & \vdots\\
                         y_1^{(r-1)} & y_2^{(r-1)} &\dots & y_r^{(r-1)}
\end{array} \right ],
\]
are linearly dependent over  $\mathbb F$.
\end{theorem}
\proof
We proceed by induction over $r$. The case $r=1$ is trivial.

Consider the Wronski matrix $Y$ and the lower triangular matrix
  \[
Z=\left[ \begin{array}{cccc} z & 0 & \dots & 0 \\
                         c_{2,1}z' & z &\dots & 0\\
                         \vdots & \vdots & \ddots & \vdots\\
                         c_{n,1}z^{(n-1)} & c_{n,2}z^{(n-2)} &\dots & z
\end{array} \right ],
\]
with $c_{i,j}$ appropriate binomial coefficients such that
\[
ZY=\left[ \begin{array}{cccc} z  y_1&   z  y_2& \dots & z  y_r \\
                         (z  y_1)' & (z  y_2)' &\dots & (z  y_r)'\\
                         \vdots & \vdots & \ddots & \vdots\\
                         (z  y_1)^{(n-1)} & (z  y_2)^{(n-1)} &\dots & (z  y_r)^{(n-1)}
\end{array} \right ].
\]
Since $\mathbb F$ is a differential field, we can choose $z=y_1^{-1}$ and obtain
that
\[
ZY=\left[ \begin{array}{cccc} 1&   y_1^{-1}  y_2& \dots & y_1^{-1}  y_r \\
                         0 & (y_1^{-1} y_2)' &\dots & ( y_1^{-1} y_r)'\\
                         \vdots & \vdots & \ddots & \vdots\\
                         0 & (y_1^{-1}  y_2)^{(n-1)} &\dots & ( y_1^{-1} y_r)^{(n-1)}
\end{array} \right ].
\]
It follows that the columns of $Y$ are linearly dependent over $\mathbb F$ if and only if the columns
of
\[
\left[ \begin{array}{ccc}
                          (y_1^{-1} y_2)' &\dots & ( y_1^{-1} y_r)'\\
                         \vdots  & \ddots & \vdots\\
                          (y_1^{-1}  y_2)^{(n-1)} &\dots & ( y_1^{-1} y_r)^{(n-1)}
\end{array} \right ]
\]
are linearly dependent over $\mathbb F$, which, by induction, holds
 if and only if  $(y_1^{-1} y_2)' ,\dots , ( y_1^{-1} y_r)'$
are linearly dependent over $\mathbb K$, i.e., there exist coefficients
$b_2,\ldots,b_r\in \mathbb K$, not all $0$,
such that
\[
b_2 (y_1^{-1} y_2)'+\cdots +b_r( y_1^{-1} y_r)'=0.
\]
Integrating this identity, we obtain
\[
b_2 (y_1^{-1} y_2)+\cdots +b_r( y_1^{-1} y_r)=-b_1
\]
for some integration constant $b_1\in \mathbb K$, or equivalently
\[
b_1 y_1+\cdots + b_r y_r=0.
\]
{}\vskip -1cm\hskip 12cm  \eproof

Theorem~\ref{frob} implies in particular that the columns of the Wronski matrix $Y$
are linearly independent over $\mathbb F$ if and only if they are linearly independent over $\mathbb K$.

\begin{remark}{\rm
Theorem~\ref{frob} is discussed from a formal algebraic point of view, which however includes the cases of complex analytic functions and rational functions over a field, since these are contained in differential fields. Necessary and sufficient conditions  for Theorem~\ref{frob}  to hold for other functions were proved in \cite{Boc01} and discussed in many places, see, e.g., \cite{BosD10,Mei61} and \cite[Ch. XVIII]{Mui33}.
 }
\end{remark}

\section{Characterization of matrices of Type~1} \label{sec:ct1}
In this section we discuss  relationships among the various properties introduced in Schur's letter and in the previous section. This will give, in particular, a characterization of matrices of Type~1.

In his letter, Schur proves the following result.

\begin{theorem}\label{th:allcommute}
Let $\mathbb F$ be a differential field. Then $M\in {\mathbb F}^{n,n}$
is of Type~1 if and only if it satisfies condition (\ref{c6}), i.e., $M^{(i)}M^{(j)}=M^{(j)}M^{(i)}$ for all nonnegative integers $i,j$.
\end{theorem}
\proof (See Schur's letter.)
If $M$ is of Type~1, then $M =\sum_{j=1}^{k} f_j C_j$ and the $C_j\in \mathbb K^{n,n}$ are pairwise commuting, which immediately implies (\ref{c6}).  For the converse,
Schur makes use of Theorem~\ref{frob}, since if among the $n^2$ coefficients
$m_{i,j}$ exactly $r$ are linearly independent over $\mathbb K$, then
\[
M=f_1C_1+\cdots+f_rC_r,
\]
with coefficients $C_i\in \mathbb K^{n,n}$, where
$f_1,\ldots,f_r$ are linearly independent over $\mathbb K$.
Then
\[
M^{(i)}=f_1^{(i)}C_1+\cdots +f_r^{(i)}C_r,\qquad i=1,\ldots,r-1.
\]
By Theorem~\ref{frob}, the columns of the associated Wronski matrix
are linearly independent, and hence each of the $C_i$ can be expressed
as
\[
C_i=\sum_{j=0}^{r-1} g_{i,j} M^{(j)}.
\]
Thus, if condition~(\ref{c6}) holds, then the $C_i$, $i=1,\ldots,r$,
are pairwise commuting and thus $M$ is of Type~1.
\eproof
Using this result we immediately have the following Theorem.

\begin{theorem}\label{th:nondero}

Let $\mathbb F$ be a differential field with field of constants
$\mathbb K$. If $M\in \mathbb F^{n,n}$ is nonderogatory  and  $MM' = M'M$,
then $M$ is of Type~1.
\end{theorem}
\proof
If $M$ is nonderogatory then all matrices that commute with $M$ have the form $p(M)$, where $p$ is a polynomial with coefficients in $\mathbb F$, see \cite{DraDG51,HorJ85}.  Thus $MM' = M'M$ implies that $M'$ is a polynomial in $M$.
But then every derivative $M^{(j)}$ is a polynomial in $M$ as well and
thus (\ref{c6}) holds which by Theorem~\ref{th:allcommute} implies that $M$ is of Type~1.
\eproof
The following example from \cite{Asc52,Eva85} of a Type~2 matrix shows that one cannot easily drop the
condition that the matrix is nonderogatory.

\begin{example}\label{eva3x3}
{\rm   Let
\[ f =\mat{c}   1\\   t \\ t^2\rix,\qquad g =\mat{c}  t^2\\ -2 t\\   1
\rix,
\]
then $f^T g=0$ and  $f^T g'=0$, hence
\begin{equation}\label{evaM}
M_a := g f^T= \mat{ccc} t^2 &   t^3&   t^4\\
-2 t& -2 t^2 & -2 t^3\\
1&     t &  t^2\rix,
\end{equation}
is of Type~2. Since $M_a$ is nilpotent with $M_a^2=0$ but $M_a\neq 0$ and the rank is $1$,
it is derogatory. One has
\[
M_a'=
 \mat{ccc}    2t & 3t^2&  4t^3\\
-2  & -4t& -6t^2\\
0 &      1 &    2 t
\rix,\qquad
M_a''= \mat{ccc}   2 & 6t & 12 t^2 \\
 0 & -4 & -12 t \\
0 & 0 & 2\rix,
\]
and thus $ M_a M_a'=M_a'  M_a=0$. By the product rule
it immediately follows that $M_a M_a''=M_a''M_a$, but
\[
M_a' M_a''= \mat{ccc}
  4t&     0& -4t^3\\
    -4  & 4t &12t^2\\
     0  &   -4 &  -8t
\rix \neq M_a'M_a''=\mat{ccc}
-8t &-6t^2 & -4t^3\\
   8  &  4t  &    0\\
   0  &   2 &  4t\rix.
\]
Therefore, it follows from Theorem~\ref{th:allcommute} that $M_a$ is not of Type~1.

For any dimension $n\geq 3$, one can construct an example of Type~2 by choosing $f \in {\mathbb F}^n$, setting $F = [f,f']$ and then choosing $g$ in the nullspace of $F^T$.
Then  $fg^T$ is of Type~2.
}
\end{example}
Actually every nilpotent matrix function $M$ of rank one
satisfying $MM' = M'M$ is of the form $M=fg^T$ and hence of Type~2.
This follows immediately because if $M=fg^T$ and $M^2=0$ then $g^Tf=0$
and hence $g^Tf'+(g^T)'f=0$. Then it follows from $MM' = M'M$
that $fg^T(f(g^T)' + f'g^T)  = (g^Tf')fg^T= (f(g^T)' + f'g^T)fg^T  = (g^T)'f fg^T$
which implies that  $g^Tf' = f^Tg'$ and hence $g^Tf' = f^Tg' = 0$.

\section{Triangularizability and Diagonalizability}\label{sec:triandia}

In his letter Schur claims that it is sufficient to consider the case
that $M\in \mathbb F^{n,n}$ is triangular with only one eigenvalue. This  follows from his argument
in case the matrix has its eigenvalues in $\mathbb F$, which could be guaranteed by assuming that this
matrix is $\mathbb F$-diagonalizable or even $\mathbb F$-triangularizable. Clearly a sufficient condition
for this to hold is that $\mathbb F$ is algebraically closed, because then for every matrix in $\mathbb F^{n,n}$ the characteristic polynomial splits into linear factors.
\if{
To do this, an essential property discussed in Schur's letter is whether there exists a similarity
transformation to triangular or diagonal form with nonsingular matrices in $\mathbb F^{n,n}$ or
$\mathbb K^{n,n}$.
}\fi
\begin{definition}\label {triangularizable}
Let $\mathbb F$ be a differential field and let $\mathbb H$ be a subfield of $\mathbb F$.
Then $M\in \mathbb F^{n,n}$ is called
{\em $\mathbb H$-triangularizable (diagonalizable)} if there exists a nonsingular $T\in \mathbb H^{n,n}$ such that $T^{-1} M T$ is upper triangular (diagonal).
\end{definition}
Using Lemma~\ref{insight}, we can obtain the following result for
matrices $M\in \mathbb F^{n,n}$ that commute with their derivative $M'$, which is most likely well known
but we could not find a reference.
\begin{lemma}\label{decomp}
Let $\mathbb F$ be a differential field with field of constants $\mathbb K$, and suppose that $M \in {\mathbb F}^{n,n}$ satisfies $MM' = M'M$. Then there
exists an invertible matrix $T\in \mathbb K^{n,n}$ such that
\eq{dirsum}
T^{-1} M T= \diag (M_1,\ldots,M_k),
\en
where the minimal polynomial of each $M_i$ is a power of a
polynomial that is irreducible over $\mathbb F$.
\end{lemma}
\proof
 Let the minimal polynomial of $M$ be $\mu(\lambda) = \mu_1(\lambda)\cdots \mu_k(\lambda)$,
where the $\mu_i(\lambda)$ are powers of pairwise distinct polynomials that are
irreducible over $\mathbb F$. Set
\[
p_i(\lambda) = \mu(\lambda)/\mu_i(\lambda),\qquad i = 1,\ldots,k.
\]
Since the polynomials $p_i(\lambda)$ have no common factor, there exist polynomials
$q_i(\lambda)$, $i = 1,\ldots,k$, such that the polynomials $\epsilon_i(\lambda) = p_i(\lambda)q_i(\lambda)$, $i = 1,\ldots,k$, satisfy
\begin{equation}\label{epscomp}
 \epsilon_1(\lambda) + \cdots + \epsilon_k(\lambda) = 1.
\end{equation}
Setting $E_i = \epsilon_i(M)$, $i = 1, \ldots, k$ and using the fact that
$\mu(M) =0$ yields that
\begin{eqnarray}\label{comp}
E_1 + \cdots + E_k &=& I, \\
\label{ortho}
E_iE_j &=& 0,\qquad
\; \, i,j = 1,\ldots,k,\quad  i\neq j,\\
\label{idem}
E_i^2 &=& E_i,\qquad i = 1,\ldots,k.
\end{eqnarray}
The last identity follows directly from (\ref{comp}) and (\ref{ortho}).
Since the $E_i$ are polynomials in $M$ and $MM' = M'M$, it follows that  the $E_i$ commute with $E'_i$, $i = 1,\ldots k$.  Hence, by Lemma~\ref{insight}, $E_i \in \mathbb K^{n,n}$, $i = 1,\ldots,k$. By (\ref{comp}), (\ref{ortho}), and (\ref{idem}), $\mathbb K^n$ is a direct sum
of the ranges of the $E_i$ and we obtain  that, for some nonsingular  $T\in \mathbb K^{n,n}$,
\[
  \widetilde{E_i}:= T^{-1}E_iT = \diag(0, I_i,0),\qquad   i = 1,\ldots,k,
\]
where the $I_i$ are identity matrices of the size equal to the dimension to the
range of $E_i$. This is a consequence of the fact that $E_i$ is diagonalizable with eigenvalues $0$ and $1$.
Since each $E_i$ commutes with $M$,
we obtain that
\begin{eqnarray*}
 \widetilde{M_i}&:=& T^{-1}E_iMT \\
 &=&  T^{-1}E_iME_iT\\
 &=& \diag(0,I_i,0) T^{-1}MT \diag(0,I_i,0)\\
 &=&\diag(0,M_i,0) ,\qquad  i = 1, \ldots, k.
\end{eqnarray*}
Now observe that
\[
\widetilde{E_i}\mu_i(\widetilde{M}_i) \widetilde{E_i}= T^{-1} \epsilon_i(M)\mu_i(M)  \epsilon_i(M)T = 0,
\]
since
$\epsilon_i(\lambda)\mu_i(\lambda )= \mu(\lambda)q_i(\lambda)$. Hence $\mu_i(M_i)=0$ as well.
We assert that  $\mu_i(\lambda)$ is the minimal polynomial of $M_i$, for if
 $r(M_i) = 0$ for a proper factor $r(\lambda)$ of $m_i(\lambda)$ then $r(M)\Pi_{j \neq i} \mu_j(M) = 0$,
 contrary to the assumption that $ \mu(\lambda)$ is the minimal polynomial of $M$.
 \eproof
Lemma~\ref{decomp} has the following corollary, which has been proved in a different way
in \cite{AdkEG93} and \cite{Gur05}.
\begin{corollary}\label{th:diagonal}
Let $\mathbb F$ be a differential field with field of constants
$\mathbb K$. If $M\in \mathbb F^{n,n}$ satisfies $MM' = M'M$ and is $\mathbb F$-diagonalizable, then $M$ is $\mathbb K$-diagonalizable.
\end{corollary}
\proof
In this case, the minimal polynomial of $M$ is a product of distinct linear factors and hence, the minimal polynomial of each $M_i$ occurring in the proof of Lemma~\ref{decomp} is linear. Therefore, each $M_i$ is a scalar matrix.
\eproof
We also have the following Corollary.
\begin{corollary}\label{cor:diag_type1}
Let $\mathbb F$ be a differential field with field of constants
$\mathbb K$. If $M\in \mathbb F^{n,n}$ satisfies $MM' = M'M$ and is $\mathbb F$-diagonalizable, then $M$ is of Type~1.
\end{corollary}
\proof
By Corollary~\ref{th:diagonal}, $M=T^{-1} \diag (m_1,\ldots,m_n)T$ with $m_i\in \mathbb F$
and nonsingular $T\in \mathbb K^{n,n}$. Hence
\[
M=\sum_{i=1}^n m_{i}T^{-1} E_{i,i} T
\]
where $E_{i,i}$ is a matrix that has a $1$ in position $(i,i)$ and zeros everywhere else. Since all the matrices $E_{i,i}$ commute,
$M$ is of Type~1.
\eproof

\begin{remark}\label{refrem} {\rm Any $M\in \mathbb F^{n,n}$ that is of rank one, satisfies $MM' = M'M$ and is not nilpotent, is of Type~1, since in this case $M$ is $\mathbb F$-diagonalizable. This follows by Corollary~\ref{cor:diag_type1}, since
the minimal polynomial has the from $(\lambda-c)\lambda$ for some $c\in \mathbb F$. This means in particular for a rank one matrix $M\in \mathbb F^{n,n}$ to be of Type~2 and not of Type~1 it has to be nilpotent.}
\end{remark}
For matrices that are just triangularizable the situation is more subtle. We have the following theorem.
\begin{theorem} \label{th:triangularize} Let $\mathbb F$ be a differential field with an algebraically closed field of constants $\mathbb K$. If $M \in \mathbb F^{n,n}$ is Type~1, then $M$ is $\mathbb K$-triangularizable.
\end{theorem}
\proof
Any finite set of pairwise
commutative matrices with elements in an algebraically closed field may be simultaneously triangularized, see e.g.,
\cite[Theorem 1.1.5]{RadR00}. Under this assumption on $\mathbb K$, if $M$ is Type~1, then it follows that  the matrices $C_i \in \mathbb K^{n,n}$  in the representation of $M$ are simultaneously triangularizable by a matrix
$T \in \mathbb K^{n,n}$. Hence $T$ also triangularizes $M$.
\eproof
Theorem~\ref{th:triangularize} implies that  Type~1 matrices
have $n$ eigenvalues  in $\mathbb F$ if $\mathbb K$ is algebraically closed and it further immediately
leads to a Corollary of Theorem~\ref{th:nondero}.
\begin{corollary}\label{cor:triangularize}
Let $\mathbb F$ be a differential field with field of constants
$\mathbb K$. If $M\in \mathbb F^{n,n}$ is nonderogatory, satisfies $MM' = M'M$ and
if $\mathbb K$ is algebraically closed, then $M$ is $\mathbb K$-triangularizable.
\end{corollary}
\proof
By Theorem~\ref{th:nondero} it follows that $M$ is Type~1 and thus the assertion follows
from Theorem~\ref{th:triangularize}.
\eproof

\section{Matrices of small size and examples}\label{sec:exs}

Example~\ref{eva3x3} again shows that it is difficult to drop
some of the assumptions, since this matrix is derogatory, not of Type~1, and not $\mathbb K$-triangularizable.

One might be tempted to conjecture that any $M\in \mathbb F^{n,n}$ that is $\mathbb K$-triangularizable and satisfies (\ref{c1}) is of Type~1 but this is so only for small dimensions and
is no longer true for large enough $n$, as we will demonstrate below.
Consider small dimensions  first.
\begin{proposition}\label{2x2}
Consider a differential field $\mathbb F$ of functions with field of constants
$\mathbb K$.
Let $M=[m_{i,j}]\in {\mathbb F}^{2,2}$ be upper triangular and satisfy $M\, M'=M'\, M$. Then
$M$ is of Type~\ref{1}.
\end{proposition}
\proof
Since $M\, M'=M'\, M$  we obtain
\[
 m_{1,2}(m_{1,1}'-m_{2,2}')-m_{1,2}'(m_{1,1}-m_{2,2})=0,
 \]
 %
which implies that  $m_{1,2}=0$ or $m_{1,1}-m_{2,2}=0$ or
 both are nonzero and ${ d \over dt}({m_{1,1}-m_{2,2}\over m_{1,2}})=0$, i.e.,
 $c m_{1,2}+ (m_{1,1}-m_{2,2})=0$ for some nonzero constant $c$.

If $m_{1,1}=m_{2,2}$ or $m_{1,2}=0$,  then $M$, being triangular, is obviously of Type~1.
Otherwise
\[
M=m_{1,1} I + m_{1,2}\mat{cc} 0 & 1 \\ 0 & c \rix.
\]
and hence again of Type~1 as claimed.
\eproof
Proposition~\ref{2x2} implies  that $2\times2$ $\mathbb K$-triangularizable matrices
satisfying (\ref{c1}) are of Type~1.

\begin{proposition}\label{2x2type}
Consider a differential field $\mathbb F$ with an algebraically closed field of constants $\mathbb K$.
Let $M=[m_{i,j}]\in {\mathbb F}^{2,2}$ satisfy $M\, M'=M'\, M$.
Then $M$ is of Type~1.
\end{proposition}
\proof If $M$ is $\mathbb F$-diagonalizable, then the result follows by Corollary~\ref{cor:diag_type1}. If $M$ is not $\mathbb F$-diagonalizable, then it is nonderogatory and the result follows by Corollary~\ref{cor:triangularize}.
\eproof

\begin{example}{\rm
In the $2\times2$ case, any Type~2 or Type~3 matrix is also of Type~1 but not every
Type~1 matrix is Type~3.

Let $M=\phi I_2 +f g^T$  with
\[\phi\in \mathbb F,\quad f=\mat{c} f_1 \\ f_2\rix ,\quad g=\mat{c} g_1 \\ g_2\rix\in {\mathbb F}^2\]
 be of Type~3, i.e.,
$f^Tg={f'}^Tg= f^T{g'}=0$.

If $f_2=0$, then $M$ is upper triangular and hence by Proposition~\ref{2x2}, $M$ is of Type~\ref{1}.
If $f_2\neq 0$, then with
\[
T=\mat{cc} 1 & -f_1/f_2 \\ 0 &  1 \rix.
\]
we have
\[
T MT^{-1}= \phi I_2 +\mat{cc} 0 & 0 \\ f_2 g_1 & 0 \rix=
\phi I_2 +f_2g_1\mat{cc} 0 & 0 \\ 1 & 0 \rix,
\]
since  $ f_1g_1+f_2 g_2=0$, and hence $M$ is  of Type~1.

However,  if we consider
\[
M=\phi I_2+ f\mat{cc} 0 & c \\ 0 & d\rix
\]
with $\phi,f$ nonzero functions and $c,d$ nonzero  constants,
then $M$ is Type~1 but not Type~3.
}
\end{example}
\begin{proposition}\label{3x3type}
Consider a differential field $\mathbb F$ of functions with field of constants
$\mathbb K$.
Let $M=[m_{i,j}]\in {\mathbb F}^{3,3}$ be $\mathbb K$-triangularizable and satisfy $M\, M'=M'\, M$. Then $M$ is of Type~\ref{1}.
\end{proposition}
\proof
Since $M$ is $\mathbb K$-triangularizable, we may assume that it is upper triangular already and consider different cases for the diagonal elements. If $M$ has three distinct diagonal elements, then it is $\mathbb K$-diagonalizable and the result follows by
Corollary~\ref{cor:diag_type1}.  If $M$ has exactly two distinct diagonal elements,
then it can be transformed to a direct sum of a $2\times 2$ and $1\times1$ matrix and hence the result follows by Proposition~\ref{2x2}. If all diagonal elements are equal, then, letting $E_{i,j}$ be the matrix that is zero except for the position $(i,j)$, where it is $1$, we have
$M=m_{1,1} I+ m_{1,3} E_{1,3}+ \widetilde M$, where $\widetilde M=m_{1,2} E_{1,2}+ m_{2,3} E_{2,3}$ also satisfies (\ref{c1}). Then it follows that $m_{1,2} m'_{2,3}= m'_{1,2} m_{2,3}$. If either
$m_{1,2}=0$ or $m_{2,3}=0$,  then we immediately have again Type~1, since $\widetilde M$ is a direct sum of a $2\times 2$ and a $1\times 1$ problem.
If both are nonzero, then $\widetilde M$ is nonderogatory and the result follows
by Theorem~\ref{th:nondero}. In fact, in this case $m_{1,2}=c m_{2,3}$ for some $c\in \mathbb K$ and therefore
\[
M=m_{1,1} I+ m_{1,3} E_{1,3}+ m_{2,3}\mat{ccc} 0 & c & 0 \\ 0 & 0 & 1 \\ 0 & 0 & 0 \rix,
\]
which is clearly of Type~\ref{1}.
\eproof

In the $4\times 4$ case, if the matrix is $\mathbb K$-triangularizable, then we either have at least two different eigenvalues, in which case we have reduced the problem again to the case of dimensions smaller than $4$, or there is only one eigenvalue,
and thus without loss of generality  $M$ is nilpotent. If $M$ is nonderogatory then we again have Type
$1$. If $M$ is derogatory then it is the direct sum of blocks of smaller dimension. If these dimensions are smaller than $3$, then we are again in the Type~1
case. So it remains to study the case of a block of size $3$ and a block of size $1$.
Since $M$ is nilpotent, the block of size $3$ is either Type~1 or Type~2. In both cases the complete matrix is also Type~1 or Type~2, respectively.

The following example shows that $\mathbb K$-triangularizability is not enough
to imply that the matrix is Type~1.
\begin{example}{\rm
Consider the $9\times 9$ block matrix
\[
\hat M=\mat{ccc} 0 & M_a & 0 \\ 0 & 0 & M_a \\ 0 & 0 & 0 \rix,
\]
where $M_a$ is the Type~2 matrix from Example~\ref{eva3x3}.
Then $\hat M$ is nilpotent upper  triangular and not of Type~1, 2, or 3, the latter two
facts due to its $\mathbb F$-rank being $2$.
}
\end{example}

 Already in the $5\times 5$
case, we can find examples that are none of the (proper) types.

\begin{example}{\rm
Consider $M=T^{-1} \diag(M_1,M_2) T$ with $T\in \mathbb K^{n,n}$,
$M_1\in \mathbb F^{3,3}$ of Type~2 (e.g., take $M_1=M_a$ as in Example~\ref{eva3x3})
and $M_2=\mat{cc} 0&1\\ 0& 0\rix$. Then clearly $M$ is
not of Type~1 and it is not of Type~2, since
it has an $\mathbb F$-rank larger than $1$. By definition it is not of Type~3 either.
Clearly examples of any size can be constructed by building direct sums
of smaller blocks.
}
\end{example}

Schur's letter states that for $n\geq 6$ there are other types. The following example demonstrates this.
\begin{example}{\rm Let $M_a$ be the Type~2 matrix in Example~\ref{eva3x3}
and form the block matrix
\[
A =\mat{cc} M_a & I \\ 0 & M_a\rix .
\]
 Direct computation shows $AA' = A'A$ but $A'A'' \not = A''A$.  Furthermore  $A^3 = 0$ and $A$ has $\mathbb F$-rank $3$. Thus $A$ is neither Type~1, Type~2  nor Type 3 (the last case need not be considered, since $A$ is nilpotent). We also note that $\rank(A'') = 6$. We now assume that $\mathbb K$ is algebraically closed  and we show that $A$ is not $\mathbb K$-similar to the direct sum of Type~1 or Type~2 matrices.

 To obtain a contradiction we assume that (after a $\mathbb K$-similarity)
$A = \diag(A_1,A_2)$ where $A_1$ is the direct sum of
Type~1 matrices (and hence Type~1) and $A_2$ is the direct sum of Type~2 matrices that are not Type~1. Since $A$ is not Type~1, $A_2$ cannot be the empty matrix. Since the minimum size of a Type~2 matrix that is not Type~1  is $3$ and its rank is $1$ it follows that  $A$ cannot be the sum of Type~2 matrices that are not Type~1. Hence the size of $A_1$ must be larger or equal to $1$ and, since $A_1$ is nilpotent, it follows that $\rank(A_1) < \size(A_1)$. Since
$A_1$ is $\mathbb K$-similar  to a strictly triangular matrix, it follows that
$\rank(A_1'')  < \size(A_1)$. Hence $\rank(A'') = \rank(A_1'') + \rank(A_2'') < 6$, a contradiction.
}
\end{example}

\begin{example}{\rm
If the matrix $M=\sum_{i=0}^r C_i t^i\in \mathbb F^{n,n}$ is a polynomial with coefficients $C_i\in \mathbb K^{n,n}$, then from (\ref{c1}) we obtain a specific set of conditions on
sums of commutators that have to be satisfied. For this we just compare coefficients
of powers of $t$ and  obtain a set of quadratic equations in the $C_i$, which has a
clear pattern. For example, in the case $r=2$, we obtain the three conditions $C_0C_1-C_1C_0=0$, $C_0C_2-C_2C_0=0$ and $C_1C_2-C_2C_1=0$, which shows that $M$ is of Type~1.
For $r=3$ we obtain the first nontrivial condition $3(C_0C_3-C_3C_0)+(C_1C_2-C_2C_1)=0$.

We have implemented
a Matlab routine for Newton's method to solve the set of quadratic matrix equations in the case $r=3$  and ran it for many different random starting coefficients
$C_i$ of different dimensions $n$. Whenever Newton's method converged (which it did in most of the
cases) it converged to a matrix of Type~1. Even in the neighborhood of a Type~2 matrix it converged to a Type~1 matrix. This suggests that the matrices of Type~1 are generic in the set of matrices satisfying~(\ref{c1}). A copy of the Matlab routine is available from the authors upon request.
}
\end{example}

\section{Conclusion}\label{conclusion}

We have presented a letter of Schur's that contains a major contribution
to the question when a matrix with elements that are functions in one variable
commutes with its derivative. Schur's letter precedes many partial results
on this question, which is still partially open. We have put Schur's result in perspective with later results and extended it in an algebraic context to matrices over a differential field. In particular, we have presented several results that characterize
Schur's matrices of Type~1. We have given examples of matrices that commute with their derivative which are of none of the Types~1,~2 or~3.We have shown that matrices of Type~1 may be triangularized over the constant field (which implies that their eigenvalues lie in the differential field) but we are left with an open problem already mentioned in Section \ref{sec:discussion}.
\begin{openproblem} {\rm Let $M$ be a matrix in a differential field $\mathbb F$, with an algebraically closed
field of constants, that satisfies $MM' = M'M$. Must the eigenvalues of $M$ be elements of the field $\mathbb F$?}
\end{openproblem}
For example, if $M$ is a polynomial matrix over the complex numbers must the eigenvalues be rational functions?
We have found no counterexample.

\section*{Acknowledgements}
We thank Carl de Boor for helpful comments on a previous draft of the paper and Olivier Lader for his careful reading of the paper and for his suggestions. We also thank an anonymous referee for pointing out the observation in Remark~\ref{refrem}.

\bibliographystyle{plain}

Rings and Algebras (math.RA); History and Overview (math.HO)


A Gallery of Gaussian Periods

Abstract: Gaussian periods are certain sums of roots of unity whose study dates back to Gauss's seminal work in algebra and number theory. Recently, large scale plots of Gaussian periods have been revealed to exhibit striking visual patterns, some of which have been explored in the second named author's prior work. In 2020, the first named author produced a new app, \texttt{Gaussian periods}, which allows anyone to create these plots much more efficiently and at a larger scale than before. In this paper, we introduce Gaussian periods, present illustrations created with the new app, and summarize how mathematics controls some visual features, including colorings left unexplained in earlier work.

\section*{Introduction}

Gaussian periods, certain sums of roots of unity introduced by Gauss, have played a key role in several mathematical developments.  For example, Gauss employed them in his work on constructibility of regular polygons by unmarked straightedge and compass, as well as in number theory.  In the past few years, realizations of their role in the supercharacter theory of Diaconis and Isaacs have led in new directions \cite{SESUP}.

The fast computations afforded by modern technology provide new insights into Gaussian periods by enabling us to study them at a scale that was until recently unfathomable.  In particular, large-scale plots of Gaussian periods display striking visual properties that were previously unknown (see, e.g., Figure \ref{Figure:BeautifulGallery}).
The goals of this paper lie in the intersection of the mathematical and artistic aspects of Gaussian periods:
\begin{itemize}[leftmargin=*]
\item{Introduce Gaussian periods, together with new illustrations representing some of their visual features.}
\item{Introduce a new app, created in 2020, that quickly produces illustrations of Gaussian periods and is appropriate as a tool for art, exploratory mathematical research, illustration at scale, and pedagogy.}
\item{Summarize how mathematics controls some features, including colorings unexplained in earlier work.}\label{item:coloringsadhoc}
\end{itemize}

\begin{figure}[h!tbp]
\centering
\begin{minipage}[b]{0.475\textwidth}
	\includegraphics[width=\textwidth]{GP-N3x7x251x281-omega54184Layers}
        	\subcaption{$n=1481151 $, $\omega = 54184$, $c=21$}
\end{minipage}
\hfill
\begin{minipage}[b]{0.475\textwidth}
		\includegraphics[width=\textwidth]{GP-N3x5x7x11x13x17-omega254r5c7x13.png}
        	\subcaption{$n=255255$, $\omega = 254$,  $c=7$}
        	\label{Figure:Rotate:b}
\end{minipage}
\caption{Examples of $\G(n, \omega)$ for different choices of input.}
\label{Figure:BeautifulGallery}
\end{figure}

Before proceeding, we clarify what we mean by the term {\em Gaussian period}.  Given a positive integer $n$, an integer $\omega$ coprime to $n$, and an integer $k$, we set
\begin{align*}
\eta_{n, \omega, k}:=\sum_{j=0}^{d-1}e^{\frac{2\pi i\omega^j k}{n}},
\end{align*}
where $d$ is the multiplicative order of $\omega$ mod $n$; that is, $d$ is the smallest positive integer such that $\omega^d\equiv 1\pmod{n}$.  When $k$ is relatively prime to $n$, we say that $\eta_{n, \omega, k}$ is a {\em Gaussian period of modulus $n$ and generator $\omega$}.
In this paper, by a slight abuse of notation that coincides with the conventions employed in \cite{GHM,GNGP, Lutz}, we still call $\eta_{n, \omega, k}$ a {\em Gaussian period of modulus $n$ and generator $\omega$} even when $k$ is not coprime to $n$.  As we explain later in this paper, $\eta_{n, \omega, k}$ is a positive integer multiple of the Gaussian period $\eta_{\frac{n}{\gcd(n, k)}, \omega, k}$, which allows us to preserve certain key structures of interest.

\section*{Creating and viewing plots of Gaussian periods}
Each of the images in this paper is a plot in the complex plane of
\begin{align*}
\mathsf{G}(n, \omega) := \left\{\eta_{n, \omega, k} : k = 1, 2, \ldots, n\right\}\subset\mathbb{C}.
\end{align*}
Mathematical principles guarantee that $\mathsf{G}(n, \omega)$ exhibits certain basic symmetries.  For large values of $n$ (which we refer to as {\em large scale}), however, plots of $\mathsf{G}(n, \omega)$ also exhibit striking patterns and intricacies whose aesthetic properties can be appreciated even by those without mathematical training.

That large-scale plots of Gaussian periods exhibit such variety and intricate patterns was a surprise.  This was discovered by B.\ Lutz,
an undergraduate, in the course of his senior thesis.  In his explorations, he also introduced a coloring scheme, which is employed in the plots in this paper and discussed in the next section.

A new app, \texttt{Gaussian Periods} (written in Swift for Apple computers and freely available \cite{app}) was produced in 2020 by the first named author, with assistance from R.\ Lipshitz.  This app:
\begin{itemize}[leftmargin=*]
\item{plots Gaussian periods faster than previous code (including the aforementioned \texttt{Mathematica} code), taking seconds to produce images that used to take hours;}
\item{allows larger scale plots than previously possible (e.g., Figure \ref{Figure:Fills:c}, which contains over 9 million points), which can be useful for exploring or illustrating asymptotic behavior;}
\item{does not require programming experience or mathematical expertise;}
\item{allows one to quickly modify values of $n$ and $\omega$, as well as a coloring parameter $c$; and}
\item{includes an option to save layers suitable for further steps, e.g., manipulation in \texttt{Adobe Photoshop} to customize color choices (as was done to produce the images in this paper).}
\end{itemize}
As a result, the app is suitable for projects ranging from art to exploratory mathematical investigations to illustration.  We also used it to produce all the images in this paper.  To improve the image quality in this paper, we layered the different color components (plotting all the points corresponding to a color at the same time), which is assisted by the layers option in the app.

  While notions of ``beauty'' and ``aesthetic appeal'' are subjective, symmetry has often appeared in discussions of beauty in both art and math, dating back to the ancient Babylonians.   In a historical context, given the algebraic origins of Gaussian periods, it is fitting to note that symmetry originally became a prominent concept in mathematics not through geometry, but through algebra \cite[Preface]{stewart}.  Gaussian periods, together with the various symmetries they exhibit, can also be considered of independent artistic merit and be appreciated in their own right (even by those with no mathematical training).  More broadly, patterns in plots of certain other families of algebraic numbers have also been recognized for their beauty \cite{baez}.
  For those who wish to delve further into philosophical considerations of the artistic merits of Gaussian periods, a brief survey of visual aesthetics in similar mathematical contexts can be found in \cite[pp.~121-4]{Brown}.

  \section*{Using color to reveal structures}
Whether focusing on art or math, a coloring scheme can be used to highlight some structures in $\mathsf{G}(n, \omega)$ for a given $n$ and $\omega$.  Following \cite[\S 3]{GHM},
fix a positive integer $c \mid n$ and, for $j=1,2, \ldots, c$, assign the same color to all points in the set
$\{\eta_{n, \omega, k} : k\equiv j\pmod{c}\}$.
Two points $\eta_{n, \omega, k}$ and $\eta_{n, \omega, \ell}$ might have the same color even if $k\nequiv \ell\pmod{c}$, since $\eta_{n, \omega, k} = \eta_{n, \omega, k\omega^j}$ for all integers $j$.

Since this is the coloring scheme employed in each of the images here (and is implemented in \texttt{Gaussian Periods}), we begin with small-scale examples to help readers grasp the subtleties of this coloring scheme.

\begin{Example}\label{example:small:a}
Suppose $n = 27$, $\omega = 2$, and $c = 9$.  There are three orbits of $\langle\omega\rangle$ acting on $\Z/27\Z$: $\mathcal{O}_1:=\Z/27\Z^\times$, $\mathcal{O}_0:=\left\{0\right\}$, and $\mathcal{O}_{18}:=\{[a]\in\Z/27\Z :  27>\gcd(a, 27) >1\}$, and $G(27, 2)$ consists of the three points $\eta_{27, 2, 1},$ $\eta_{27, 2, 0}$, and $\eta_{27, 2, 18}$.  So by our rules for coloring, since $c=9$ and $18\equiv 0\pmod{9}$, we must assign the same colors to $\eta_{27, 2, 0}$ and $\eta_{27, 2, 9}$.  Since elements in $(\Z/27\Z)^\times$ are not congruent modulo $9$ to elements divisible by $3$, there are no restrictions on the color of $\eta_{27, 2, 1}$.  As seen in Figure \ref{Figure:Small:a}, for this input, our recipe produces a plot with $3$ points and just $2$ colors, even though $c= 9$.
\end{Example}

\begin{figure}[h!tbp]
\centering
\begin{minipage}[b]{0.3\textwidth}
	\boxed{\includegraphics[width=\textwidth]{GPN27omega2c9r88}}
        	\subcaption{$n=27$, $\omega = 2$, $c=9$}
        	\label{Figure:Small:a}
\end{minipage}
\hfill
\begin{minipage}[b]{0.3\textwidth}
	\boxed{\includegraphics[width=\textwidth]{GPN12omega5c3r88}}
        	\subcaption{$n=12$, $\omega = 5$, $c=3$}
        	\label{Figure:Small:b1}
\end{minipage}
\hfill
\begin{minipage}[b]{0.3\textwidth}
	\boxed{\includegraphics[width=\textwidth]{GPN12omega5c4r88}}
        	\subcaption{$n=12$, $\omega = 5$, $c=4$}
        	\label{Figure:Small:b2}
\end{minipage}
\caption{Small scale illustrations for Examples \ref{example:small:a} and \ref{example:small:b}.}
\label{Figure:Small}
\end{figure}

This approach to coloring was chosen not as a way to illustrate a particular mathematical principle but rather as a recipe Lutz discovered that produced visually appealing pictures.  In fact, in the final paragraph of \cite{GHM}, he and his coauthors note that this approach to coloring is \emph{ad hoc} and that ``a general theory is necessary to formalize our intuition.''

\section*{Algebraic structures}

Through the lens of Galois theory  (which was never considered in prior work on illustrating $\mathsf{G}(n,\omega)$), the above coloring scheme can be linked to mathematical structure.  The main theorem of Galois theory gives a bijection between the subfields of $\Q\left(\zeta_n\right)$, with $\zeta_n$ a primitive $n$th of unity, and the subgroups of the Galois group $G:=\mathrm{Gal}\left(\Q\left(\zeta_n\right)/\Q\right)=\operatorname{Aut}\left(\Q\left(\zeta_n\right)\right)$, which is identified with $\left(\Z/n\Z\right)^\times$ via
\begin{align*}
\left(\Z/n\Z\right)^\times&\overset{\sim}{\rightarrow} G\\
[m]&\mapsto \psi_m\\
\psi_m\Big(\sum_j a_j \zeta_n^j\Big) &:= \sum_j a_j\left(\zeta_n^m\right)^j, \hspace{0.5in} a_j\in\Q.
\end{align*}
Each subgroup $H\subseteq G$ corresponds to the fixed field $\Q\left(\zeta_n\right)^H:=\left\{z\in  \Q\left(\zeta_n\right) : \psi(z) = z \mbox{ for all } \psi\in H\right\}$.  Then $H$ is the Galois group of $\Q\left(\zeta_n\right)$ over $\mathbb{Q}\left(\zeta_n\right)^H$, i.e., the group of field automorphisms of $\Q\left(\zeta_n\right)$ fixing $\Q\left(\zeta_n\right)^H$, and $G/H$ is the Galois group of $\Q\left(\zeta_n\right)^H$ over $\Q$, i.e., the group of field automorphisms of $\Q\left(\zeta_n\right)^H$.

To help identify elements of the subfields of $\Q\left(\zeta_n\right)$, students in Galois theory courses are sometimes assigned to determine Gaussian periods (e.g., see \cite[\S 14.5]{DF}).  Indeed,  if $H=\langle\omega\rangle$, then
\begin{equation*}
 \eta_{n, \omega, k}=\sum_{\psi\in H}{\left(\psi\left(\zeta_n\right)^k\right) }= \sum_{\psi\in H}\psi\big(\zeta_n^k\big)\in \Q\left(\zeta_n\right)^H,
\end{equation*}
So
the plot of $\mathsf{G}(n, \omega)$ contains a (rescaled) plot of $\mathsf{G}(\frac{n}{\gcd(n, k)}, \omega)$.
If $c$ is the coloring number, then the plot of $\mathsf{G}(n, \omega)$ contains a single-colored plot of $\mathsf{G}(\frac{n}{c}, \omega)$, rescaled by a factor of $\frac{\mathrm{ord}_n(\omega)}{\mathrm{ord}_{n/c}(\omega)}$, with $\mathrm{ord}_m(\omega)$ denoting the multiplicative order of $\omega \pmod{m}$.   For clarification, we illustrate this in a simple example.

\begin{Example}\label{example:small:b}
Let $n= 12$ and $\omega = 5$.  Note that $5$ has multiplicative order $2$ mod $12$ and $1$ mod $4$.  So $\eta_{12, 5, 3k} = 2\eta_{4, 5, k} = 2 e^{\frac{2\pi ik}{4}}$ for all $k$.  So $G(4, 5)=\{1, -1, i, -i\}$, and $G(12, 5)\supseteq 2\cdot G(4, 5) = \{2, -2, 2i, -2i\}$.  If we choose $c = 3$, then the points in $2\cdot G(4, 5)$ all must be the same color as each other (the red, outer diamond in Figure \ref{Figure:Small:b1}), while the other points need not be colored that color (the blue, inner diamond).  On the other hand, selecting $c= 4$ forces the pair of points in $G(3, 5)\subset G(12, 5)$ to be the same color (shown in Figure \ref{Figure:Small:b2} in red).  As illustrated in Figure \ref{Figure:Small:b2}, the pair gets rotated by $2\pi/4 = 2\pi\omega/4$, with a new color allowed at each rotation.
\end{Example}

Regarding the current coloring scheme, if two elements of $\Z/n\Z^\times\cong\mathrm{Gal}(\Q(\zeta_n)/\Q)$ are congruent $\mod c$, then the corresponding elements of the Galois group restrict to the same element of $\mathrm{Gal}(\Q(\zeta_c)/\Q)$.  So, for example, given an element $\psi\in \mathrm{Gal}(\Q(\zeta_c)/\Q)$ and an integer $a$, all points $\Psi(\eta_{n, \omega, a})$, as $\Psi$ ranges over the extensions of $\psi$ to $\Q(\zeta_n),$ are colored the same.  There are also other natural coloring schemes.  For example, an option (called ``period squared'') in \texttt{Gaussian Periods} is to color $\eta_{n, \omega, k}$ and $\eta_{n, \omega, -k}$ the same, thus creating symmetry across the real axis.  This corresponds to coloring the points in the Galois orbit of the complex conjugation automorphism the same.  More generally, one might color all points in some other given Galois orbits the same.  Furthermore, our reformulation in terms of elements of fixed fields should naturally generalize beyond Gaussian periods to the illustration of symmetries in other settings beyond the scope of this short paper (such as finite nonabelian extensions of $\Q$).

\section*{Asymptotic behavior}
Symmetry is the most obvious feature in typical Gaussian-period plots.
We say that $\G(n, \omega)$ has \emph{$k$-fold dihedral symmetry}
if $\G(n, \omega)$ is invariant under the action of the dihedral group of order $2k$.
That is, $\G(n, \omega)$ is invariant under complex conjugation and rotation by $2\pi/k$ about the origin.
It turns out that $\G(n, \omega)$ has at least $\gcd(\omega-1,n)$-fold dihedral symmetry \cite[Prop.~3.1]{GNGP}.
This symmetry refers to the uncolored graph; the colors highlight additional features beyond the initial symmetry.
This is illustrated in Figure \ref{Figure:Rotate}.

\begin{figure}[h!tbp]
\centering
\begin{minipage}[b]{0.32\textwidth}
	\includegraphics[width=\textwidth]{GP-N2x3x5x17x3x19-omega169x169x169Layers}
        	\subcaption{$n=29070$, $\omega = 1189$, $\gcd(1188, 29070)=18$, $c=3$}
        	\label{Figure:Rotate:a}
\end{minipage}
~
\begin{minipage}[b]{0.32\textwidth}
	\includegraphics[width=\textwidth]{GP-N70091-omega21792c7r4FIGH}
        	\subcaption{$n=70091$, $\omega = 21792$, $\gcd(21791,70091)=7$, $c=7$}
        	\label{Figure:Rotate:c}
\end{minipage}
~
\begin{minipage}[b]{0.32\textwidth}
	\includegraphics[width=\textwidth]{GP-N3x5x7x11x13x17-omega254Layers}
        	\subcaption{$n=255255$, $\omega = 254$, $\gcd(255255,253)=11$, $c=7$}
\end{minipage}
\caption{Dihedral symmetry of $\G(n, \omega)$.}
\label{Figure:Rotate}
\end{figure}

Gaussian period plots often demonstrate great structural coherence if the parameters
$n$ and $\omega$ vary in the appropriate manner.  The following ``filling out'' of various shapes
was discovered in \cite[Thm.~6.3]{GNGP}. See the thorough exposition in \cite[Thm.~1]{GHM}.
Let $q=p^a$ be a nonzero power of an odd prime and let $\omega = \omega(q)$ be such that
$d= |\langle \omega \rangle|$ divides $p-1$.
Then $\mathsf{G}(q,\omega)$ is contained in the image of the Laurent polynomial function $g:\mathbb{T}^{\phi(d)}\to\mathbb{C}$ defined by
\begin{equation*}
	g(z_1,z_2,\ldots,z_{\phi(d)}) = \sum_{k=0}^{d-1} \prod_{j=0}^{\phi(d)-1} z_{j+1}^{b_{k,j}},
\end{equation*}
where the integers $b_{k,j}$ are determined by
	$t^k\equiv \sum_{j=0}^{\phi(d)-1} b_{k,j} t^j \pmod{\Phi_d(t)}.$
Here $\mathbb{T}$ denotes the unit circle in $\mathbb{C}$, $\phi$ is the Euler totient function, and $\Phi_d$ denotes the $d$th cyclotomic polynomial.
For a fixed $d$, as $q$ becomes large, $\mathsf{G}(q,\omega)$ ``fills out'' the image of $g$; see Figure \ref{Figure:Fills}.

\begin{figure}[h!tbp]
\centering
\begin{minipage}[b]{0.32\textwidth}
	\includegraphics[width=\textwidth]{GP-N3019-omega239r6c1}
        	\subcaption{$n=3019$, $\omega = 239$}
\end{minipage}
~
\begin{minipage}[b]{0.32\textwidth}
	\includegraphics[width=\textwidth]{GP-N13063-omega1347r6c1}
        	\subcaption{$n=13063$, $\omega = 1347$}
\end{minipage}
~
\begin{minipage}[b]{0.32\textwidth}
	\includegraphics[width=\textwidth]{GP-N9114361-omega3082638r1c1}
        	\subcaption{$n=9114361$, $\omega = 3082638$}
	\label{Figure:Fills:c}
\end{minipage}
\caption{Sometimes $\mathsf{G}(n,\omega)$ appears to ``fill out'' the image of a Laurent
polynomial $g:\mathbb{T}^{\phi(d)}\to\mathbb{C}$.  Here $g(z_1, z_2) = z_1 + z_1 + 1/(z_1 z_2)$.}
\label{Figure:Fills}
\end{figure}

\begin{comment}
\begin{figure}[h!tbp]
\centering
\begin{minipage}[b]{0.32\textwidth}
	\includegraphics[width=\textwidth]{GP-N3019-omega239r6c1}
        	\subcaption{$n=3019$, $\omega = 239$}
\end{minipage}
~
\begin{minipage}[b]{0.32\textwidth}
	\includegraphics[width=\textwidth]{GP-N13063-omega1347r6c1}
        	\subcaption{$n=13063$, $\omega = 1347$}
\end{minipage}
~
\begin{minipage}[b]{0.32\textwidth}
	\includegraphics[width=\textwidth]{GP-N9114361-omega3082638r1c1}
        	\subcaption{$n=9114361$, $\omega = 3082638$}
	\label{Figure:Fills:c}
\end{minipage}
\caption{Sometimes $\mathsf{G}(n,\omega)$ appears to ``fill out'' the image of a Laurent
polynomial $g:\mathbb{T}^{\phi(d)}\to\mathbb{C}$.}
\label{Figure:Fills}
\end{figure}
\end{comment}

With ellipses, hypocycloids, and so forth as primitive graphical elements, one can use the Chinese remainder
theorem to produce new images of startling complexity (as explained in \cite{Lutz}).  We content ourselves here
with a few aesthetically pleasing images produced in such a manner; see Figure \ref{Figure:Finale}.
We encourage the reader to enjoy more examples by experimenting with our app \texttt{Gaussian Periods} (freely available at \url{http://www.elleneischen.com/gaussianperiods.html}).

\begin{figure}[h!tbp]
\centering
\begin{minipage}[b]{0.32\textwidth}
	\includegraphics[width=\textwidth]{GP-N11x43x79-omega608Layers}
        	\subcaption{$n=37367$, $\omega = 608$, $c=11$}
        	\label{Figure:Finale:a}
\end{minipage}
~
\begin{minipage}[b]{0.32\textwidth}
	\includegraphics[width=\textwidth]{GP-N3x37x67x5x5-omega766Layers}
        	\subcaption{$n=185925$, $\omega = 766$, $c=25$}
        	\label{Figure:Finale:b}
\end{minipage}
~
\begin{minipage}[b]{0.32\textwidth}
	\includegraphics[width=\textwidth]{GP-N82677-omega8147Layeredpng}
        	\subcaption{$n=82677$, $\omega = 8147$, $c=21$}
        	\label{Figure:Finale:c}
\end{minipage}
\caption{Primitive graphical elements
(here, a ``filled'' deltoid) can form more elaborate plots.}
\label{Figure:Finale}
\end{figure}

\section*{Acknowledgments}
Ellen Eischen was partially funded by NSF grant DMS-1751281.  Stephan Ramon Garcia was partially funded by NSF grant DMS-1800123.  This material is based partly upon work supported by the NSF grant  DMS-1439786 and the Alfred P.~Sloan Foundation award G-2019-11406 while the authors were in residence at the Institute for Computational and Experimental Research in Mathematics (ICERM) in Providence, RI, during the Illustrating Mathematics program (Fall 2019).  We thank R.\ Lipshitz for help with the code.

\footnotesize
{\setlength{\baselineskip}{13pt}
\raggedright

A Gallery of Gaussian Periods


Abstract: We study three types of generalized partial fractional operators. An extension of Green's theorem, by considering partial fractional derivatives with more general kernels, is proved. New results are obtained, even in the particular case when the generalized operators are reduced to the standard partial fractional derivatives and fractional integrals in the sense of Riemann-Liouville or Caputo.

\section{Introduction}

In 1828, the English mathematician George Green (1793-1841),
who up to his forties was working as a baker and a miller,
published an essay where he introduced a formula connecting
the line integral around a simple closed curve with a double integral.
Within years, this result turned out to be useful in many fields
of mathematics, physics and engineering \cite{Colton,Emch,Russenschuck,Sherman}.
Generalizations of Green's theorem have chosen different directions,
and are known as the Kelvin--Stokes and the Gauss--Ostrogradsky theorems.

In this paper, in contrast with previous works,
we want to state a Green's theorem for generalized
partial fractional derivatives. Notions of generalized fractional
derivatives were introduced in \cite{OmPrakashAgrawal,book:Kiryakova},
and then developed in \cite{FVC_Gen,MyID:227}.
A fractional version of the Green theorem
has been already showed for Riemann--Liouville integrals
and Caputo derivatives \cite{tarasov}, and for fractional operators
in the sense of Jumarie \cite{MyID:182}. However, generalized fractional
operators have never been considered. Our result may be useful
in the theory of fractional calculus (see, e.g.,
\cite{book:Kilbas,book:Klimek,book:Podlubny,book:Samko}),
in particular for the two-dimensional fractional calculus of variations,
where the derivation of Euler--Lagrange equations uses,
as a key step in the proof,
Green's theorem \cite{MyID:182,Cresson,book:frac,tatiana}.

The paper is organized as follows. In Section~\ref{sec:prelim} a common review
of ordinary and partial generalized fractional calculus is given. Our results
are then formulated and proved in Section~\ref{sec:MR}: we show the two-dimensional
integration by parts formula for generalized Riemann--Liouville partial
fractional integrals (Theorem~\ref{theorem:GRI})
and Green's theorem for generalized
partial fractional derivatives (Theorem~\ref{thm:ggt}).

\section{Basic Notions}
\label{sec:prelim}

In this section we give definitions of generalized ordinary
and partial fractional operators. By the choice of a certain
kernel, these operators can be reduced to the standard fractional
integrals and derivatives. For more on the subject, we refer the
reader to \cite{OmPrakashAgrawal,MR2974327,book:Kiryakova,FVC_Gen,MyID:227}.

\subsection{Generalized fractional operators}

\begin{definition}[Generalized fractional integral]
\label{def:GI}
The operator $K_P^\alpha$ is given by
\begin{equation*}
\left(K_P^{\alpha}f\right)(t)
:=p\int\limits_{a}^{t}k_{\alpha}(t,\tau)f(\tau)d\tau
+q\int\limits_{t}^{b}k_{\alpha}(\tau,t)f(\tau)d\tau,
\end{equation*}
where $P=\langle a,t,b,p,q\rangle$ is the \emph{parameter set}
($p$-set for brevity), $t\in[a,b]$, $p,q$ are real numbers,
and $k_{\alpha}(t,\tau)$ is a kernel which may depend on $\alpha$.
The operator $K_P^\alpha$ is referred as the \emph{operator $K$}
($K$-op for simplicity) of order $\alpha$ and $p$-set $P$.
\end{definition}

\begin{theorem}[Theorem 2.3 of \cite{FVC_Gen}]
\label{theorem:L1}
Let $k_\alpha$ be a difference kernel, i.e.,
$k_\alpha(t,\tau)=k_\alpha(t-\tau)$ and
$k_\alpha\in L_1\left([a,b]\right)$. Then,
$K_P^{\alpha}:L_1\left([a,b]\right)\rightarrow
L_1\left([a,b]\right)$ is well defined,
bounded and linear operator.
\end{theorem}

The $K$-op reduces to the classical left or right Riemann--Liouville
fractional integral (see, \textrm{e.g.}, \cite{book:Kilbas,book:Podlubny})
for a suitably chosen kernel $k_{\alpha}(t,\tau)$ and $p$-set $P$. Indeed,
let $k_{\alpha}(t-\tau)=\frac{1}{\Gamma(\alpha)}(t-\tau)^{\alpha-1}$.
If $P=\langle a,t,b,1,0\rangle$, then
\begin{equation*}
\left(K_{P}^{\alpha}f\right)(t)=\frac{1}{\Gamma(\alpha)}
\int\limits_a^t(t-\tau)^{\alpha-1}f(\tau)d\tau
=: \left({_{a}}\textsl{I}^{\alpha}_{t} f\right)(t)
\end{equation*}
is the left Riemann--Liouville fractional integral
of order $\alpha$; if $P=\langle a,t,b,0,1\rangle$, then
\begin{equation*}
\left(K_{P}^{\alpha}f\right)(t)=\frac{1}{\Gamma(\alpha)}
\int\limits_t^b(\tau-t)^{\alpha-1}f(\tau)d\tau
=: \left({_{t}}\textsl{I}^{\alpha}_{b} f\right)(t)
\end{equation*}
is the right Riemann--Liouville fractional integral
of order $\alpha$.

\begin{definition}[Generalized Riemann--Liouville derivative]
\label{def:GRL}
Let $P$ be a given parameter set. The operator $A_P^\alpha$,
$0 < \alpha < 1$, is defined for functions $f$ such that
$K_P^{1-\alpha} f\in AC\left([a,b]\right)$ by
$A_P^\alpha := \frac{d}{dt} \circ K_P^{1-\alpha}$,
where $D$ denotes the standard derivative.
We refer to $A_P^\alpha$ as \emph{operator $A$} ($A$-op)
of order $\alpha$ and $p$-set $P$.
\end{definition}

\begin{definition}[Generalized Caputo derivative]
\label{def:GC}
Let $P$ be a given parameter set. The operator $B_P^\alpha$,
$\alpha \in (0,1)$, is defined for functions $f$
such that $f\in AC\left([a,b]\right)$ by
$B_P^\alpha :=K_P^{1-\alpha} \circ \frac{d}{dt}$
and is referred as the \emph{operator $B$} ($B$-op)
of order $\alpha$ and $p$-set $P$.
\end{definition}

Let $k_{1-\alpha}(t-\tau)=\frac{1}{\Gamma(1-\alpha)}(t-\tau)^{-\alpha}$,
$\alpha \in (0,1)$. If $P=\langle a,t,b,1,0\rangle$, then
\begin{equation*}
\left(A_{P}^\alpha f\right)(t) = \frac{1}{\Gamma(1-\alpha)}
\frac{d}{dt} \int\limits_a^t(t-\tau)^{-\alpha}f(\tau)d\tau
=: \left({_{a}}\textsl{D}^{\alpha}_{t} f\right)(t)
\end{equation*}
is the standard left Riemann--Liouville fractional derivative
of order $\alpha$ while
\begin{equation*}
\left(B_{P}^\alpha f\right)(t)
=\frac{1}{\Gamma(1-\alpha)}
\int\limits_a^t(t-\tau)^{-\alpha} f'(\tau)d\tau
=: \left({^{C}_{a}}\textsl{D}^{\alpha}_{t} f\right)(t)
\end{equation*}
is the standard left Caputo fractional derivative of order $\alpha$;
if $P=\langle a,t,b,0,1\rangle$, then
\begin{equation*}
- \left(A_{P}^\alpha f\right)(t)
= - \frac{1}{\Gamma(1-\alpha)} \frac{d}{dt}
\int\limits_t^b(\tau-t)^{-\alpha}f(\tau)d\tau
=: \left({_{t}}\textsl{D}^{\alpha}_{b} f\right)(t)
\end{equation*}
is the standard right Riemann--Liouville
fractional derivative of order $\alpha$ while
\begin{equation*}
- \left(B_{P}^\alpha f\right)(t)
= - \frac{1}{\Gamma(1-\alpha)}
\int\limits_t^b(\tau-t)^{-\alpha} f'(\tau)d\tau
=: \left({^{C}_{t}}\textsl{D}^{\alpha}_{b} f\right)(t)
\end{equation*}
is the standard right Caputo fractional derivative of order $\alpha$.

\subsection{Generalized partial fractional operators}

Let $\alpha$ be a real number from the interval $(0,1)$,
$\Delta_n=[a_1,b_1]\times\dots\times [a_n,b_n]$, $n\in\mathbb{N}$,
be a subset of $\mathbb{R}^n$, $\textbf{t}=(t_1,\dots, t_n)$
be a point in $\Delta_n$ and $\mathbf{p}=(p_1,\dots,p_n)$,
$\mathbf{q}=(q_1,\dots,q_n)\in\mathbb{R}^n$. Generalized partial fractional
integrals and derivatives are a natural generalization
of the corresponding one-dimensional generalized fractional
integrals and derivatives.

\begin{definition}[Generalized partial fractional integral]
\label{def:GPI}
Let function $f=f(t_1,\dots,t_n)$ be continuous
on the set $\Delta_n$. The generalized partial
Riemann--Liouville fractional integral of order $\alpha$
with respect to the $i$th variable $t_i$ is given by
\begin{multline*}
\left(K_{P_{t_i}}^{\alpha}f\right)(\textbf{t})
:=p_i\int\limits_{a_i}^{t_i}k_{\alpha}(t_i,\tau)
f(t_1,\dots,t_{i-1},\tau,t_{i+1},\dots,t_n)d\tau \\
+q_i\int\limits_{t_i}^{b_i}k_{\alpha}(\tau,t_i)
f(t_1,\dots,t_{i-1},\tau,t_{i+1},\dots,t_n)d\tau,
\end{multline*}
where $P_{t_i}=\langle a_i,t_i,b_i,p_i,q_i \rangle$.
We refer to $K_{P_{t_i}}^{\alpha}$ as the
\emph{partial operator $K$} (partial $K$-op)
of order $\alpha$ and $p$-set $P_{t_i}$.
\end{definition}

\begin{definition}[Generalized partial Riemann--Liouville derivatives]
\label{def:GPRL}
Let $P_{t_i}=\langle a_i,t_i,b_i,p_i,q_i \rangle$
and $K_{P_{t_i}}^{1-\alpha}f\in C^1(\Delta_n)$.
The generalized partial Riemann--Liouville fractional
derivative of order $\alpha$ with respect
to the $i$th variable $t_i$ is given by
\begin{equation*}
\begin{split}
\bigl(A_{P_{t_i}}^{\alpha}f\bigr)(\textbf{t})
&:=\left(\frac{\partial}{\partial t_i}\circ K_{P_{t_i}}^{1-\alpha}f\right)(\textbf{t})\\
&=\frac{\partial}{\partial t_i}\left(p_i\int\limits_{a_i}^{t_i}
k_{1-\alpha}(t_i,\tau)f(t_1,\dots,t_{i-1},\tau,t_{i+1},\dots,t_n)d\tau \right.\\
&\qquad \qquad \left.+q_i\int\limits_{t_i}^{b_i}k_{1-\alpha}(\tau,t_i)
f(t_1,\dots,t_{i-1},\tau,t_{i+1},\dots,t_n)d\tau\right).
\end{split}
\end{equation*}
The operator $A_{P_{t_i}}^{\alpha}$ is referred as the
\emph{partial operator $A$} (partial $A$-op)
of order $\alpha$ and $p$-set $P_{t_i}$.
\end{definition}

\begin{definition}[Generalized partial Caputo derivative]
\label{def:GPC}
Let $P_{t_i}=\langle a_i,t_i,b_i,p_i,q_i \rangle$
and $f\in C^1(\Delta_n)$. The generalized partial Caputo
fractional derivative of order $\alpha$ with respect
to the $i$th variable $t_i$ is given by
\begin{equation*}
\begin{split}
\bigl(B_{P_{t_i}}^{\alpha}f\bigr)(\textbf{t})
&:=\left(K_{P_{t_i}}^{1-\alpha} \circ \frac{\partial}{\partial t_i} f\right)(\textbf{t})\\
&=p_i\int\limits_{a_i}^{t_i}k_{1-\alpha}(t_i,\tau)\frac{\partial}{\partial \tau}
f(t_1,\dots,t_{i-1},\tau,t_{i+1},\dots,t_n)d\tau\\
& \qquad \qquad +q_i\int\limits_{t_i}^{b_i}k_{1-\alpha}(\tau,t_i)\frac{\partial}{\partial \tau}
f(t_1,\dots,t_{i-1},\tau,t_{i+1},\dots,t_n)d\tau
\end{split}
\end{equation*}
and is referred as the \emph{partial operator $B$} (partial $B$-op)
of order $\alpha$ and $p$-set $P_{t_i}$.
\end{definition}

Similarly as in the one-dimensional case \cite{OmPrakashAgrawal,FVC_Gen,MyID:227},
the generalized partial operators $K$, $A$ and $B$ here introduced
give the standard partial fractional integrals
and derivatives for particular kernels and $p$-sets.
The left- and right-sided Riemann--Liouville partial fractional integrals
with respect to the $i$th variable $t_i$ are obtained by choosing the kernel
$$
k_{\alpha}(t_i,\tau)=\frac{1}{\Gamma(\alpha)}(t_i-\tau)^{\alpha-1}
$$
and $p$-sets $L_{t_i}=\langle a_i,t_i,b_i,1,0\rangle$
and $R_{t_i}=\langle a_i,t_i,b_i,0,1\rangle$, respectively:
\begin{equation*}
\begin{split}
\left({_{a_i}}\textsl{I}^{\alpha}_{t_i} f\right)(\textbf{t})
&= \left(K_{L_{t_i}}^{\alpha}f\right)(\textbf{t})\\
&=\frac{1}{\Gamma(\alpha)}\int\limits_{a_i}^{t_i}(t_i-\tau)^{\alpha-1}
f(t_1,\dots,t_{i-1},\tau,t_{i+1},\dots,t_n)d\tau,
\end{split}
\end{equation*}
\begin{equation*}
\begin{split}
\left({_{t_i}}\textsl{I}^{\alpha}_{b_i} f\right)(\textbf{t})
&= \left(K_{R_{t_i}}^{\alpha}f\right)(\textbf{t})\\
&=\frac{1}{\Gamma(\alpha)}\int\limits_{t_i}^{b_i}(\tau-t_i)^{\alpha-1}
f(t_1,\dots,t_{i-1},\tau,t_{i+1},\dots,t_n)d\tau.
\end{split}
\end{equation*}
The standard left- and right-sided partial Riemann--Liouville and Caputo
fractional derivatives with respect to the $i$th variable $t_i$
are obtained with the choice of kernel $k_{1-\alpha}(t_i,\tau)
=\frac{1}{\Gamma(1-\alpha)}(t_i-\tau)^{-\alpha}$:
if $P_{t_i}=\langle a_i,t_i,b_i,1,0\rangle$, then
\begin{equation*}
\begin{split}
\left({_{a_i}}\textsl{D}^{\alpha}_{t_i} f\right)(\textbf{t})
&= \left(A_{P_{t_i}}^{\alpha}f\right)(\textbf{t})\\
&=\frac{1}{\Gamma(1-\alpha)}\frac{\partial}{\partial t_i}
\int\limits_{a_i}^{t_i}(t_i-\tau)^{-\alpha}
f(t_1,\dots,t_{i-1},\tau,t_{i+1},\dots,t_n)d\tau
\end{split}
\end{equation*}
and
\begin{equation*}
\begin{split}
\left({^{C}_{a_i}}\textsl{D}^{\alpha}_{t_i} f\right)(\textbf{t})
&= \left(B_{P_{t_i}}^{\alpha}f\right)(\textbf{t})\\
&=\frac{1}{\Gamma(1-\alpha)}\int\limits_{a_i}^{t_i}
(t_i-\tau)^{-\alpha}\frac{\partial}{\partial \tau}
f(t_1,\dots,t_{i-1},\tau,t_{i+1},\dots,t_n)d\tau;
\end{split}
\end{equation*}
if $P_{t_i}=\langle a_i,t_i,b_i,0,1\rangle$, then
\begin{equation*}
\begin{split}
\left({_{t_i}}\textsl{D}^{\alpha}_{b_i} f\right)(\textbf{t})
&= -\left(A_{P_{t_i}}^{\alpha}f\right)(\textbf{t})\\
&=-\frac{1}{\Gamma(1-\alpha)}\frac{\partial}{\partial t_i}\int\limits_{t_i}^{b_i}
(\tau-t_i)^{-\alpha}f(t_1,\dots,t_{i-1},\tau,t_{i+1},\dots,t_n)d\tau
\end{split}
\end{equation*}
and
\begin{equation*}
\begin{split}
\left({^{C}_{t_i}}\textsl{D}^{\alpha}_{b_i} f\right)(\textbf{t})
&= -\left(B_{P_{t_i}}^{\alpha}f\right)(\textbf{t})\\
&=-\frac{1}{\Gamma(1-\alpha)}\int\limits_{t_i}^{b_i}(\tau-t_i)^{-\alpha}
\frac{\partial}{\partial \tau}f(t_1,\dots,t_{i-1},\tau,t_{i+1},\dots,t_n)d\tau.
\end{split}
\end{equation*}

\begin{remark}
In Definitions~\ref{def:GPI}, \ref{def:GPRL} and \ref{def:GPC},
all the variables, except $t_i$, are kept fixed. That choice
of fixed values determines a function
$f_{t_1,\dots,t_{i-1},t_{i+1},\dots,t_n}:[a_i,b_i]\rightarrow \mathbb{R}$
of one variable $t_i$:
\begin{equation*}
f_{t_1,\dots,t_{i-1},t_{i+1},\dots,t_n}(t_i)
=f(t_1,\dots,t_{i-1},t_i,t_{i+1},\dots,t_n).
\end{equation*}
By Definitions~\ref{def:GI}, \ref{def:GRL}, \ref{def:GC}
and \ref{def:GPI}, \ref{def:GPRL}, \ref{def:GPC}, we have
\begin{gather*}
\left(K_{P_{t_i}}^{\alpha}f_{t_1,\dots,t_{i-1},t_{i+1},\dots,t_n}\right)(t_i)
=\left(K_{P_{t_i}}^{\alpha}f\right)(t_1,\dots,t_{i-1},t_i,t_{i+1},\dots,t_n),\\
\left(A_{P_{t_i}}^{\alpha}f_{t_1,\dots,t_{i-1},t_{i+1},\dots,t_n}\right)(t_i)
=\left(A_{P_{t_i}}^{\alpha}f\right)(t_1,\dots,t_{i-1},t_i,t_{i+1},\dots,t_n),\\
\left(B_{P_{t_i}}^{\alpha}f_{t_1,\dots,t_{i-1},t_{i+1},\dots,t_n}\right)(t_i)
=\left(B_{P_{t_i}}^{\alpha}f\right)(t_1,\dots,t_{i-1},t_i,t_{i+1},\dots,t_n).
\end{gather*}
Therefore, as in the classical integer order case, computation of partial
generalized fractional operators is reduced to the computation
of one-variable generalized fractional operators.
\end{remark}

\section{Green's Theorem for Generalized Fractional Derivatives}
\label{sec:MR}

\begin{definition}[Dual $p$-set]
Let $P_{t_i}=\langle a_i,t_i,b_i,p_i,q_i\rangle$, $i\in\mathbb{N}$.
We denote by $P_{t_i}^{*}$ the $p$-set
$P_{t_i}^{*} = \langle  a_i,t_i,b_i,q_i,p_i\rangle$
and call it the dual of $P_{t_i}$.
\end{definition}

\begin{theorem}[Generalized 2D Integration by Parts]
\label{theorem:GRI}
Let $\alpha\in (0,1)$, $P_{t_i}=\langle a_i,t_i,b_i,p_i,q_i \rangle$
be a parameter set, and $k_\alpha$ be a difference kernel, i.e.,
$k_\alpha(t_i,\tau)=k_\alpha(t_i-\tau)$ such that
$k_\alpha\in L_1([0,b_i-a_i])$, $i=1,2$.
If $f,g,\eta_1,\eta_2\in C\left(\Delta_2\right)$, then the
generalized partial fractional integrals satisfy the following identity:
\begin{multline*}
\int\limits_{a_1}^{b_1}\int\limits_{a_2}^{b_2}
\left[g(\textbf{t})\left(K_{P_{t_1}}^{\alpha}\eta_1\right)(\textbf{t})
+f(\textbf{t})\left(K_{P_{t_2}}^{\alpha}\eta_2\right)(\textbf{t})\right]dt_2 dt_1\\
=\int\limits_{a_1}^{b_1}\int\limits_{a_2}^{b_2}
\eta_1(\textbf{t})\left[\left(K_{P_{t_1}^*}^{\alpha}g\right)(\textbf{t})\right]
+\eta_2(\textbf{t})\left[\left(K_{P_{t_2}^*}^{\alpha}f\right)(\textbf{t})\right]dt_2 dt_1,
\end{multline*}
where $P_{t_i}^*$ is the dual of $P_{t_i}$, $i=1,2$.
\end{theorem}

\begin{proof}
Define
\[
F_1(\textbf{t},\tau):=
\left\{
\begin{array}{ll}
\left|p_1 k_\alpha(t_1-\tau)\right|
\cdot\left|g(\textbf{t})\right|\cdot \left|\eta_1(\tau,t_2)\right|
& \mbox{if $\tau \leq t_1$}\\
\left|q_1 k_\alpha(\tau-t_1)\right|
\cdot \left|g(\textbf{t})\right|\cdot\left|\eta_1(\tau,t_2)\right|
& \mbox{if $\tau > t_1$}
\end{array}\right.
\]
for all $(\textbf{t},\tau)\in [a_1,b_1]\times [a_2,b_2]\times [a_1,b_1]$ and
\[
F_2(\textbf{t},\tau):=
\left\{
\begin{array}{ll}
\left|p_2 k_\alpha(t_2-\tau)\right|
\cdot\left|f(\textbf{t})\right|\cdot \left|\eta_2(t_1,\tau)\right|
& \mbox{if $\tau \leq t_2$}\\
\left|q_2 k_\alpha(\tau-t_2)\right|
\cdot \left|f(\textbf{t})\right|\cdot\left|\eta_2(t_1,\tau)\right|
& \mbox{if $\tau > t_2$}
\end{array}\right.
\]
for all $(\textbf{t},\tau)\in [a_1,b_1]\times [a_2,b_2]\times [a_2,b_2]$.
Since $f,g$ and $\eta_i$, $i=1,2$, are continuous functions on $\Delta_2$,
they are bounded on $\Delta_2$. Hence, there exist real numbers
$C_1,C_2,C_3,C_4>0$ such that
$$
\left|f(\textbf{t})\right|\leq C_1, \quad
\left|g(\textbf{t})\right| \leq C_2, \quad
\left|\eta_1(\textbf{t})\right| \leq C_3,
\quad \left|\eta_2(\textbf{t})\right| \leq C_4,
$$
for all $\textbf{t}\in \Delta_2$. Therefore,
\begin{equation*}
\begin{split}
\int_{a_1}^{b_1}&\int_{a_2}^{b_2}\int_{a_1}^{b_1}
F_1(\textbf{t},\tau)dt_1 dt_2 d\tau
+ \int_{a_1}^{b_1} \int_{a_2}^{b_2} \int_{a_2}^{b_2}
F_2(\textbf{t},\tau)dt_2 d\tau dt_1\\
&=\int_{a_1}^{b_1}\left(\int_{a_2}^{b_2}\left(
\int_{\tau}^{b_1} \left|p_1 k_\alpha(t_1-\tau)\right|
\cdot\left|g(\textbf{t})\right|\cdot \left|\eta_1(\tau,t_2)\right| dt_1\right.\right. \\
&\quad + \left.\left.\int_{a_1}^{\tau} \left|q_1 k_\alpha(\tau-t_1)\right|
\cdot \left|g(\textbf{t})\right|\cdot\left|\eta_1(\tau,t_2)\right| dt_1 \right)dt_2 \right) d\tau \\
&\quad +\int_{a_1}^{b_1}\left(\int_{a_2}^{b_2}\left(\int_{\tau}^{b_2} \left|p_2 k_\alpha(t_2-\tau)\right|
\cdot\left|f(\textbf{t})\right|\cdot \left|\eta_2(t_1,\tau)\right| dt_2 \right.\right.\\
&\quad +\left.\left.\int_{a_2}^{\tau} \left|q_2 k_\alpha(\tau-t_2)\right|
\cdot \left|f(\textbf{t})\right|\cdot\left|\eta_2(t_1,\tau)\right| dt_2 \right)d\tau \right)dt_1\\
&\leq C_2 C_3 \left[\int_{a_1}^{b_1}\left(\int_{a_2}^{b_2}\left(\int_{\tau}^{b_1}
\left|p_1 k_\alpha(t_1-\tau)\right|dt_1\right.\right.\right. \\
&\quad +\left.\left.\left.\int_{a_1}^{\tau}
\left|q_1 k_\alpha(\tau-t_1)\right| dt_1\right)dt_2\right)d\tau\right]\\
&\quad + C_1 C_4 \left[\int_{a_1}^{b_1}\left(\int_{a_2}^{b_2}
\left(\int_{\tau}^{b_2}\left|p_2 k_\alpha(t_2-\tau)\right| dt_2\right.\right.\right.\\
&\quad + \left.\left.\left. \int_{\tau}^{b_2}\left|q_2 k_\alpha(\tau-t_2)\right|dt_2
\right)d\tau \right)dt_1\right]\\
&\leq C_2 C_3 \left[\int_{a_1}^{b_1}\left(\int_{a_2}^{b_2}\left(\int_{0}^{b_1-a_1}
\left|p_1 k_\alpha(u_1)\right|du_1 \right.\right.\right.\\
&\quad + \left.\left.\left.\int_{0}^{b_1-a_1}
\left|q_1 k_\alpha(u_1)\right| du_1\right)dt_2\right)d\tau\right]\\
&\quad + C_1 C_4 \left[\int_{a_1}^{b_1}\left(\int_{a_2}^{b_2}\left(
\int_{0}^{b_2-a_2}\left|p_2 k_\alpha(u_2)\right| du_2\right.\right.\right.\\
&\quad + \left.\left.\left.\int_{0}^{b_2-a_2}
\left|q_2 k_\alpha(u_2)\right|du_2 \right)d\tau \right)dt_1\right]\\
&= C_2 C_3 \left(\left|p_1\right|+\left|q_1\right|\right)\left\|k_{\alpha}\right\|(b_2-a_2)(b_1-a_1)\\
&\quad + C_1 C_4 \left(\left|p_2\right|+\left|q_2\right|\right)
\left\|k_{\alpha}\right\|(b_2-a_2)(b_1-a_1)\\
&< \infty.
\end{split}
\end{equation*}
Hence, we can use Fubini's theorem to change
the order of integration in the iterated integrals:
\begin{equation*}
\begin{split}
\int_{a_1}^{b_1}&\int_{a_2}^{b_2}\left[g(\textbf{t})\left(K_{P_{t_1}}^{\alpha}\eta_1\right)(\textbf{t})
+f(\textbf{t})\left(K_{P_{t_2}}^{\alpha}\eta_2\right)(\textbf{t})\right]dt_2 dt_1
\end{split}
\end{equation*}
\begin{equation*}
\begin{split}
&= \int_{a_1}^{b_1}\int_{a_2}^{b_2}\left[g(\textbf{t})\left(p_1 \int_{a_1}^{t_1}
k_\alpha (t_1-\tau)\eta_1(\tau,t_2)d\tau\right.\right.\\
&\quad + \left. q_1\int_{t_1}^{b_1} k_\alpha (\tau-t_1)\eta_1(\tau,t_2)d\tau\right)\\
&\quad +f(\textbf{t})\left(p_2 \int_{a_2}^{t_2} k_\alpha (t_2-\tau)\eta_2(t_1,\tau)d\tau\right.\\
&\quad + \left.\left. q_2\int_{t_2}^{b_2} k_\alpha (\tau-t_2)\eta_2(t_1,\tau)d\tau\right)\right]dt_2 dt_1\\
&=\int_{a_2}^{b_2}\left(\int_{a_1}^{b_1}\eta_1(\tau,t_2)\left(p_1\int_{\tau}^{b_1}
k_\alpha (t_1-\tau)g(\textbf{t})dt_1\right.\right.\\
&\quad + \left.\left. q_1\int_{a_1}^{\tau}k_\alpha (\tau-t_1)g(\textbf{t})dt_1\right)d\tau \right)dt_2\\
& \quad +\int_{a_1}^{b_1}\left(\int_{a_2}^{b_2}\eta_2(t_1,\tau)\left(p_2 \int_{\tau}^{b_2}
k_\alpha(t_2-\tau)f(\textbf{t})dt_2\right.\right.\\
&\quad + \left.\left. q_2 \int_{a_2}^{\tau}k_\alpha(\tau-t_2)f(\textbf{t})dt_2\right)d\tau\right)dt_1\\
&=\int_{a_1}^{b_1}\int_{a_2}^{b_2}\eta_1(\tau,t_2)\left(K_{P_{t_1^*}}^{\alpha}g\right)(\tau,t_2) dt_2 d\tau \\
&\quad + \int_{a_1}^{b_1}\int_{a_2}^{b_2}\eta_2(t_1,\tau)\left(K_{P_{t_2^*}}^{\alpha}f\right)(t_1,\tau) d\tau dt_1.
\end{split}
\end{equation*}
\end{proof}

We are now in conditions to state and prove the main result of the paper:
the Green theorem for generalized fractional derivatives.

\begin{theorem}[Generalized Green's Theorem]
\label{thm:ggt}
Let $0<\alpha<1$ and $f,g,\eta\in C^1\left(\Delta_2\right)$.
Let $k_\alpha$ be a difference kernel, i.e.,
$k_\alpha(t_i,\tau)=k_\alpha(t_i-\tau)$ such that $k_\alpha\in L_1([0,b_i-a_i])$,
$i=1,2$, and $K_{P_{t_1}^*}^{1-\alpha}g,K_{P_{t_2}^*}^{1-\alpha}f\in C^1\left(\Delta_2\right)$.
Then, the following formula holds:
\begin{multline*}
\int_{a_1}^{b_1}\int_{a_2}^{b_2}\left[g(\textbf{t})\left(B_{P_{t_1}}^{\alpha}\eta\right)(\textbf{t})
+f(\textbf{t})\left(B_{P_{t_2}}^{\alpha}\eta\right)(\textbf{t})\right]dt_2 dt_1\\
=-\int_{a_1}^{b_1}\int_{a_2}^{b_2}\eta(\textbf{t})\left[\left(A_{P_{t_1}^*}^{\alpha}g\right)(\textbf{t})
+\left(A_{P_{t_2}^*}^{\alpha}f\right)(\textbf{t})\right]dt_2 dt_1\\
+\oint_{\partial\Delta_2}\eta(\textbf{t})\left[\left(K_{P_{t_1}^*}^{1-\alpha}g\right)(\textbf{t})dt_2
-\left(K_{P_{t_2}^*}^{1-\alpha}f\right)(\textbf{t})dt_1\right].
\end{multline*}
\end{theorem}

\begin{proof}
By the definition of generalized partial Caputo fractional derivative,
Theorem~\ref{theorem:GRI}, and the standard Green's theorem, one has
\begin{equation*}
\begin{split}
\int_{a_1}^{b_1}&\int_{a_2}^{b_2}\left[g(\textbf{t})\left(B_{P_{t_1}}^{\alpha}\eta\right)(\textbf{t})
+f(\textbf{t})\left(B_{P_{t_2}}^{\alpha}\eta\right)(\textbf{t})\right]dt_2 dt_1\\
&=\int_{a_1}^{b_1}\int_{a_2}^{b_2}\left[g(\textbf{t})\left(
K_{P_{t_1}}^{1-\alpha}\frac{\partial}{\partial t_1} \eta\right)(\textbf{t})
+ f(\textbf{t})\left(K_{P_{t_2}}^{1-\alpha}\frac{\partial}{\partial t_2}
\eta\right)(\textbf{t})\right]dt_2 dt_1\\
&=\int_{a_1}^{b_1}\int_{a_2}^{b_2}\left[\frac{\partial}{\partial t_1}\eta(\textbf{t})
\left(K_{P_{t_1}^*}^{1-\alpha} g\right)(\textbf{t})
+ \frac{\partial}{\partial t_2}\eta(\textbf{t})
\left(K_{P_{t_2}^*}^{1-\alpha} f\right)(\textbf{t})\right]dt_2 dt_1\\
&=-\int_{a_1}^{b_1}\int_{a_2}^{b_2}\eta(\textbf{t})\left[\frac{\partial}{\partial t_1}
\left(K_{P_{t_1^*}}^{1-\alpha}g\right)(\textbf{t})
+ \frac{\partial}{\partial t_2}\left(
K_{P_{t_2^*}}^{1-\alpha}f\right)(\textbf{t})\right]dt_2 dt_1\\
&\quad + \oint_{\partial\Delta_2}\eta(\textbf{t})\left[\left(K_{P_{t_1}^*}^{1-\alpha}g\right)(\textbf{t})dt_2
-\left(K_{P_{t_2}^*}^{1-\alpha}f\right)(\textbf{t})dt_1\right].
\end{split}
\end{equation*}
\end{proof}

\begin{corollary}
Let $0<\alpha<1$ and $f,g,\eta\in C^1\left(\Delta_2\right)$.
If $\left({_{t_1}}\textsl{I}^{1-\alpha}_{b_1} g\right)(\textbf{t})$
and $\left({_{t_2}}\textsl{I}^{1-\alpha}_{b_2} f\right)(\textbf{t})$
are continuously differentiable on the rectangle $\Delta_2$, then
\begin{multline*}
\int_{a_1}^{b_1}\int_{a_2}^{b_2}\left[g(\textbf{t})\left({^{C}_{a_1}}\textsl{D}^{\alpha}_{t_1}
\eta\right)(\textbf{t})+f(\textbf{t})\left({^{C}_{a_2}}\textsl{D}^{\alpha}_{t_2}
\eta\right)(\textbf{t})\right]dt_2 dt_1\\
=\int_{a_1}^{b_1}\int_{a_2}^{b_2}\eta(\textbf{t})\left[
\left({_{t_1}}\textsl{D}^{\alpha}_{b_1} g\right)(\textbf{t})
+\left({_{t_2}}\textsl{D}^{\alpha}_{b_2} f\right)(\textbf{t})\right]dt_2 dt_1\\
+\oint_{\partial\Delta_2}\eta(\textbf{t})\left[\left({_{t_1}}\textsl{I}^{1-\alpha}_{b_1}
g\right)(\textbf{t})dt_2-\left({_{t_2}}\textsl{I}^{1-\alpha}_{b_2} f\right)(\textbf{t})dt_1\right].
\end{multline*}
\end{corollary}

\section*{Acknowledgements}

This work received \emph{The Grunwald--Letnikov Award: Best Student Paper (theory)},
at the 2012 Symposium on Fractional Differentiation and Its Applications (FDA'2012),
May 16, 2012, Hohai University, Nanjing.
It was supported by {\it FEDER} funds through
{\it COMPETE} (Operational Program Factors of Competitiveness)
and by Portuguese funds through the
{\it Center for Research and Development
in Mathematics and Applications} (CIDMA)
and the Portuguese Foundation for Science and Technology (FCT),
within project PEst-C/MAT/UI4106/2011
with COMPETE number FCOMP-01-0124-FEDER-022690.
Odzijewicz was also supported by FCT under Ph.D. fellowship
SFRH/BD/33865/2009; Malinowska by Bia{\l}ystok
University of Technology grant S/WI/02/2011;
and Torres by FCT through the project PTDC/MAT/113470/2009.