Tight bounds for Katona's shadow intersection theorem

Abstract: A fundamental result in extremal set theory is Katona's shadow intersection theorem, which extends the Kruskal-Katona theorem by giving a lower bound on the size of the shadow of an intersecting family of $k$-sets in terms of its size. We improve this classical result and a related result of Ahlswede, Aydinian, and Khachatrian by proving tight bounds for families that can be quite small. For example, when $k=3$ our result is sharp for all families with $n$ points and at least $3n-7$ triples.Katona's theorem was extended by Frankl to families with matching number $s$. We improve Frankl's result by giving tight bounds for large $n$.

\section{Introduction}
Let $n\ge k \ge \ell\ge 1$.
Given a family $\mathcal{H}\subset \binom{[n]}{k}$ the $\ell$-th shadow of $\mathcal{H}$ is
\begin{align}
\partial_{\ell}\mathcal{H} = \left\{A\in \binom{[n]}{k-\ell}: \exists B\in \mathcal{H} \text{ such that }A\subset B \right\}. \notag
\end{align}
When $\ell = 1$ we write $\partial\mathcal{H}$ and call $\partial\mathcal{H}$ the shadow of $\mathcal{H}$.
The colex order on ${[n] \choose k}$  is defined as follows:
\begin{align}
A \prec B \text{ iff } \max\{(A\setminus B)\cup (B\setminus A)\}\in B. \notag
\end{align}
Write $L_{m}\mathcal{H}$ to denote the set of the first $m$ elements of $\mathcal{H} \subset {[n] \choose k}$ in the colex order. When $\mathcal{H} = {[n] \choose k}$, we abuse notation by simply writing $L_{m}\binom{[n]}{k}$.

The celebrated Kruskal-Katona theorem states that the families in ${[n] \choose k}$ with a fixed number of sets and minimum shadow size are initial elements of the colex order.

\begin{thm}[Kruskal-Katona~\cite{KA68,KR63}]\label{thm-Kruskal-Katona}
For $n\ge k >\ell  \ge 1$ and $\mathcal{H}\subset \binom{[n]}{k}$ with $|\mathcal{H}| = m$,
 $$|\partial_{\ell}\mathcal{H}|\ge \left |\partial_{\ell}L_{m}\binom{[n]}{k}\right|.$$
\end{thm}
\subsection{Katona's shadow intersection Theorem}
The Kruskal-Katona theorem was extended to families with additional properties.
One such result is due to Katona \cite{KA64} about $t$-intersecting families, which are families in which every two sets have at least $t$ common elements.

\begin{thm}[Katona~\cite{KA64}]\label{thm-Katona-t-intersecting}
Let $n\ge k > t \ge \ell \ge 1$.
If $\mathcal{H} \subset \binom{[n]}{k}$ is $t$-intersecting, then
$$|\partial_{\ell}\mathcal{H}|\ge \frac{\binom{2k-t}{k-\ell}}{\binom{2k-t}{k}} |\mathcal{H}|.$$
\end{thm}

The only case of equality in Theorem \ref{thm-Katona-t-intersecting} is when $n=2k-t$ and $\mathcal{H} \cong \binom{[2k-t]}{k}$ (see \cite{AAK04}).

Theorem~\ref{thm-Katona-t-intersecting} is a foundational result in extremal set theory with many applications.
Its first application was to prove a conjecture of Erd\H os-Ko-Rado on the maximum size of a  $t$-intersecting family in $2^{[n]}$.
It was used to obtain short new proofs for several classical results.
For example, Frankl-F\"{u}redi \cite{FF12} used it to give a short proof for the Erd\H{o}s-Ko-Rado theorem,
and Frankl-Tokushige \cite{FT92} used it to obtain a short proof for the Hilton-Milner theorem.
It also has many applications to Sperner families and other types of intersection problems~\cite{BF19,CG81,FF84,FF86,G80,MB18,S92,Z89}.

This paper is concerned with improving the bounds in Theorem~\ref{thm-Katona-t-intersecting} and related results about shadows of families with certain properties. In many cases the bounds we prove are best possible.

Our first result improves Theorem~\ref{thm-Katona-t-intersecting} for intersecting families  (the case $t=1$) and applies to all  $n > 2k$. It is convenient to define  the family
\begin{align}
EKR(n,k) = \left\{A\in {[n]\choose k}:  1 \in A\right\}. \notag
\end{align}

\begin{thm}\label{thm-shadow-intersecting-all-n}
Let $n > 2k\ge 6$  and $1\le \ell < k$.
Suppose that $\mathcal{H} \subset \binom{[n]}{k}$ is intersecting and
\begin{align}
|\mathcal{H}| = m > m(n,k) =
\begin{cases}
3n-8, & \text{ if } k=3, \\
\binom{n-1}{k-1}-\binom{n-k}{k-1}+\binom{n-k-2}{k-3}+2, & \text{ if } k \ge 4.
\end{cases}\notag
\end{align}
Then $|\partial_{\ell}\mathcal{H}| \ge |\partial_{\ell} L_{m}EKR(n,k)|$.
In particular, if for some $x\in \mathbb{R}$
\begin{align}
|\mathcal{H}| = \binom{x-1}{k-1} > m(n,k)
\end{align}
then $|\partial_{\ell}\mathcal{H}| \ge \binom{x}{k-\ell}$.
\end{thm}

{\bf Remarks.}
\begin{itemize}
    \item
\ For $k=3$ and $m=3n-8$, the inequality $|\partial\mathcal{H}|<|\partial L_{m}EKR(n,k)|$ is possible
(see Fact~\ref{fact1.7} with $t=1$), so Theorem~\ref{thm-shadow-intersecting-all-n} is best possible in this sense. In fact, when $k=3$ one can compute the sharp lower bound for $|\partial{\mathcal H}|$ {\em for all} intersecting families  $\mathcal{H}$ using our proof method but we do not carry out all these details.

\item For fixed $k>3$ and  $n\rightarrow \infty$, we will lower the value of $m(n,k)$ from $(k-1+o(1)){n \choose k-2}$ to   $(3+o(1)){n \choose k-2}$ in Theorem~\ref{thm-EM(n,k,s)-n^k-2} and the constant $3$ will be shown to be  tight.
\end{itemize}
\medskip

Ahlswede, Aydinian, and Khachatrian \cite{AAK04} considered large $t$-intersecting families on $\mathbb{N}$. Let $\binom{\mathbb{N}}{k}$ denote the collection of all $k$-subsets of $\mathbb{N}$
and let $$EM(\mathbb{N},k,s,t) = \left\{A \in \binom{\mathbb{N}}{k}: |A\cap [s]|\ge t\right\}.$$

\begin{thm}[Ahlswede, Aydinian, and Khachatrian~\cite{AAK04}]\label{thm-AAK04}
Let $\mathcal{H}\subset \binom{\mathbb{N}}{k}$ be a $t$-intersecting family.
\begin{itemize}
\item For $1 \le \ell \le t < k$, there exists $m_{1}(k,t,\ell) \in \mathbb{N}$ such that if $|\mathcal{H}|=m\ge m_{1}(k,t,\ell)$,
then $|\partial_{\ell}\mathcal{H}|\ge |\partial_{\ell}L_{m}EM(\mathbb{N},k,2k-2-t,k-1)|$.
\item For $1 \le t < \ell < k$, there exists $m_{2}(k,t,\ell) \in \mathbb{N}$ such that if $|\mathcal{H}|=m\ge m_{2}(k,t,\ell)$,
then $|\partial_{\ell}\mathcal{H}|\ge |\partial_{\ell}L_{m}EM(\mathbb{N},k,t,t)|$.
\end{itemize}
\end{thm}

For $0 \le t \le \min \{k,s\}$, let
\begin{align}
EM(n,k,s,t) = \left\{A\subset {[n]\choose k}:  |A\cap [s]|\ge t \right\}, \notag
\end{align}
and set $EM(n,k,s,t) = \emptyset$ if $t > \min\{k,s\}$, and  $EM(n,k,s,t) = \binom{[n]}{k}$ if $n \le s$.

For every $m \le \binom{n-t}{k-t}$ we have $L_{m}EM(n,k,t,t) = L_{m}EM(\mathbb{N},k,t,t)$.
Therefore, Theorem \ref{thm-AAK04} implies the following result.

\begin{coro}\label{coro-AAK04}
Let $1 \le t < \ell < k$ and $\mathcal{H}\subset \binom{[n]}{k}$ be a $t$-intersecting family with $|\mathcal{H}| = m > m_{2}(k,t,\ell)$.
Then $|\partial_{\ell}\mathcal{H}|\ge |\partial_{\ell}L_{m}EM(n,k,t,t)|$.
\end{coro}

However, for the case $\ell \le t$ we  show that  the smallest possible size of the $\ell$-th shadow of
large $t$-intersecting families on $[n]$ is different than the formula in Theorem~\ref{thm-AAK04}. Let
\begin{align}
AK(n,k,t) = \left\{ A \in \binom{[n]}{k}: [t] \subset A \text{ and } [t+1,k+1] \cap A \neq\emptyset \right\} \cup
            \left( \bigcup_{i\in [t]}\left\{[k+1]\setminus\{i\} \right\} \right). \notag
\end{align}
Notice that $AK(n,k,t)$ and $EM(n,k,t+2,t+1)$ are both $t$-intersecting,
$$|AK(n,k,t)| \sim (k-t+1)\binom{n}{k-t-1},$$
$$|EM(n,k,t+2,t+1)| \sim (t+2)\binom{n}{k-t-1}.$$
Our next result is a finite version of Theorem~\ref{thm-AAK04}.
\medskip
\begin{thm}\label{thm-shadow-t-intersecting-all-n}
Let $t\ge 1, k\ge 3, 1 \le \ell < k$, and $n> (t+1)(k-t+1)$.
Suppose that $\mathcal{H} \subset \binom{[n]}{k}$ is $t$-intersecting and
\begin{align}
|\mathcal{H}| = m > m(n,k,t) =
\begin{cases}
\max\left\{|AK(n,k,t)|,|EM(n,k,t+2,t+1)|\right\}, & \text{ if } t < \frac{k-1}{2}, \\
|EM(n,k,t+2,t+1)|, & \text{ if } t \ge \frac{k-1}{2}.
\end{cases}\notag
\end{align}
Then $|\partial_{\ell}\mathcal{H}|\ge |\partial_{\ell} L_{m}EM(n,k,t,t)|$.
In particular, if
\begin{align}
|\mathcal{H}| = \binom{x-t}{k-t} > m(n,k,t)
\end{align}
for some $x\in \mathbb{R}$.
Then $|\partial_{\ell}\mathcal{H}|\ge \sum_{i= t-\ell}^{k-\ell}\binom{t}{i}\binom{x-t}{k-\ell-i}$.
For  $1\le \ell \le t$ the  value of $m(n,k,t)$ is tight for $t \ge \frac{k-1}{2}$
and is tight up to a constant multiplicative factor independent of $n$ for $t < \frac{k-1}{2}$.
\end{thm}
{\bf Remarks.}
\begin{itemize}
       \item
Theorem \ref{thm-shadow-t-intersecting-all-n} implies that for a $t$-intersecting family $\mathcal{H} \subset \binom{[n]}{k}$
with large size, $$\frac{|\partial_{\ell}\mathcal{H}|}{|\mathcal{H}|} > \binom{t}{\ell} \ge  \frac{\binom{2k-t}{k-\ell}}{\binom{2k-t}{k}}$$ for $1 \le \ell \le t$ with equality in the second inequality iff $\ell = t$. Hence our bound is better than that in Theorem \ref{thm-Katona-t-intersecting} (as expected since our bound is best possible).

\item For $t < \frac{k-1}{2}$ we will show in the last section that the lower bound for
$|\mathcal{H}|$ in Theorem \ref{thm-shadow-t-intersecting-all-n} can be improved slightly.
\end{itemize}

\subsection{Frankl's theorem}
The matching number of $\mathcal{H}$, denoted by $\nu(\mathcal{H})$,
is the maximum number of pairwise disjoint edges in $\mathcal{H}$.
Notice that $\nu(EM(n,k,s,1)) \le s$ with equality iff $n \ge ks$ and
$$|EM(n,k,s,1)| = \binom{n}{k}-\binom{n-s}{k} \sim s \binom{n}{k-1} \qquad \hbox{($n \rightarrow \infty$)}.$$
The Erd\H{o}s matching conjecture \cite{ER65} says that for all $n\ge (s+1)k-1$, if $\mathcal{H} \subset \binom{[n]}{k}$
and $\nu(\mathcal{H})\le s$, then
\begin{align} \label{eqEMC}
|\mathcal{H}| \le \max\left\{\binom{(s+1)k-1}{k}, \binom{n}{k}-\binom{n-s}{k}\right\}.
\end{align}

When $s=1$, (\ref{eqEMC}) follows from the  Erd\H{o}s-Ko-Rado theorem \cite{EKR61}.

\begin{thm}[Erd\H{o}s-Ko-Rado~\cite{EKR61}]\label{thm-EKR}
Let $k\ge 2$ and $n\ge 2k$, $\mathcal{H}\subset \binom{[n]}{k}$ be an intersecting family.
Then $\mathcal{H} \le \binom{n-1}{k-1}$ and when $n>2k$ equality holds iff $\mathcal{H} \cong EKR(n,k)$.
\end{thm}

The Erd\H{o}s matching conjecture is still open  and
the current record on this conjecture is due to Frankl \cite{FR13}.

\begin{thm}[Frankl~\cite{FR13}]\label{thm-Frankl-Matching-Conj}
Let $k\ge 2$ and $n\ge (2s+1)k - s$, $\mathcal{H}\subset \binom{[n]}{k}$ and $\nu(\mathcal{H}) \le s$.
Then $\mathcal{H} \le \binom{n}{k} - \binom{n-s}{k}$ with equality iff $\mathcal{H} \cong EM(n,k,s,1)$.
\end{thm}

If we take $t=1$ in Theorem \ref{thm-Katona-t-intersecting},
then every intersecting family
$\mathcal{H} \subset \binom{[n]}{k}$ satisfies $|\partial\mathcal{H}|\ge |\mathcal{H}|$. Frankl generalized this as follows.

\begin{thm} [Frankl~\cite{FR91, FR13}] \label{franklnu=s}
Let $n \ge k \ge 2$ and $\mathcal{H} \subset {[n] \choose k}$. If $\nu(\mathcal{H})=s\ge 1$,
then $$|\partial\mathcal{H}|\ge \frac{|\mathcal{H}|}{s}$$
with equality iff $\mathcal{H}\cong \binom{[(s+1)k-1]}{k}$.
\end{thm}

Theorem~\ref{franklnu=s} is a crucial tool in the proof of Theorem~\ref{thm-Frankl-Matching-Conj} and any improvement in Theorem~\ref{franklnu=s} for small values of $n$  could lead to a corresponding improvement in Theorem~\ref{thm-Frankl-Matching-Conj}. Our final result provides such an improvement (for large $n$) that is sharp if $|\mathcal{H}|$ is large.

\begin{thm}\label{thm-EM(n,k,s)-n^k-2}
For every $k\ge 3$ and every $s\ge 1$ there exists  $m(n,k,s)$  such that the following holds as $n \rightarrow \infty$.
Suppose that $\mathcal{H} \subset \binom{[n]}{k}$ satisfies $\nu(\mathcal{H})\le s$ and
\begin{align}\label{hlowerc}
|\mathcal{H}| = m > m(n,k,s) =
\begin{cases}
(3+o(1)){n \choose k-2} & \text{ if } s=1 \\
(\binom{2s+1}{2}+o(1)){n \choose k-2} & \text{ if } k=3 \\
(k\binom{s+1}{2} + o(1)){n \choose k-2} & \text{ if } k \ge 4, s \ge 2.
\end{cases}
\end{align}
Then $$|\partial\mathcal{H}| \ge |\partial L_{m}EM(n,k,s,1)|.$$
In particular, if $|\mathcal{H}| = \binom{x}{k} - \binom{x-s}{k} > m(n,k,s)$
for some $x \in \mathbb{R}$, then $|\partial\mathcal{H}| \ge \binom{x}{k-1}$.
\end{thm}

The constraint $\nu(\mathcal{H})\le s$ above imposes the bound $|\mathcal{H}| = O(n^{k-1})$, so the point of Theorem~\ref{thm-EM(n,k,s)-n^k-2} is that it applies to $|\mathcal{H}| \ge (c(k,s)+o(1)){n \choose k-2}$ where $c(k,s)$ is obtained from (\ref{hlowerc});  this is a lower order of magnitude  than $n^{k-1}$. In fact, as we will show below, the order of magnitude $n^{k-2}$ is best possible for such a result and even the constant $c(k,s)$ is tight if $s=1$ or $k=3$,
 and is tight up to a constant factor for all other $(s,k)$.

Let $\mathcal{G} = EM(n,k,2s+1,2)$ and
$m = |\mathcal{G}| \sim \binom{2s+1}{2}\binom{n}{k-2}$ and
let $x \in \mathbb{R}$ such that $\binom{x}{k} -\binom{x-s}{k} = m$.
Since $\binom{x}{k} -\binom{x-s}{k} \sim s \binom{x}{k-1}$, $x = \Theta(n^{\frac{k-2}{k-1}})$.
Notice that
\begin{align}
s|\partial \mathcal{G}|- m
& = s \sum_{i=1}^{k-1}\binom{2s+1}{i}\binom{n-2s-1}{k-1-i} - \sum_{i=2}^{k}\binom{2s+1}{i}\binom{n-2s-1}{k-i} \notag\\
& = \Theta(n^{k-3}), \notag
\end{align}
and
\begin{align}
s|\partial L_{m}EM(n,k,s,1)|- m
& \ge s \binom{x}{k-1} -\left( \binom{x}{k} -\binom{x-s}{k}\right) \notag\\
& = \Theta(x^{k-2})= \Theta(n^{\frac{(k-2)^2}{k-1}}). \notag
\end{align}
Since $\frac{(k-2)^2}{k-1} > k-3$, $|\partial L_{m}EM(n,k,s,1)| > |\partial EM(n,k,2s+1,2)|$ for sufficiently large $n$.
Therefore, we obtain the following result.

\begin{fact}
For every $k \ge 3$ and sufficiently large $n$
there exists $\mathcal{G} \subset \binom{[n]}{k}$ with $\nu(\mathcal{G}) =s$ and $|\mathcal{G}| = (1+o_{n}(1))\binom{2s+1}{2}\binom{n}{k-2}$
such that $|\partial\mathcal{G}| < |\partial L_{|\mathcal{G}|}EM(n,k,s,1)|$.
\end{fact}

It would be interesting to determine the minimum value of $c(k,s)$ such that the conclusion in Theorem \ref{thm-EM(n,k,s)-n^k-2} holds for
all $|\mathcal{H}| > c(k,s)\binom{n}{k-2}$ and sufficiently large $n$.

\section{Proofs}
\subsection{Extension of the $k$-cascade representation}
In this section, we prove an extension of the well-known $k$-cascade representation of a number.
The $k$-cascade representation  plays an important role in the Kruskal-Katona theorem and the extension that we prove plays an analogous role for our theorems.
As a convention, let $\binom{a}{b} = 0$ if $b< 0$ or $a<b$, and let $\binom{a}{0} = 1$ for all $a \ge 0$.

For an $r$-graph $\mathcal{H}$ and a vertex set $S$ that is disjoint from $V(\mathcal{H})$ define
\begin{align}
\mathcal{H}+S = \left\{A \cup S: A \in \mathcal{H}  \right\}.   \notag
\end{align}
For every $i \in \mathbb{N}$ let $\widehat{i} = i+1$.

\begin{lemma}\label{lemma-decompose-LmEM(n,k,s,t}
Let $n \ge k \ge t \ge 0$ and $s \ge t \ge 0$. Then the following hold.
\begin{itemize}
\item[(a)] $|EM(n,k,s,t)| = \binom{n}{k} - \sum_{j=0}^{t-1}\binom{s}{j}\binom{n-s}{k-j}$.
\item[(b)] For every $1 \le m \le |EM(n,k,s,t)|$
there exist integers $a_k > a_{k-1}> \cdots > a_h \ge h \ge \max\{t,1\}$ such that
\begin{align}
L_{m}EM(n,k,s,t)= EM(a_{k},k,s,t) \cup \bigcup_{i=h}^{k-1}
\left( EM(a_{i},i,s,t)+\{\widehat{a}_{i+1}, \ldots, \widehat{a}_{k}\} \right)
\notag
\end{align}
\end{itemize}
\end{lemma}
\begin{proof}
$(a)$ is clear.
So let us consider $(b)$.

First, it follows from the definition that the colex order of $EM(n',k,s,t)$ is the initial segment of the colex on $EM(n,k,s,t)$ for all $n' < n$.
Let $\mathcal{F} = L_{m}EM(n,k,s,t)$.
Without loss of generality we may assume that $\mathcal{F} \neq EM(n',k,s,t)$ for all $n' \le n$
since otherwise we can let $h=k$ and $a_k = n'$ and we are done.
So there exists $a_k$ such that $EM(a_k,k,s,t) \subset \mathcal{F} \subset EM(a_{k}+1,k,s,t)$
and hence every set in $\mathcal{F} \setminus EM(a_k,k,s,t)$ contains $a_{k}+1$.
Therefore, $\mathcal{F} = EM(a_k,k,s,t) \cup \left(\mathcal{F}_{k}+\{\widehat{a}_k\}\right)$ for some $\mathcal{F}_{k} \subset EM(a_k,k-1,s,t)$.

Let $m' = |\mathcal{F}_{k}|$.
Then it follows from the definition of colex order that $\mathcal{F}_{k} = L_{m'}EM(a_{k},k-1,s,t)$.
So we can repeat the argument above to show that there exists $a_{k-1}$ such that
$\mathcal{F}_{k} = EM(a_{k-1},k-1,s,t) \cup \left(\mathcal{F}_{k-1}+\{\widehat{a}_{k-1}\}\right)$.
This means that
\begin{align}
\mathcal{F} = EM(a_k,k,s,t) \cup \left(EM(a_{k-1},k-1,s,t)+\{\widehat{a}_k\}\right) \cup \left(\mathcal{F}_{k-1}+\{\widehat{a}_k,\widehat{a}_{k-1}\}\right).\notag
\end{align}
Inductively, one will get a decomposition of $\mathcal{F}$ as in Lemma \ref{lemma-decompose-LmEM(n,k,s,t}.
\end{proof}

\begin{lemma}\label{lemma-k-cascade-resp}
Let $s \ge t \ge 0$ and $k \ge t$.
Then, for every integers $m\ge 1$,
there exists  a unique representation of $m$ in the form
\begin{align}
m = \sum_{i=h}^{k}\binom{a_i}{i} - \sum_{j=0}^{t-1} \binom{s}{j}\sum_{i=h}^{k}\binom{a_i-s}{i-j}, \notag
\end{align}
where $a_k > \cdots > a_h \ge h \ge \max\{t,1\}$ are integers.
\end{lemma}
\begin{proof}
If $t=0$, then this is just the $k$-cascade representation of $m$.
So we may assume that $t\ge 1$.
Let $n\in \mathbb{N}$ be sufficiently large such that $m \le |EM(n,k,s,t)|$.
Then the existence of such a representation follows from Lemma \ref{lemma-decompose-LmEM(n,k,s,t} since
\begin{align}
m
= |L_{m}EM(n,k,s,t)|
= \sum_{i=h}^{k}|EM(a_{i},i,s,t)|
& = \sum_{i=h}^{k}\left(\binom{a_{i}}{i}-\sum_{j=0}^{t-1}\binom{s}{j}\binom{a_i-s}{i-j}\right) \notag\\
& = \sum_{i=h}^{k}\binom{a_i}{i} - \sum_{j=0}^{t-1} \binom{s}{j}\sum_{i=h}^{k}\binom{a_i-s}{i-j}. \notag
\end{align}

Next, we prove the uniqueness of such representation of $m$.
Suppose that there exists $a_k > \cdots > a_h \ge h \ge t$ and $b_k > \cdots > b_{h'} \ge h' \ge t$
such that
\begin{align}\label{equation-m-k-cascade}
\sum_{i=h}^{k}\binom{a_i}{i} - \sum_{j=0}^{t-1}\binom{s}{j}\sum_{i=h}^{k}\binom{a_i-s}{i-j}
= m
= \sum_{i=h'}^{k}\binom{b_i}{i} - \sum_{j=0}^{t-1} \binom{s}{j}\sum_{i=h'}^{k}\binom{b_i-s}{i-j}.
\end{align}
Without loss of generality we may assume that $a_k \neq b_k$ since otherwise we can consider
$m' = m -\left(\binom{a_k}{i} - \sum_{j=0}^{t-1}\binom{s}{j}\binom{a_k-s}{i-j}\right)$ instead.
Let
\begin{align}
\mathcal{F}_{a}
= EM(a_{k},k,s,t) \cup \bigcup_{i=h}^{k-1} \left(EM(a_{i},i,s,t)+\{\widehat{a}_{i+1}, \ldots, \widehat{a}_k\}\right) \notag
\end{align}
and
\begin{align}
\mathcal{F}_{b}
= EM(b_{k},k,s,t) \cup \bigcup_{i=h'}^{k-1} \left(EM(b_{i},i,s,t)+\{\widehat{b}_{i+1}, \ldots, \widehat{b}_k\}\right). \notag
\end{align}
Then
\begin{align}
|\mathcal{F}_a| =
\sum_{i=h}^{k}\binom{a_i}{i} - \sum_{j=0}^{t-1}\binom{s}{j}\sum_{i=h}^{k}\binom{a_i-s}{i-j}, \notag
\end{align}
and
\begin{align}
|\mathcal{F}_b| =
\sum_{i=h'}^{k}\binom{b_i}{i} - \sum_{j=0}^{t-1} \binom{s}{j}\sum_{i=h'}^{k}\binom{b_i-s}{i-j}. \notag
\end{align}
Without loss of generality
we may assume that $a_k \ge b_k +1$.
However, notice that in this case $\mathcal{F}_b$ is a proper subset of $\mathcal{F}_a$, since every set of $\mathcal{F}_b$ has maximum element at most $b_k+1 \le a_k$. This contradicts (\ref{equation-m-k-cascade}).
\end{proof}

\subsection{Shifting}
For every $A \in \mathcal{H}$ and $1\le i < j \le n$ define
\begin{align}
S_{ij}(A) =
\begin{cases}
(A\setminus\{j\}) \cup \{i\}, & \text{ if } j\in A, i\not\in A, \text{ and } (A\setminus\{j\}) \cup \{i\} \not\in \mathcal{H}, \\
A, & \text{ otherwise}.
\end{cases}\notag
\end{align}
Let $S_{ij}(\mathcal{H}) = \{S_{ij}(A): A\in \mathcal{H}\}$ and call $\mathcal{H}$ shifted if $\mathcal{H} = S_{ij}(\mathcal{H})$
for all $1\le i < j \le n$.

\begin{fact}[see \cite{FR87}] \label{fact}
The following statements hold for all $\mathcal{H} \subset \binom{[n]}{k}$ and all $1\le i <j \le n$ and all $1\le t,\ell\le k-1$.
\begin{itemize}
\item $|\mathcal{H}| = |S_{ij}(\mathcal{H})|$.
\item $\partial_{\ell}S_{ij}(\mathcal{H}) \subset S_{ij}(\partial_{\ell}\mathcal{H})$ and in particular,
        $|S_{ij}(\partial_{\ell}\mathcal{H})| \ge |\partial_{\ell}S_{ij}(\mathcal{H})|$
\item $\nu(S_{ij}(\mathcal{H})) \le \nu(\mathcal{H})$.
\item If $\mathcal{H}$ is $t$-intersecting, then $S_{ij}(\mathcal{H})$ is also $t$-intersecting.
\end{itemize}
\end{fact}

\subsection{Main Lemma}
Fact~\ref{fact} shows that it suffices to consider shifted families in all proofs in this paper. The main technical statement in this work is Lemma~\ref{lemma-shadow-k-s-t-exact} below which is a generalization of the Kruskal-Katona theorem. For two families $\mathcal{H}_1$ and $\mathcal{H}_2$ we write $\mathcal{H}_1 \subset \mathcal{H}_2$
if $\mathcal{H}_1$ is isomorphic to a subgraph of $\mathcal{H}_2$.

Given a family $\mathcal{H}$, let $\mathcal{H}(1) = \{A\setminus \{1\}: 1\in A\in \mathcal{H}\}$
and $\mathcal{H}(\bar{1}) = \{A \in \mathcal{H}: 1\not\in A\}$.
It is easy to see that if $\mathcal{H}$ is shifted, then $\partial\mathcal{H}(\bar{1}) \subset \mathcal{H}(1)$
and hence $|\partial\mathcal{H}| = |\mathcal{H}(1)|+|\partial\mathcal{H}(1)|$.

\begin{lemma}\label{lemma-size-shadow-LmEM(n,k,s,t)}
Let $n \ge k \ge t \ge 0$ and $s \ge t \ge 0$.
Suppose that
\begin{align}
m =  \sum_{i=h}^{k}\binom{a_i}{i} - \sum_{j=0}^{t-1} \binom{s}{j}\sum_{i=h}^{k}\binom{a_i-s}{i-j} \notag
\end{align}
for integers $a_k > \cdots > a_{h} \ge \max\{t,1\}$.
Then for $1 \le \ell \le k-1$
\begin{align}
|\partial_{\ell} L_{m}EM(n,k,s,t)|
=  \sum_{i=h}^{k}\binom{a_i}{i-\ell} - \sum_{j=0}^{t-1-\ell} \binom{s}{j}\sum_{i=h}^{k}\binom{a_i-s}{i-\ell-j}.\notag
\end{align}
\end{lemma}
\begin{proof}
Fix $1 \le \ell \le k-1$. By Lemma \ref{lemma-decompose-LmEM(n,k,s,t},
\begin{align}
L_{m}EM(n,k,s,t)= EM(a_{k},k,s,t) \cup \bigcup_{i=h}^{k-1}
\left(EM(a_{i},i,s,t)+\{\widehat{a}_{i+1}, \ldots, \widehat{a}_{k}\}\right).
\notag
\end{align}
Notice that
\begin{align}
\partial  EM(a_k,k,s,t)
= EM(a_k,k-1,s,t-1),
\notag
\end{align}
and for every $h \le i \le k-1$ we have
\begin{align}
\partial \left(EM(a_i,i,s,t) + \{\widehat{a}_{i+1},\ldots,\widehat{a}_{k}\}\right)
=  \left(EM(a_i,i-1,s,t-1) + \{\widehat{a}_{i+1},\ldots,\widehat{a}_{k}\}\right) \cup  \notag\\
\bigcup_{j=i+1}^{k} \left(EM(a_i,i,s,t) + \{\widehat{a}_{i+1},\ldots,\widehat{a}_{k}\}\setminus \{\widehat{a}_{j}\}\right).
\notag
\end{align}
On the other hand, for all $h\le i<j \le k-2$ since $a_{j} > a_{i}$ ,
\begin{align}
EM(a_i,i,s,t) + \{\widehat{a}_{i+1},\ldots,\widehat{a}_{k}\}\setminus \{\widehat{a}_{j}\}
\subset EM(a_j,j-1,s,t-1) + \{\widehat{a}_{j+1},\ldots,\widehat{a}_{k}\}.
\notag
\end{align}
For all $h \le i \le k-1$ since $a_{k} > a_{i}$,
\begin{align}
EM(a_i,i,s,t) + \{\widehat{a}_{i+1},\ldots,\widehat{a}_{k}\}\setminus \{\widehat{a}_{k}\}
\subset EM(a_k,k-1,s,t-1).
\notag
\end{align}
Therefore,
\begin{align}
\partial L_{m}EM(n,k,s,t)
= \bigcup_{i=h}^{k} \left(EM(a_{i},i-1,s,t-1)+\{\widehat{a}_{i+1},\ldots,\widehat{a}_{k}\}\right), \notag
\end{align}
and inductively we obtain for all $1 \le \ell \le k-1$
\begin{align}
\partial_{\ell} L_{m}EM(n,k,s,t)
= \bigcup_{i=h}^{k} \left(EM(a_{i},i-\ell,s,t-\ell)+\{\widehat{a}_{i+1},\ldots,\widehat{a}_{k}\}\right). \notag
\end{align}
Therefore,
\begin{align}
|\partial_{\ell} L_{m}EM(n,k,s,t)|
&= \sum_{i=h}^{k} |EM(a_i,i-\ell,s,t-\ell)| \notag \\
& =  \sum_{i=h}^{k}\left(\binom{a_i}{i-\ell}-\sum_{j=0}^{t-1-\ell}\binom{s}{j}\binom{a_i}{i-\ell-j}\right) \notag\\
& = \sum_{i=h}^{k}\binom{a_i}{i-\ell} - \sum_{j=0}^{t-1-\ell} \binom{s}{j}\sum_{i=h}^{k}\binom{a_i-s}{i-\ell-j}. \notag
\end{align}
\end{proof}

\begin{lemma}\label{lemma-shadow-k-s-t-exact}
Let $s\ge t \ge 0$.
If $\mathcal{H} \subset EM(n,k,s,t)$ and $|\mathcal{H}| = m$, then
$$|\partial\mathcal{H}|\ge |\partial L_{m}EM(n,k,s,t)|.$$
\end{lemma}
\begin{proof}
By Lemma \ref{lemma-k-cascade-resp}, there exists $a_k > \cdots > a_{h} \ge \max\{t,1\}$
such that
\begin{align}
m =  \sum_{i=h}^{k}\binom{a_i}{i} - \sum_{j=0}^{t-1} \binom{s}{j}\sum_{i=h}^{k}\binom{a_i-s}{i-j}. \notag
\end{align}
Then, by Lemma \ref{lemma-size-shadow-LmEM(n,k,s,t)} it suffices to show that
\begin{align}
|\partial\mathcal{H}| \ge \sum_{i=h}^{k}\binom{a_i}{i-1} - \sum_{j=0}^{t-2}\binom{s}{j}\sum_{i=h}^{k}\binom{a_i-s}{i-1-j}. \notag
\end{align}
We prove this statement by induction on $k,s,t$.
When $s=0$ or $k=1$ the statement is trivially true.
When $t=0$ the statement follows from the Kruskal-Katona theorem.
So we may assume that $s\ge t \ge 1$ and $k\ge 2$.

\begin{claim}\label{claim-H(1)-k-s-t}
$|\mathcal{H}(1)| \ge \sum_{i=h}^{k}\binom{a_i-1}{i-1} - \sum_{j=0}^{t-2}\binom{s-1}{j}\sum_{i=h}^{k}\binom{a_i-s}{i-1-j}$.
\end{claim}
\begin{proof}[Proof of Claim \ref{claim-H(1)-k-s-t}]
Suppose not.
Then
\begin{align}
|\mathcal{H}(\bar{1})|
& = |\mathcal{H}| - |\mathcal{H}(1)| \notag\\
& > \sum_{i=h}^{k}\binom{a_i}{i} - \sum_{j=0}^{t-1}\binom{s}{j}\sum_{i=h}^{k}\binom{a_i-s}{i-j}
    -\left( \sum_{i=h}^{k}\binom{a_i-1}{i-1} - \sum_{j=0}^{t-2}\binom{s-1}{j}\sum_{i=h}^{k}\binom{a_i-s}{i-1-j} \right) \notag\\
& = \sum_{i=h}^{k}\binom{a_i}{i} - \sum_{i=h}^{k}\binom{a_i-1}{i-1}
    - \sum_{j=0}^{t-1}\left(\binom{s}{j}-\binom{s-1}{j-1}\right)\sum_{i=h}^{k}\binom{a_i-s}{i-j} \notag\\
& = \sum_{i=h}^{k}\binom{a_i-1}{i} - \sum_{j=0}^{t-1}\binom{s-1}{j}\sum_{i=h}^{k}\binom{a_i-s}{i-j}.  \notag
\end{align}
Since $\mathcal{H}(\bar{1}) \subset EM(n,k,s-1,t)$, by the induction hypothesis
\begin{align}
|\partial\mathcal{H}(\bar{1})|
>  \sum_{i=h}^{k}\binom{a_i-1}{i-1} - \sum_{j=0}^{t-2} \binom{s-1}{j}\sum_{i=h}^{k}\binom{a_i-s}{i-1-j}
> |\mathcal{H}(1)|,  \notag
\end{align}
which contradicts the assumption that $\mathcal{H}$ is shifted.
\end{proof}

Since $\mathcal{H}(1) \subset EM(n,k-1,s-1,t-1)$, by the induction hypothesis and Claim \ref{claim-H(1)-k-s-t},
\begin{align}
|\partial\mathcal{H}|
&  \ge |\mathcal{H}(1)| + |\partial\mathcal{H}(1)| \notag\\
& \ge  \sum_{i=h}^{k}\binom{a_i-1}{i-1} - \sum_{j=0}^{t-2}\binom{s-1}{j}\sum_{i=h}^{k}\binom{a_i-s}{i-1-j}  \notag\\
& \quad   + \sum_{i=h}^{k}\binom{a_i-1}{i-2} - \sum_{j=0}^{t-3}\binom{s-1}{j}\sum_{i=h}^{k}\binom{a_i-s}{i-2-j}  \notag \\
& = \sum_{i=h}^{k}\binom{a_i}{i-1} - \sum_{j=0}^{t-2}\left(\binom{s-1}{j}+\binom{s-1}{j-1}\right)\sum_{i=h}^{k}\binom{a_i-s}{i-1-j} \notag\\
& = \sum_{i=h}^{k}\binom{a_i}{i-1} - \sum_{j=0}^{t-2} \binom{s}{j}\sum_{i=h}^{k}\binom{a_i-s}{i-1-j}. \notag
\end{align}
This completes the proof of Lemma \ref{lemma-shadow-k-s-t-exact}.
\end{proof}

\begin{coro}\label{coro-ell-shadow-k-s-t-exact}
Let $s\ge t \ge 0$ and $1\le \ell \le k-1$.
Suppose that $\mathcal{H} \subset EM(n,k,s,t)$ and $|\mathcal{H}| = m$.
Then $|\partial_{\ell}\mathcal{H}|\ge |\partial_{\ell} L_{m}EM(n,k,s,t)|$.
\end{coro}
\begin{proof}
Similar to the proof of Lemma \ref{lemma-shadow-k-s-t-exact},
it suffices to show that if for some integers $a_k> \cdots > a_h\ge h\ge \max\{t,1\}$
\begin{align}
|\mathcal{H}| = \sum_{i=h}^{k}\binom{a_i}{i} - \sum_{j=0}^{t-1} \binom{s}{j}\sum_{i=h}^{k}\binom{a_i-s}{i-j}, \notag
\end{align}
then
\begin{align}
|\partial_{\ell}\mathcal{H}|
\ge \sum_{i=h}^{k}\binom{a_i}{i-\ell} - \sum_{j=0}^{t-1-\ell} \binom{s}{j}\sum_{i=h}^{k}\binom{a_i-s}{i-\ell-j}. \notag
\end{align}

We proceed by induction on $\ell$.
When $\ell = 1$, this is Lemma \ref{lemma-shadow-k-s-t-exact}.
So we may assume that $\ell \ge 2$.
By the induction hypothesis
\begin{align}
|\partial_{\ell-1}\mathcal{H}|
\ge \sum_{i=h}^{k}\binom{a_i}{i-\ell+1} - \sum_{j=0}^{t-\ell}\binom{s}{j}\sum_{i=h}^{k}\binom{a_i-s}{i-\ell+1-j}. \notag
\end{align}
Since $\partial_{\ell-1}\mathcal{H} \subset EM(n,k,s,t-\ell+1)$,
by Lemma \ref{lemma-shadow-k-s-t-exact},
\begin{align}
|\partial_{\ell}\mathcal{H}| = |\partial \partial_{\ell-1}\mathcal{H}|
\ge \sum_{i=h}^{k}\binom{a_i}{i-\ell} - \sum_{j=0}^{t-\ell-1}\binom{s}{j}\sum_{i=h}^{k}\binom{a_i-s}{i-\ell-j}. \notag
\end{align}
This completes the proof of Corollary \ref{coro-ell-shadow-k-s-t-exact}.
\end{proof}

The same induction argument as above gives the following technically simpler version of
Corollary \ref{coro-ell-shadow-k-s-t-exact}.

\begin{lemma}[Simplified version of Lemma \ref{lemma-shadow-k-s-t-exact}]\label{lemma-shadow-k-s-t-simple}
Let $s\ge t \ge 0$ and $1\le \ell \le k-1$.
Suppose that $\mathcal{H} \subset EM(n,k,s,t)$ and
$|\mathcal{H}| = \binom{x}{k} - \sum_{j=0}^{t-1}\binom{s}{j}\binom{x-s}{k-j}$ for some $x\in \mathbb{R}$.
Then $|\partial_{\ell} \mathcal{H}|\ge \binom{x}{k-\ell} - \sum_{j=0}^{t-1-\ell}\binom{s}{j}\binom{x-s}{k-\ell-j}$.
\end{lemma}

Let
\begin{align}
HM(n,k,s,t) = & \left\{ A\in\binom{[n]}{k}: |A\cap [s-1]|\ge 1\right\} \cup  \notag\\
               & \left\{A\in\binom{[n]}{k}: s\in A \text{ and } |A\cap [s+1,s+t]|\ge 1\right\}. \notag
\end{align}
Note that there is no constraint on the relation between $s$ and $t$ for $HM(n,k,s,t)$.

Similar to Lemmas \ref{lemma-decompose-LmEM(n,k,s,t}, \ref{lemma-k-cascade-resp}, and \ref{lemma-size-shadow-LmEM(n,k,s,t)}
we have the following result for $HM(n,k,s,t)$.

\begin{lemma}\label{lemma-decompose-HM(n,k,s,t)}
Let $n\ge k$. Then the following hold.
\begin{itemize}
\item[(a)] $|HM(n,k,s,t)| = \binom{n}{k} - \binom{n-s}{k} - \binom{n-s-t}{k-1}$ and $|\partial HM(n,k,s,t)| = \binom{n}{k-1}$.
\item[(b)] For every $m \le |HM(n,k,s,t)|$ there exist integers $a_{k}> \cdots > a_{h} \ge h \ge 1$ such that
\begin{align}
L_{m}HM(n,k,s,t) = HM(a_{k},k,s,t) \cup \bigcup_{i=h}^{k-1}
\left(HM(a_{i},i,s,t)+\{\widehat{a}_{i+1}, \ldots, \widehat{a}_{k}\}\right). \notag
\end{align}
\item[(c)] For every $m\ge 1$ there exists a unique sequence of integers $a_{k}> \cdots > a_{h} \ge h \ge 1$ such that
\begin{align}
m = \sum_{i=h}^{k}\binom{a_i}{i} - \sum_{i=h}^{k}\binom{a_{i}-s}{i} - \sum_{i=h}^{k}\binom{a_i-s-t}{i-1}. \notag
\end{align}
\item[(d)] If $m$ is given by the equation above, then
\begin{align}
|\partial L_{m}HM(n,k,s,t)| = \sum_{i=h}^{k}\binom{a_i}{i-1}. \notag
\end{align}
\end{itemize}
\end{lemma}

\begin{lemma}\label{lemma-shadow-HM(n,k,s,t)-exact}
If $\mathcal{H} \subset HM(n,k,s,t)$ and $|\mathcal{H}| = m$, then $|\partial\mathcal{H}|\ge |\partial L_{m}HM(n,k,s,t)|$.
In particular, if $|\mathcal{H}| = \sum_{i=h}^{k}\binom{a_i}{i} - \sum_{i=h}^{k}\binom{a_{i}-s}{i} - \sum_{i=h}^{k}\binom{a_i-s-t}{i-1}$
for some integers $a_{k}> \cdots > a_{h} \ge h \ge 1$,
then $|\partial\mathcal{H}| \ge \sum_{i=h}^{k}\binom{a_i}{i-1}$.
\end{lemma}
\begin{proof}
Let $a_{k}> \cdots > a_{h} \ge h \ge 1$ be integers such that
\begin{align}
m = \sum_{i=h}^{k}\binom{a_i}{i} - \sum_{i=h}^{k}\binom{a_{i}-s}{i} - \sum_{i=h}^{k}\binom{a_i-s-t}{i-1}.\notag
\end{align}
Then by Lemma \ref{lemma-decompose-HM(n,k,s,t)}, it suffices to show
\begin{align}
|\partial\mathcal{H}| \ge  \sum_{i=h}^{k}\binom{a_i}{i-1}=|\partial L_{m}HM(n,k,s,t)|. \notag
\end{align}

We proceed by induction on $s$ and $t$.
When $s = 0$, this is trivially true.
When $t=0$, we have $HM(n,k,s,0) = EM(n,k,s,1)$, so the conclusion follows from
Lemma \ref{lemma-shadow-k-s-t-exact}.
So we may assume that $s\ge 1$ and $t\ge 1$.

\begin{claim}\label{claim-size-H(1)-in-HM(n,k,s,t)}
$|\mathcal{H}(1)| \ge \sum_{i=h}^{k}\binom{a_i-1}{i-1}$
\end{claim}
\begin{proof}[Proof of Claim \ref{claim-size-H(1)-in-HM(n,k,s,t)}]
Suppose not. Then
\begin{align}
|\mathcal{H}(\bar{1})| = |\mathcal{H}| - |\mathcal{H}(1)|
                 > \sum_{i=h}^{k}\binom{a_i-1}{i} - \sum_{i=h}^{k}\binom{a_i-s}{i} - \sum_{i=h}^{k}\binom{a_i-s-t}{i-1}.\notag
\end{align}
Since $\mathcal{H}(\bar{1})\subset HM(n,k,s-1,t)$,
by the induction hypothesis
$|\partial\mathcal{H}(\bar{1})|> \sum_{i=h}^{k}\binom{a_i-1}{i-1} > |\mathcal{H}(1)|$,
which contradicts the assumption that $\mathcal{H}$ is shifted.
\end{proof}

Now, by Claim \ref{claim-size-H(1)-in-HM(n,k,s,t)} and the Kruskal-Katona theorem,
\begin{align}
|\partial\mathcal{H}| \ge |\mathcal{H}(1)| + |\partial\mathcal{H}(1)|
                      \ge \sum_{i=h}^{k}\binom{a_i-1}{i-1} + \sum_{i=h}^{k}\binom{a_i-1}{i-2}
                      = \sum_{i=h}^{k}\binom{a_i}{i-1}. \notag
\end{align}
This completes the proof of Lemma \ref{lemma-shadow-HM(n,k,s,t)-exact}.
\end{proof}

Similarly, the same induction argument as above gives the following technically simpler version of Lemma \ref{lemma-shadow-HM(n,k,s,t)-exact}.

\begin{lemma}[Simplified version of Lemma \ref{lemma-shadow-HM(n,k,s,t)-exact}]\label{lemma-shadow-HM(n,k,s,t)-simple}
Suppose that $\mathcal{H} \subset HM(n,k,s,t)$ and
$|\mathcal{H}| = \binom{x}{k} - \binom{x-s}{k} - \binom{x-s-t}{k-1}$ for some $x\in \mathbb{R}$.
Then $|\partial\mathcal{H}| \ge \binom{x}{k-1}$.
\end{lemma}

\subsection{Proof of Theorem \ref{thm-shadow-intersecting-all-n}}
The proof of Theorem \ref{thm-shadow-intersecting-all-n} uses the following structural theorem for intersecting families.

For $1\le t\le k-1$ let
\begin{align}
    HM(n,k,t) = & \left\{A\in EKR(n,k): A \cap [2,k] \neq \emptyset \text{ or } [k+1,k+t] \subset A \right\} \cup \notag\\
    & \bigcup_{i=1}^{t} \{\{2,\ldots,k,k+i\}\}. \notag
\end{align}
Note that $|HM(n,k,2)| = \binom{n-1}{k-1}-\binom{n-k}{k-1}+\binom{n-k-2}{k-3}+2$ and $HM(n,k,1)$ is the extremal configuration in the Hilton-Milner theorem on nontrivial intersecting families.

\begin{thm}[Han and Kohayakawa, \cite{HK17}]\label{thm-HK17-structure-HM'}
Let $k\ge 3$ and $n> 2k$ and let $\mathcal{H}$ be an $n$-vertex intersecting $k$-graph.
If $\mathcal{H} \not\subset EKR(n,k)$ and $\mathcal{H} \not\subset HM(n,k,1)$ and for $k=3$ $\mathcal{H} \not\subset EM(n,3,3,2)$ as well,
then $|\mathcal{H}| \le |HM(n,k,2)|$.
\end{thm}

\begin{proof}[Proof of Theorem \ref{thm-shadow-intersecting-all-n}]
By the assumption on the size of $\mathcal{H}$ and Theorem \ref{thm-HK17-structure-HM'},
for $k\ge 4$ either $\mathcal{H} \subset EKR(n,k)$ or $\mathcal{H} \subset HM(n,k,1)$,
and for $k=3$ we have $\mathcal{H} \subset EKR(n,3)$.

Suppose that $k=3$.
Since $\mathcal{H} \subset EKR(n,3) = EM(n,3,1,1)$, by Corollary \ref{coro-ell-shadow-k-s-t-exact},
$|\partial_{\ell}\mathcal{H}| \ge |\partial_{\ell} L_{m}EKR(n,3)|$ for $1\le \ell \le 2$.

Now suppose that $k\ge 4$.
Let $a_k> \cdots > a_h \ge h \ge 1$ be integers such that $|\mathcal{H}| = \sum_{i=h}^{k}\binom{a_i}{i} - \sum_{i=h}^{k}\binom{a_i-1}{i}$.
If $\mathcal{H} \subset EKR(n,k)=EM(n,k,1,1)$, then by Corollary \ref{coro-ell-shadow-k-s-t-exact},
$|\partial_{\ell}\mathcal{H}|\ge  |\partial_{\ell}L_{m}EM(n,k,1,1)|
=|\partial_{\ell}L_{m}EKR(n,k)|$ and we are done.
So we may assume that $\mathcal{H} \subset HM(n,k,1)$ and we are going to show that
$|\partial_{\ell}\mathcal{H}|> \sum_{i=h}^{k}\binom{a_i}{i-\ell}=|\partial_{\ell}L_{m}EKR(n,k)|$ in this case.

Suppose that $|\partial_{\ell}\mathcal{H}| \le \sum_{i=h}^{k}\binom{a_i}{i-\ell}$.
Let $\mathcal{H}' = \mathcal{H}\setminus\{\{2,\ldots,k+1\}\}$
and note that $|\partial_{\ell}\mathcal{H}'|\le|\partial_{\ell}\mathcal{H}| \le \sum_{i=h}^{k}\binom{a_i}{i-\ell}$.
Applying the the contrapositive of the Kruskal-Katona theorem to $\mathcal{H}'$ we obtain $|\partial \mathcal{H}'| \le \sum_{i=h}^{k}\binom{a_i}{i-1}$.
On the other hand, since $\mathcal{H} \subset HM(n,k,1)$, $\mathcal{H}' \subset HM(n,k,1)\setminus \{\{2,\ldots,k+1\}\} = HM(n,k,1,k)$.
So applying the contrapositive of Lemma \ref{lemma-shadow-HM(n,k,s,t)-exact}
to $\mathcal{H}'$ we obtain
\begin{align}
|\mathcal{H}|
\le |\mathcal{H}'|+1
& \le \sum_{i=h}^{k}\binom{a_i}{i} - \sum_{i=h}^{k}\binom{a_i-1}{i} - \sum_{i=h}^{k}\binom{a_i-1-k}{i-1} + 1 \notag\\
& = \sum_{i=h}^{k}\binom{a_i-1}{i-1} - \sum_{i=h}^{k}\binom{a_i-1-k}{i-1} + 1. \notag
\end{align}

\begin{claim}\label{claim-size-a_k-a_k-1}
$a_k \ge 2k$ and if $a_k = 2k$ then $a_{k-1} = 2k-1$.
\end{claim}
\begin{proof}[Proof of Claim \ref{claim-size-a_k-a_k-1}]
First, suppose that $a_k \le 2k-1$. Then
\begin{align}
|\mathcal{H}|   & \le \sum_{i=h}^{k}\binom{a_i-1}{i-1} - \sum_{i=h}^{k}\binom{a_i-1-k}{i-1} + 1 \notag\\
                & \le \sum_{i=1}^{k}\binom{k+i-2}{i-1} - \sum_{i=1}^{k}\binom{i-2}{i-1} + 1 \notag\\
                &  =   \binom{2k-1}{k-1} + 1
                   <  \binom{2k}{k-1}-\binom{k}{k-1}-\binom{k-1}{k-2} +3, \notag
\end{align}
which contradicts the assumption that  $|\mathcal{H}| > |HM(n,k,2)|$ and $n> 2k$.
Therefore, $a_k \ge 2k$.

Now suppose that $a_k = 2k$ and $a_{k-1}\le 2k-2$.
Then,
\begin{align}
|\mathcal{H}|   & \le \sum_{i=h}^{k}\binom{a_i-1}{i-1} - \sum_{i=h}^{k}\binom{a_i-1-k}{i-1} + 1 \notag\\
                & \le \binom{2k-1}{k-1} + \sum_{i=1}^{k-1}\binom{k+i-2}{i-1} - \sum_{i=1}^{k}\binom{i-2}{i-1} \notag\\
                &  =   \binom{2k-1}{k-1} + \binom{2k-2}{k-2}
                   <  \binom{2k}{k-1}-\binom{k}{k-1}-\binom{k-1}{k-2} +3, \notag
\end{align}
where the strict inequality uses $k \ge 4$ and $n>2k$. This contradicts the assumption that  $|\mathcal{H}| > |HM(n,k,2)|$.
\end{proof}

Claim \ref{claim-size-a_k-a_k-1} implies that $\sum_{i=h}^{k}\binom{a_i-1-k}{i-1} - 1 > 0$.
Therefore, $$|\mathcal{H}| \le \sum_{i=h}^{k}\binom{a_i-1}{i-1} - \sum_{i=h}^{k}\binom{a_i-1-k}{i-1} + 1 < \sum_{i=h}^{k}\binom{a_i-1}{i-1},$$
contradicts the assumption that $|\mathcal{H}| = \sum_{i=h}^{k}\binom{a_i}{i} - \sum_{i=h}^{k}\binom{a_i-1}{i} = \sum_{i=h}^{k}\binom{a_i-1}{i-1}$.
Therefore, if $\mathcal{H} \subset HM(n,k,1)$, then $|\partial_{\ell}\mathcal{H}|> \sum_{i=h}^{k}\binom{a_i}{i-\ell}$,
and this completes the proof of Theorem \ref{thm-shadow-intersecting-all-n}.
\end{proof}

\subsection{Proof of Theorem \ref{thm-shadow-t-intersecting-all-n}}
In this section we prove Theorem \ref{thm-shadow-t-intersecting-all-n}. We need the following  theorem for $t$-intersecting families.

\begin{thm}[Ahlswede and Khachatrian, \cite{AK96}]\label{thm-nontrivial-t-intersecting-AK96}
Let $t\ge 1, k\ge 3$, and $n> (t+1)(k-t+1)$.
Suppose that $\mathcal{H} \subset \binom{[n]}{k}$ is a $t$-intersecting family
and
\begin{align}
|\mathcal{H}| = m >
\begin{cases}
\max\left\{|AK(n,k,t)|,|EM(n,k,t+2,t+1)|\right\}, & \text{ if } t < \frac{k-1}{2}, \\
|EM(n,k,t+2,t+1)|, & \text{ if } t \ge \frac{k-1}{2}.
\end{cases}\notag
\end{align}
Then $\mathcal{H} \subset EM(n,k,t,t)$.
\end{thm}

\begin{proof}[Proof of Theorem \ref{thm-shadow-t-intersecting-all-n}]
Suppose $\mathcal{H}$ is given as in Theorem~\ref{thm-shadow-t-intersecting-all-n}.
By Theorem \ref{thm-nontrivial-t-intersecting-AK96},
$\mathcal{H} \subset EM(n,k,t,t)$ and by Corollary \ref{coro-ell-shadow-k-s-t-exact}, we have $|\partial_{\ell}{\mathcal H}| \ge |\partial_{\ell}L_mEM(n,k,t,t)|$.

We now show that the value of $m(n,k,t)$ in the theorem cannot be reduced for $t \ge \frac{k-1}{2}$
and is tight up to a constant multiplicative factor for $t < \frac{k-1}{2}$.
Indeed, our construction is $\mathcal{H} = EM(n,k,t+2, t+1)$ and hence it suffices to prove the following.

\begin{fact} \label{fact1.7}
Let $n$ be sufficiently large and $m=|EM(n,k,t+2,t+1)|$.
Then $$|\partial_{\ell} EM(n,k,t+2,t+1)| < |\partial_{\ell} L_{m}EM(n,k,t,t)| \quad \text{ for all } \quad 1 \le \ell \le t.$$
In particular, for $1 \le \ell \le t$
the lower bound $m(n,k,t)$ for $|\mathcal{H}|$ in Theorem \ref{thm-shadow-t-intersecting-all-n} cannot be reduced to be less than $|EM(n,k,t+2,t+1)| \sim (t+2)\binom{n}{k-t-1}$.
\end{fact}

Note that when $t < \frac{k-1}{2}$ Fact \ref{fact1.7} implies that the constant multiplicative factor
is at most $|AK(n,k,t)|/|EM(n,k,t+2,t+1)| \sim \frac{k-t+1}{t+2}$ which is independent of $n$.

Let $x\in \mathbb{R}$ such that $\binom{x-t}{k-t} = |EM(n,k,t+2,t+1)| = (t+2)\binom{n-t-2}{k-t-1}+\binom{n-t-2}{k-t-2}$,
then $x = \Theta(n^{\frac{k-t-1}{k-t}})$.
Applying Lemma \ref{lemma-size-shadow-LmEM(n,k,s,t)} to $EM(n,k,t,t)$, we obtain
\begin{align}
|\partial_{\ell} L_{m}EM(n,k,t,t)|
& \ge \sum_{i= t-\ell}^{k-\ell}\binom{t}{i}\binom{x-t}{k-\ell-i} \notag\\
& = \binom{t}{t-\ell}\binom{x-t}{k-t} + (1+o(1))\binom{t}{t-\ell+1}\binom{x-t}{k-t-1} \notag\\
& = (t+2)\binom{t}{t-\ell}\binom{n}{k-t-1} + \Theta(n^{\frac{(k-t-1)^2}{k-t}}), \notag
\end{align}
and
\begin{align}
|\partial_{\ell} EM(n,k,t+2,t+1)|
& = \sum_{i=t+1-\ell}^{k-\ell}\binom{t+2}{i}\binom{n-t+2}{k-\ell-i} \notag\\
& = \binom{t+2}{t+1-\ell}\binom{n}{k-t-1} + \Theta(n^{k-t-2}). \notag
\end{align}

If $\ell < t$, then
$$|\partial_{\ell} L_{m}EM(n,k,t,t)| \sim (t+2)\binom{t}{t-\ell}\binom{n}{k-t-1} $$
and
$$|\partial_{\ell} EM(n,k,t+2,t+1)| \sim \binom{t+2}{t+1-\ell}\binom{n}{k-t-1}.$$
Since $\binom{t+2}{t+1-\ell} < (t+2)\binom{t}{t-\ell}$ for $\ell < t$,
$$|\partial_{\ell} EM(n,k,t+2,t+1)| < |\partial_{\ell} L_{m}EM(n,k,t,t)|$$ for large $n$.

If $\ell = t$, then $$|\partial_{\ell} L_{m}EM(n,k,t,t)| \sim (t+2)\binom{n}{k-t-1} + \Theta(n^{\frac{(k-t-1)^2}{k-t}})$$
and $$|\partial_{\ell} EM(n,k,t+2,t+1)| \sim (t+2)\binom{n}{k-t-1} + \Theta(n^{k-t-2}).$$
Since $\frac{(k-t-1)^2}{k-t} > k-t-2$,
$$|\partial_{t+1} EM(n,k,t+2,t+1)| < |\partial_{t+1} L_{m}EM(n,k,t,t)|$$ for large $n$. Consequently, Fact~\ref{fact1.7} holds and the proof is complete.
\end{proof}

\subsection{Proof of Theorem \ref{thm-EM(n,k,s)-n^k-2}}
Before proving Theorem \ref{thm-EM(n,k,s)-n^k-2} we need some structure theorems for
a family with large size and a given matching number.

\begin{dfn}
Let $n\ge sk+1$, $k \ge 3$, and $s\ge 1$.
Let $v_0,\ldots, v_{s-1} \in [n]$ be distinct vertices, $T_1,\ldots, T_s \subset [n]$ be pairwise disjoint $k$-sets,
and $v_i \in T_i$ for all $1\le i \le s-1$, and $v_0 \not\in T_i$ for all $1\le i \le s$.
Let
\begin{align}
PF(n,k,s) & = \left\{ T_1,\ldots, T_s \right\} \cup \notag\\
            & \quad \left\{A\in \binom{[n]}{k}:  \exists 0\le i \le s-1 \text{ such that } x_i\in A \text{ and } |A\cap \bigcup_{j=i+1}^{s}T_i|\ge 1 \right\}. \notag
\end{align}
\end{dfn}
Notice that $|PF(n,k,s)| \sim k\binom{s+1}{2}\binom{n}{k-2}$.

\begin{thm}[Kostochka and Mubayi, \cite{KM17}]\label{thm-KM17-induction-n^k-2}
For every $k\ge 3$, $s\ge t \ge 2$, there exists $n_0$ such that the following holds for all $n\ge n_0$.
Suppose that $\mathcal{H} \subset \binom{[n]}{k}$ satisfies $\nu(\mathcal{H}) = s$ and
\begin{align}
|\mathcal{H}| >
\begin{cases}
|EM(n,3,s-t,1)| + |EM(n-s+t,3,2s+1,2)| & \text{ if } k=3, \\
|EM(n,k,s-t,1)| + |PF(n-s+t, k, t)| & \text{ if } k \ge 4.
\end{cases}\notag
\end{align}
Then there exists $X \subset [n]$ with $|X| = s-t+1$ such that $\nu(H-X) = t-1$.
The bound on $|\mathcal{H}|$ is tight.
In particular, if
\begin{align}
|\mathcal{H}| >
\begin{cases}
|EM(n,3,2s+1,2)| & \text{ for } k=3, \\
|PF(n, k, s)| & \text{ for } k \ge 4,
\end{cases}\notag
\end{align}
then there exists $v \in [n]$ such that $\nu(H-v) = s-1$.
\end{thm}

Note that the proof of Theorem \ref{thm-KM17-induction-n^k-2} was not included in \cite{KM17},
but one can easily prove it using results in \cite{FR18} (Theorems 4.1 and 4.2 in \cite{FR18}).

We also need the following structure theorems for intersecting families.  Let
\begin{itemize}
\item $H_{0}^{3}(n) = \left\{ A \in \binom{[n]}{3}: |A\cap [3]|\ge 2 \right\}$.
\item $H_{1}^{3}(n) = \left\{ A \in \binom{[n]}{3}: 1\in A \text{ and } |A\cap \{2,3,4\}|\ge 1 \right\} \cup \{234\}$.
\item $H_{2}^{3}(n) = \left\{ A \in \binom{[n]}{3}: 1\in A \text{ and } |A\cap \{2,3\}|\ge 1 \right\} \cup \{234,235,145\}$.
\item $H_{3}^{3}(n) = \left\{ A \in \binom{[n]}{3}: \{1,2\}\in A \right\} \cup \{134,135,145,234,235,245\}$.
\item $H_{4}^{3}(n) = \left\{ A \in \binom{[n]}{3}: \{1,2\}\in A \right\} \cup \{ 134, 156, 235, 236, 245, 246 \}$.
\item $H_{5}^{3}(n) = \left\{ A \in \binom{[n]}{3}: \{1,2\}\in A \right\} \cup \{ 134, 156, 136, 235, 236, 246 \}$.
\item For $k\ge 4$ and $0\le i \le 5$, $H_{i}^{k}(n)=\left\{ A \in \binom{[n]}{k}: \exists B\in H_{i}^{3}(n) \text{ such that } B\subset A \right\}$.
\end{itemize}

\begin{fact}\label{fact-size-Hi(n)}
The following holds for all $n\ge k \ge 3$.
\begin{itemize}
\item $|H_{0}^{k}(n)| = 3\binom{n-3}{k-2} + \binom{n-3}{k-3} < 3\binom{n}{k-2} - 2\binom{n}{k-3}$.
\item $|H_{1}^{k}(n)| = 3\binom{n-4}{k-2} + 4\binom{n-4}{k-3} + \binom{n-4}{k-4} < 3\binom{n}{k-2} - 2\binom{n}{k-3}$.
\item $\max\{|H_{i}^{k}(n)|: 2\le i \le 5\} \le 2 \binom{n}{k-2}$.
\end{itemize}
\end{fact}

\begin{dfn}
Let $n\ge 2k$ and $k \ge 3$.
Let $Y = [2,k+1], Z=[k+2,2k]$. The $n$-vertex $k$-graph $PF(n,k)$ consists of all $k$-subsets of $[n]$ containing a member
of the family
\begin{align}
G = & \left\{ A: 1\in A\text{ and } |A\cap Y| = 1\text{ and } |A\cap Z|= 1 \right\}  \cup \notag\\
    & \left\{ Y, \{1,k,k+1\}, Z\cup \{k\},Z\cup \{k+1\} \right\}.\notag
\end{align}
\end{dfn}
Note that $|PF(n,k)| = O(n^{k-3})$.

\begin{thm}[Kostochka and Mubayi, \cite{KM17}]\label{thm-MK17-structure-nv(H)=s-stability}
Let $k\ge 4$ be fixed and $n$ be sufficiently large.
Then there is $C>0$ such that for every intersecting $n$-vertex $k$-graph $\mathcal{H}$ with $|\mathcal{H}|>|PF(n,k)| = O(n^{k-3})$,
one can remove from $\mathcal{H}$ at most $Cn^{k-4}$ edges
so that the resulting $k$-graph $\mathcal{H}'$ is contained in one of
$H_{0}^{k}(n),\ldots,H_{5}^{k}(n),EKR(n,k)$.
\end{thm}

For intersecting $3$-graphs there is a stronger result.
Define
\begin{align}
\tau(\mathcal{H}) = \min\{|S|: S\subset V(\mathcal{H}) \text{ and } |S\cap A|\ge 1 \text{ for all } A\in \mathcal{H}\}. \notag
\end{align}

\begin{thm}[Kostochka and Mubayi, \cite{KM17}]\label{thm-MK17-structure-1}
Let $\mathcal{H}$ be an intersecting $3$-graph and $n = |V(\mathcal{H})| \ge 6$.
If $\tau(\mathcal{H})\le 2$, then $\mathcal{H}$ is contained in one of
$EKR(n,3),H_{1}^{3}(n),\ldots,H_{5}^{3}(n)$.
\end{thm}

The following result shows that the size of an intersecting $3$-graph $\mathcal{H}$ with $\tau(\mathcal{H})\ge 3$ is bounded by a constant.

\begin{thm}[Frankl, \cite{FR80}]\label{thm-Frankl-cover-number-3}
Let $k\ge 3$ and $n$ be sufficiently large.
Then every intersecting $n$-vertex $k$-graph $\mathcal{H}$ with $\tau(\mathcal{H})\ge 3$
satisfies $|\mathcal{H}|\le |PF(n,k)|$.
Moreover, if $k\ge 4$, then equality holds only if $\mathcal{H} \cong PF(n,k)$.
\end{thm}

Now we are ready to prove Theorem \ref{thm-EM(n,k,s)-n^k-2}.

\begin{proof}[Proof of Theorem \ref{thm-EM(n,k,s)-n^k-2}]
Let $n$ be sufficiently large and $c = c(k,s)$ be given by $(\ref{hlowerc})$.
We may assume that $\mathcal{H}$ is shifted and $\nu(\mathcal{H})=s$.
For every $v\in [n]$ let $d_{\mathcal{H}}(v) = |\{A\in \mathcal{H}: v\in A\}|$,
and let $\Delta = \max\{d_{\mathcal{H}}(v) : v\in [n]\}$.
Suppose that $m = \sum_{i=h}^{k}\binom{a_i}{i} - \sum_{i=h}^{k}\binom{a_i-s}{i}$ for some integers $a_{k}> \cdots > a_{h} \ge h\ge 1$.
Then by Lemma \ref{lemma-size-shadow-LmEM(n,k,s,t)}, it suffice to show that
\begin{align}
|\partial\mathcal{H}| \ge \sum_{i=h}^{k}\binom{a_i}{i-1}
=|\partial L_{m}EM(n,k,s,1)|. \notag
\end{align}
Note that  $a_k \rightarrow \infty$ as $n \rightarrow \infty$
and so $m \sim s{a_k-1 \choose k-1}$.
\begin{claim}\label{claim-max-degree-H}
$\Delta \le \sum_{i=h}^{k} \binom{a_i-1}{i-1} = (1+o(1))\frac{m}{s}$.
\end{claim}
\begin{proof}[Proof of Claim \ref{claim-max-degree-H}]
Suppose that there exists $v\in [n]$ with $d_{\mathcal{H}}(v) > \sum_{i=h}^{k} \binom{a_i-1}{i-1}$.
Let $\mathcal{H}(v) = \{A \setminus \{v\} : v\in A \in \mathcal{H}\}$.
Then by the Kruskal-Katona theorem,
\begin{align}
|\partial\mathcal{H}| \ge |\mathcal{H}(v)| + |\partial\mathcal{H}(v)|
> \sum_{i=h}^{k} \binom{a_i-1}{i-1} +  \sum_{i=h}^{k} \binom{a_i-1}{i-2}
= \sum_{i=h}^{k} \binom{a_i}{i-1}, \notag
\end{align}
and we are done.
\end{proof}

We are going to use Theorem \ref{thm-KM17-induction-n^k-2} and Claim \ref{claim-max-degree-H}
to define a sequence of distinct vertices $v_1,\ldots, v_{s-1}$ and a sequence of $k$-graphs $\mathcal{H}_1,\ldots, \mathcal{H}_{s-1}$
such that $\nu(\mathcal{H}_i) = s-i$ and $|\mathcal{H}_i| > (1-o(1))\frac{s-i}{s} m$ for all $1\le i \le s-1$.
Since $\mathcal{H}$ is shifted, we may assume that $v_i = i$ for $1 \le i \le s-1$.

First, by the assumption on the size of $\mathcal{H}$ and Theorem \ref{thm-KM17-induction-n^k-2},
there exists $v_1 \in [n]$ such that $\mathcal{H}_1 := \mathcal{H}-v_1$ satisfies $\nu(\mathcal{H}_1) = s-1$.
By Claim \ref{claim-max-degree-H}, $d_{\mathcal{H}}(v_1) < (1+o(1))m/s$, so $|\mathcal{H}_1| > (1-o(1))\frac{s-1}{s}m$.

Now suppose that we have defined $\mathcal{H}_i$ for some $1\le i \le s-2$ such that
$\nu(\mathcal{H}_i) = s-i$ and $|\mathcal{H}_i| > (1-o(1))\frac{s-i}{s} m$.
Since
\begin{align}
|\mathcal{H}_i|
> (1-o(1)) \frac{s-i}{s} m
 \ge\frac{s-i}{s} c\binom{n}{k-2}  \ge
\begin{cases}
|EM(n,3,2(s-i)+1,2)|, & \text{ for } k=3, \\
|PF(n, k, s-i)|, & \text{ for } k \ge 4,
\end{cases}\notag
\end{align}
by Theorem \ref{thm-KM17-induction-n^k-2},
there exists $v_{i+1} \in [n]$ such that $\mathcal{H}_{i+1} := \mathcal{H}_{i}-v_{i+1}$ satisfies $\nu(\mathcal{H}_{i+1}) = s-i-1$.
By Claim \ref{claim-max-degree-H}, $|\mathcal{H}_{i+1}| > (1-o(1))\frac{s-i-1}{s}m$.

Note that $\mathcal{H}_{s-1}$ satisfies $\nu(\mathcal{H}_{s-1}) = 1$ and
\begin{align}
|\mathcal{H}_{s-1}| > (1-o(1))\frac{1}{s} m \ge \frac{1}{s} c \binom{n}{k-2} \ge 3\binom{n}{k-2} > |PF(n,k)|. \notag
\end{align}

If $k=3$, then by Theorem \ref{thm-Frankl-cover-number-3}, $\tau(\mathcal{H}_{s-1}) \le 2$.
Therefore, by Theorem \ref{thm-MK17-structure-1}, $\mathcal{H}$ is contained in one of $EKR(n,3),H_{1}^{3}(n),\ldots,H_{5}^{3}(n)$.
Since $|\mathcal{H}_{s-1}| > 3n$ and
by Fact \ref{fact-size-Hi(n)}, $\max_{0\le i \le 5}\{|H_{i}^{3}|\} \le  3n-8$,
we must have $\mathcal{H} \subset EKR(n,3) = EM(n,3,1,1)$.
Note that $\mathcal{H}_{s-1}$ is obtained from $\mathcal{H}$ by removing $s-1$ vertices, so $\mathcal{H} \subset EM(n,3,s,1)$.
Therefore, by Lemma \ref{lemma-shadow-k-s-t-exact}, $|\partial\mathcal{H}| \ge |\partial L_{m}EM(n,3,s,1)|$
and we are done.

Now we may assume that $k\ge 4$.
Then, by Theorem~\ref{thm-MK17-structure-nv(H)=s-stability}, one can remove at most $Cn^{k-4}$ edges from $\mathcal{H}_{s-1}$
such that the resulting $k$-graph $\mathcal{H}'$ is contained in one of $H_{0}^{k}(n),\ldots,H_{5}^{k}(n)$, $EKR(n,k)$.
Note that $|\mathcal{H}'| \ge |\mathcal{H}_{s-1}| - Cn^{k-4} > 3\binom{n}{k-2} - \binom{n}{k-3}$
and by Fact \ref{fact-size-Hi(n)}, $\max_{0\le i \le 5}\{|H_{i}^{k}|\} < 3\binom{n}{k-2} - 2\binom{n}{k-3}$,
so $\mathcal{H}' \subset EKR(n,k) = EM(n,k,1,1)$.
Here we need $n$ to be sufficient large so that $Cn^{k-4} < \binom{n}{k-3}$.

Note that $\mathcal{H}_{s-1}$ is obtained from $\mathcal{H}$ by removing $s-1$ vertices.
If $\mathcal{H}_{s-1} \subset EM(n,k,1,1)$, then $\mathcal{H} \subset EM(n,k,s,1)$ and by Lemma \ref{lemma-shadow-k-s-t-exact} we are done.
So we may assume that $\mathcal{H}_{s-1} \not\subset EM(n,k,1,1)$, i.e. $\mathcal{H}_{s-1} \setminus \mathcal{H}' \neq \emptyset$.
Let $A \in \mathcal{H}_{s-1} \setminus \mathcal{H}'$ and since $\mathcal{H}_{s-1}$ is shifted,
we may assume that $A = \{s+1,\ldots,s+k\}$.
Since $\mathcal{H}_{s-1}$ is intersecting, every edge in $\mathcal{H}'$ must have nonempty intersecting with $A$.
So $\mathcal{H}' \subset HM(n,k,1,k)$.
This implies that
one can remove at most $Cn^{k-4}$ edges from $\mathcal{H}$ such that the resulting $k$-graph $\mathcal{H}''$
satisfies $\mathcal{H}'' \subset HM(n,k,s,k)$.

Let $y\in \mathbb{R}$ satisfy $|\mathcal{H}''| = \binom{y}{k} - \binom{y-s}{k}-\binom{y-s-k}{k-1}$.
Then by Lemma \ref{lemma-shadow-HM(n,k,s,t)-simple},
$|\partial\mathcal{H}|\ge |\partial\mathcal{H}''| \ge \binom{y}{k-1}$.
Let $x\in \mathbb{R}, a_{k}, \ldots, a_h \in \mathbb{N}$ such that $a_k > \cdots >a_h\ge h \ge 1$
and $|\mathcal{H}| = \binom{x}{k}-\binom{x-s}{k} = \sum_{i=h}^{k}\binom{a_i}{i} - \sum_{i=h}^{k}\binom{a_i-s}{i}$.
It is easy to see that $x \le a_{k}+1$.

\begin{claim}\label{claim-y-ge-x+1}
$y > x+1$.
\end{claim}
\begin{proof}[Proof of Claim \ref{claim-y-ge-x+1}]
Suppose not. Then
\begin{align}
& \binom{x+1}{k}-\binom{x+1-s}{k} -\binom{x+1-s-k}{k-1} \notag\\
\ge & \binom{y}{k}-\binom{y-s}{k} -\binom{y-s-k}{k-1}
\ge \binom{x}{k} - \binom{x-s}{k} - Cn^{k-4}. \notag
\end{align}
Since $|\mathcal{H}| \ge c\binom{n}{k-2}$, $x = \Omega(n^{\frac{k-2}{k-1}})$.
Therefore,
\begin{align}
& \binom{x+1}{k}-\binom{x+1-s}{k} -\binom{x+1-s-k}{k-1} \notag\\
= & \binom{x}{k} - \binom{x-s}{k} + \binom{x}{k-1}-\binom{x-s}{k-1} - \binom{x+1-s-k}{k-1} \notag\\
< & \binom{x}{k} - \binom{x-s}{k} - \frac{1}{2}\binom{x-s-k}{k-1} \notag\\
< & \binom{x}{k} - \binom{x-s}{k} - Cn^{k-4}, \notag
\end{align}
a contradiction. This completes the proof of Claim \ref{claim-y-ge-x+1}.
\end{proof}

By Claim \ref{claim-y-ge-x+1},
\begin{align}
|\partial\mathcal{H}|\ge \binom{y}{k-1} > \binom{x+1}{k-1} \ge \sum_{i=h}^{k}\binom{a_i}{i-1}. \notag
\end{align}
This completes the proof of Theorem \ref{thm-EM(n,k,s)-n^k-2}.
\end{proof}

\section{Concluding Remarks}
Let $\mathcal{H} \subset \binom{[n]}{3}$ be an intersecting family with $|\mathcal{H}| \ge PF(n,3) = 10$.
Then Theorems \ref{thm-MK17-structure-1} and \ref{thm-Frankl-cover-number-3}
completely determine the structure of $\mathcal{H}$.
One can use this structural result to determine the minimum size of $|\partial_{\ell} \mathcal{H}|$ completely for $1\le \ell \le 2$.
However, the calculation is very complicated and tedious, so we omit it here.

As we mentioned before, for $1 \le \ell \le t$ the lower bound for $|\mathcal{H}|$ in Theorem \ref{thm-shadow-t-intersecting-all-n}
above is tight for $t \ge \frac{k-1}{2}$ and can be improved for $t < \frac{k-1}{2}$.
Indeed, one can use the $\Delta$-system method (see \cite{KM17}) to prove the following result.

\begin{thm}\label{thm-t-intersecting-second-level}
Let $t\ge 1$, $k\ge 3$, $\epsilon>0$, and $n$ be sufficiently large.
Suppose that $\mathcal{H} \subset \binom{[n]}{k}$ is $t$-intersecting.
If $t < \frac{k-1}{2}$ and $|\mathcal{H}| > (k-t+\epsilon)\binom{n}{k-t-1}$,
then either $\mathcal{H} \subset AK(n,k,t)$ or $\mathcal{H} \subset EM(n,k,t,t)$.
If $t\ge \frac{k-1}{2}$ and $|\mathcal{H}| > (t+1+\epsilon)\binom{n}{k-t-1}$,
then $\mathcal{H}$ is contained in one of $AK(n,k,t), EM(n,k,t+2,t+1), EM(n,k,t,t)$.
\end{thm}

One can easily use Corollary \ref{coro-ell-shadow-k-s-t-exact} to show that for $1\le \ell \le t$,
$|\partial_{\ell} L_{m}AK(n,k,t)| > |\partial_{\ell} L_{m}EM(n,k,t,t)|$ for sufficiently large $n$ and $m$.
Therefore, by Theorem \ref{thm-t-intersecting-second-level}, we obtain the following result.

\begin{fact}
Let $k\ge 3$, $t <\frac{k-1}{2}$, $1\le \ell \le t$, $\epsilon>0$, and $n$ be sufficiently large.
Then every $t$-intersecting family $\mathcal{H} \subset \binom{[n]}{k}$ with $|\mathcal{H}| = m > (k-t+\epsilon)\binom{n}{k-t-1}$
satisfies $|\partial_{\ell}\mathcal{H}| \ge |\partial_{\ell} L_{m}EM(n,k,t,t)|$.
\end{fact}
\bibliographystyle{abbrv}


Identification of linear time-invariant systems with Dynamic Mode Decomposition

Abstract: Dynamic mode decomposition (DMD) is a popular data-driven framework to extract linear dynamics from complex high-dimensional systems. In this work, we study the system identification properties of DMD. We first show that DMD is invariant under linear transformations in the image of the data matrix. If, in addition, the data is constructed from a linear time-invariant system, then we prove that DMD can recover the original dynamics under mild conditions. If the linear dynamics are discretized with a Runge-Kutta method, then we further classify the error of the DMD approximation and detail that for one-stage Runge-Kutta methods even the continuous dynamics can be recovered with DMD. A numerical example illustrates the theoretical findings.

\section{Introduction}

Dynamical systems play a fundamental role in many modern modeling approaches of physical and chemical phenomena. The need for high fidelity models often results in large-scale dynamical systems, which are computationally demanding to solve, analyze, and optimize. Thus the last three decades have seen significant efforts to replace the so-called full-order model, which is considered the \emph{truth model}, with a computationally cheaper surrogate model \cite{BenCOW17,BauBF14,QuaMN16,Ant05,BenGW15,HesRS16,AntBG20}. Often, the surrogate model is constructed by projecting the dynamical system onto a low-dimensional manifold, thus requiring a state-space description of the differential equation.

If a mathematical model is not available or not suited for modification,
data-driven methods like the \emph{Loewner framework} \cite{MayA07,BeaG12},
\emph{vector fitting} \cite{GusS99,DrmGB15a,DrmGB15b}, \emph{operator inference}
\cite{PehW16}, or \emph{dynamic mode decomposition}
(\textsf{DMD}\xspace) \cite{KutBBP16} may be used to create a low-dimensional realization
directly from measurement or simulation data of the system. Suppose the dynamical system that creates the data is linear. In that case, the Loewner framework and vector fitting are -- under some technical assumptions -- able to recover the original dynamical system and hence serve as system identification tools. Despite the popularity of \textsf{DMD}\xspace, a similar analysis seems to be missing, and this paper aims to close this gap.

Since \textsf{DMD}\xspace creates a discrete, linear time-invariant dynamical system from data, we are interested answering the following questions:
\begin{enumerate}
	\item What is the impact of transformations of the data on the resulting \textsf{DMD}\xspace approximation?
	\item Assume that the data used to generate the \textsf{DMD}\xspace approximation is obtained from a linear differential equation. Can we estimate the error between the continuous dynamics and the \textsf{DMD}\xspace approximation?
	\item Are there situations in which we are even able to recover the original dynamical system from the \textsf{DMD}\xspace approximation?
\end{enumerate}

It is essential to know, how the data for the construction of the \textsf{DMD}\xspace model is generated to answer these questions. Assuming exact measurements of the solution may be valid from a theoretical perspective only. Instead, we take the view of a numerical analyst and assume that the data is obtained via time integration of the dynamics with a general \emph{Runge-Kutta method} (\textsf{RKM}\xspace) with known order of convergence. Thus we can summarize the questions graphically as in \Cref{fig:problemSetup}. Hereby the dashed line represents the questions that we aim to answer in this paper.

\begin{figure}[ht]
	\centering
	\begin{tikzpicture}[auto,node distance=3.4cm]
		\node[entity] (dynSys) {$\dot{x} = Fx$};
		\node[entity] (discSys) [below = of dynSys]	{$x_{i+1} = Ax_{i}$};
		\node[entity] (data) [right = of discSys] {$(x_i)_{i=0}^{m}$};
		\node[entity] (transformedData) [right = of data] {$(\tilde{x}_i\vcentcolon=Tx_i)_{i=0}^{m}$};
		\node[entity] (dmdSys) [above = of data]	{$\tilde{x}_{i+1} = A_{\mathrm{DMD}}\tilde{x}_i$};
		\node[entity] (transformedDmdSys) [above = of transformedData]	{$\tilde{x}_{i+1} = \tilde{A}_{\mathrm{DMD}}\tilde{x}_i$};

		\path[->,very thick] (dynSys) edge node[align=center,xshift=-2.5cm] {time\\discretization\\\cref{subsec:RKM}} (discSys);
      	\draw[->, very thick] (discSys) -- node[align=center,yshift=-1.5em] {data\\generation} (data);
      	\path[->,very thick] (data) edge node[align=center,xshift=2cm] {\textsf{DMD}\xspace\\\cref{subsec:DMD}} (dmdSys);
      	\path[->,very thick] (data) edge node[align=center,yshift=-1.4em] {data\\transformation} (transformedData);
      	\path[->,very thick] (transformedData) edge node[align=center,xshift=-.2cm] {\textsf{DMD}\xspace\\\cref{subsec:DMD}} (transformedDmdSys);

      	\path[<-,dashed,very thick] (dynSys) edge node[align=center,yshift=-1.5em] {error analysis\\identification\\[.5em]\cref{subsec:continuousTime}} (dmdSys);
      	\path[<-,dashed,very thick] (dmdSys) edge node[align=center,yshift=-1.5em] {transformation\\invariance\\[.5em]\cref{subsec:dataTransformation}} (transformedDmdSys);
      	\path[<-,dashed,very thick] (discSys) edge node[align=center,xshift=3.5em,yshift=1em,rotate=40] {identification\\[.5em]\cref{subsec:discreteTime}} (dmdSys);
	\end{tikzpicture}
	\caption{Problem setup}
	\label{fig:problemSetup}
\end{figure}

\noindent Our main results are the following:
\begin{itemize}
	\item We show in \Cref{thm:invariance} that \textsf{DMD}\xspace is invariant in the image of the data under linear transformations of the data.
	\item \Cref{thm:exactDMD} details that \textsf{DMD}\xspace is able to identify to discrete-time dynamics, i.e., for every initial value in the image of the data, the \textsf{DMD}\xspace approximation exactly recovers the discrete-time dynamics.
	\item In Theorem~\ref{thm:DMDapproximationError} we show that if the \textsf{DMD}\xspace approximation is constructed with data that is obtained via a \textsf{RKM}\xspace, then the approximation error of \textsf{DMD}\xspace with respect to the ordinary differential equation is in the order of the error of the \textsf{RKM}\xspace. If a one-stage \textsf{RKM}\xspace is used and the data is sufficiently rich, then the continous-time dynamics, i.e., the matrix $F$ in \Cref{fig:problemSetup} can be recovered, cf.~\Cref{lem:exactRKDMD}.
\end{itemize}

To render the manuscript self-contained, we recall important definitions and results for \textsf{RKM}\xspace and \textsf{DMD}\xspace in the upcoming \cref{subsec:RKM,subsec:DMD}, respectively, before we present our analysis in \cref{sec:errorAnalysis}. We conclude with a numerical example to confirm the theoretical findings.

\subsection*{Notation}
As is standard, $\mathbb{N}$ and $\mathbb{R}$ denote the positive integers and the real numbers, respectively. For any $n,m\in\mathbb{N}$, we denote with $\mathbb{R}^{n\times m}$ the set of $n\times m$ matrices with real entries. The set of nonsingular matrices of size $n\times n$ is denoted with $\GL{n}{\mathbb{R}}$. Let $A=[a_{ij}]\in\mathbb{R}^{n\times m}$, $B\in\mathbb{R}^{p\times q}$, and $x_i\in\mathbb{R}^{n}$ ($i=1,\ldots,k$). The transpose and the Moore-Penrose pseudoinverse of $A$ are denoted with $A^T$ and $\pseudo{A}$, respectively. The Kronecker product $\otimes$ is defined as

\begin{displaymath}
	A\otimes B \vcentcolon= \left[\begin{smallmatrix} a_{11}B & \cdots & a_{1m}B\\
		\vdots & & \vdots\\
		a_{n1}B & \cdots & a_{nm}B
	\end{smallmatrix}\right]\in\mathbb{R}^{np\times mq}.
\end{displaymath}

We will use $\spann\{x_1,\ldots,x_k\}$ to denote the linear span of the vectors
$x_1,\ldots,x_k$ and also casually write $\spann \{X\}=\spann\{x_1,\ldots,x_k\}$
for the column space of the matrix $X$ with $\{x_1,\ldots,x_k\}$ as its columns.
For $A\in \mathbb R^{n\times n}$ and a vector $x_0\in \mathbb R^{n}$, we denote
the reachable space as $\mathcal C(x_0, A)=\spann\{x_0, Ax_0, \dotsc,
A^{n-1}x_0\}$.
For a continuously differentiable function $x:\mathbb{I}\to\mathbb{R}^n$ from the interval $\mathbb{I}\subseteq\mathbb{R}$ to the vector space $\mathbb{R}^n$ we use the notation $\dot{x} \vcentcolon= \tfrac{\text{\normalfont d}}{\text{\normalfont d}t} x$ to denote the derivative with respect to the independent variable $t$, which we refer to as the time.

\section{Preliminaries}
As outlined in the introduction, \textsf{DMD}\xspace creates a finite-dimensional linear model to approximate the
original dynamics. Thus, in view of possibly exact system identification, we need to assume that the data that is fed to the \textsf{DMD}\xspace algorithm is obtained from a linear \textsf{ODE}\xspace, which in the sequel is denoted by
\begin{subequations}
	\label{eq:IVP}
	\begin{equation}
		\label{eq:ODE}
		\dot{x}(t) = Fx(t)
	\end{equation}
  with $F\in\mathbb{R}^{n\timesn}$. To fix a solution of \eqref{eq:ODE}, we prescribe the initial condition
	%
	\begin{equation}
		\label{eq:IC}
		x(0) = x_0\in\mathbb{R}^{n},
	\end{equation}
\end{subequations}
and denote the solution of the \emph{initial value problem} (\textsf{IVP}\xspace) as $x(t;x_0) \vcentcolon= \exp(F t)x_0$.

\begin{Remark}
  While a \textsf{DMD}\xspace approximation, despite its linearity, may well reproduce
  trajectories of nonlinear systems (see, e.g., \cite{Mez05}), the question of \textsf{DMD}\xspace being able to recover the full dynamics has to focus on linear systems.
  Here, the key observation is that a \textsf{DMD}\xspace approximation is a finite-dimensional linear map. In contrast, the encoding of nonlinear systems via a linear operator necessarily needs an infinite-dimensional mapping.
\end{Remark}

\subsection{Runge-Kutta methods}
\label{subsec:RKM}
To solve the \textsf{IVP}\xspace~\eqref{eq:IVP} numerically, we employ a \textsf{RKM}\xspace, which is a common one-step method to approximate ordinary and differential-algebraic equations \cite{HaiNW08,KunM06}. More precisely, given a step size $h>0$, the solution of the \textsf{IVP}\xspace~\eqref{eq:IVP} is approximated via the sequence $x_i \approx x(t_0 + ih)$ given by
\begin{subequations}
	\label{eq:RKmethod}
	\begin{equation}
		x_{i+1} = x_i + h\sum_{j=1}^s \beta_j k_j,
	\end{equation}
	with the so-called \emph{internal stages} $k_j\in\mathbb{R}^n$ (implicitly) defined via
	%
	\begin{equation}
		\label{eq:internalStages}k_j = Fx_i + h \sum_{\ell=1}^s \alpha_{j,\ell} F k_\ell \qquad\text{for}\ j=1,\ldots,s.
	\end{equation}
\end{subequations}
Using the matrix notation $\mathcal{A} = [\alpha_{j,\ell}]\in\mathbb{R}^{s\times s}$ and $\beta = [\beta_{j}]\in\mathbb{R}^s$ the $s$-stage \textsf{RKM}\xspace defined via \eqref{eq:RKmethod} is conveniently summarized with the pair $(\mathcal{A},\beta)$.  Note that we restrict our presentation to linear time-invariant dynamics and hence do not require the full Butcher tableau.

Since the \textsf{ODE}\xspace~\eqref{eq:ODE} is linear, we can rewrite the internal stages as
\begin{equation}
	\label{eq:internalStages2}
	\begin{bmatrix}
		I_s - h \alpha_{1,1}F & -h \alpha_{1,2}F & \ldots & -h\alpha_{1,s}F\\
		-h\alpha_{2,1}F & I_s - h\alpha_{2,2}F & \ldots & -h\alpha_{2,s}F\\
		\vdots & \ddots & \ddots & \vdots\\
		-h\alpha_{s,1}F & \cdots & -h\alpha_{s,s-1}F & I_s - h\alpha_{s,s}F
	\end{bmatrix}
	\begin{bmatrix}
		k_1\\k_2\\\vdots\\k_s
	\end{bmatrix} = \begin{bmatrix}
		Fx_i\\
		Fx_i\\
		\vdots\\
		Fx_i
	\end{bmatrix}
\end{equation}
Setting $k\vcentcolon= \begin{bmatrix}
	k_1^T & \ldots & k_s^T
\end{bmatrix}^T\in\mathbb{R}^{sn}$ and $e \vcentcolon= \begin{bmatrix} 1 & \ldots 1\end{bmatrix}^T\in\mathbb{R}^s$, the linear system in \eqref{eq:internalStages2} can be written as
\begin{equation}
	(I_s\otimes I_{n} - h\mathcal{A}\otimes F)k = (e\otimes F)x_i,
\end{equation}
where $\otimes$ denotes the Kronecker product. If $h$ is small enough, the matrix $(I_s\otimes I_{n} - h\mathcal{A}\otimes F)$ is invertible and thus we obtain the discrete linear system
\begin{align*}
	x_{i+1} &= x_i + h\sum_{j=1}^s \beta_jk_j = x_i + h (\beta^T\otimes I_{n})k\\
	&= x_i + h (\beta^T\otimes I_{n}) \left(I_s\otimes I_{n} - h\mathcal{A}\otimes F\right)^{-1}(e\otimes F)x_i = A_{h}x_i,
\end{align*}
with
\begin{equation}
	\label{eq:discretizationRungeKutta}
	A_{h} \vcentcolon= I_{n} + h (\beta^T\otimes I_{n}) \left(I_s\otimes I_{n} - h\mathcal{A}\otimes F\right)^{-1}(e\otimes F).
\end{equation}

\begin{Example}
	The explicit Euler method is given as $(\mathcal{A},\beta) = (0,1)$ and according to \eqref{eq:discretizationRungeKutta} we obtain the well-known formula $A_{h} = I_{n} + h F$. For the implicit Euler method $(\mathcal{A},\beta) = (1,1)$ the discrete system matrix is given by
	%
	\begin{displaymath}
		A_{h} = I_{n} + h(I_{n} - h F)^{-1}F = (I_{n} - h F)^{-1}(I_{n} - h F + h F) = (I_{n}-h F)^{-1}.
	\end{displaymath}
\end{Example}

To guarantee that the representation~\eqref{eq:discretizationRungeKutta} is valid, we will make the following assumption throughout the manuscript.

\begin{Assumption}
	\label{ass:suitableStepsize}
	For any $s$-stage \textsf{RKM}\xspace $(\mathcal{A},\beta)$ and any dynamical system matrix $F\in\mathbb{R}^{n\timesn}$ we assume that the step size $h$ is chosen such that the matrix $I_{sn} - h \mathcal{A}\otimes F$ is nonsingular.
\end{Assumption}

\begin{Remark}
	Using \Cref{ass:suitableStepsize}, the matrix $I_{sn} - h \mathcal{A}\otimes F$ is nonsingular and thus there exists a polynomial $p = \sum_{k=0}^{sn-1} p_kt^k \in\mathbb{R}[t]$ of degree at most $sn-1$ depending on the step size $h$ such that
	%
	\begin{align*}
		\left(I_{sn} - h \mathcal{A}\otimes F\right)^{-1} &= p(I_{sn} - h \mathcal{A}\otimes F) = \sum_{k=0}^{sn-1} p_k \left(I_{sn} - h \mathcal{A}\otimes F\right)^k\\
		&= \sum_{k=0}^{sn-1}p_k\sum_{\rho=0}^k \binom{k}{\rho} h^{\rho} (\mathcal{A}^\rho\otimes F^\rho),
	\end{align*}
	where the last equality follows from the binomial theorem. Consequently, we have
	%
	\begin{align}
    \label{eq:ah-as-polynomial}
		A_{h} = I_{n} + \sum_{k=0}^{sn-1}p_k\sum_{\rho=0}^k \binom{k}{\rho} h^{\rho+1} \left(\beta^T\mathcal{A}^\rho e\right) F^{\rho+1}.
	\end{align}
	Rearranging the terms together with the Cayley-Hamilton theorem implies the existence of a polynomial $\tilde{p}\in\mathbb{R}[t]$ of degree at most $n$ such that $A_{h} = \tilde{p}(F)$. As a direct consequence, we see that any eigenvector of $F$ is an eigenvector of $A_{h}$ and thus $A_{h}$ is diagonalizable if $F$ is diagonalizable.
\end{Remark}

Having computed the matrix $A_{h}$, the question that remains to be answered is the quality of the approximation $\|x(ih;x_0)-x_i\|$, which yields the following well-known definition (cf.~\cite{HaiNW08}).

\begin{Definition}
	A \textsf{RKM}\xspace $(\mathcal{A},\beta)$ has \emph{order $p$} if there exists a constant $C\geq 0$ (independent of $h$) such that
	%
	\begin{equation}
		\label{eq:locerror-estimate}
		\|x(h;x_0)-x_1\| \leq Ch^{p+1}
	\end{equation}
	holds, where $x_1 = A_{h}x_0$ with $A_{h}$ defined as in \eqref{eq:discretizationRungeKutta}.
\end{Definition}

For one-step methods, it is well-known that the local errors -- as estimated in \eqref{eq:locerror-estimate} for the initial time step -- basically sum in the global error, such that the following estimate holds

\begin{displaymath}
	\|x(Nh;x_0)-x_N\| \leq Ch^p;
\end{displaymath}
see, e.g., \cite[Thm.~II.3.6]{HaiNW08}.

\subsection{Dynamic Mode Decomposition}
\label{subsec:DMD}
For $i=0,\ldots,m$, assume data points $x_i\in\mathbb{R}^{n}$ available.  The idea of \textsf{DMD}\xspace is to determine a linear time-invariant relation between the data, i.e., finding a matrix $A_{\mathrm{DMD}}\in\mathbb{R}^{n\times n}$, such that the data approximately satisfies
\begin{displaymath}
	x_{i+1} \approx A_{\mathrm{DMD}} x_i\qquad \text{for $i=0,1,\ldots,m-1$}.
\end{displaymath}
Following \cite{TuRLBK14} we introduce
\begin{equation}
	\label{eq:DMDdata}
	X \vcentcolon= \begin{bmatrix}
		x_0 & \ldots & x_{m-1}
	\end{bmatrix}\in\mathbb{R}^{n\timesm}\qquad\text{and}\qquad
	Z \vcentcolon= \begin{bmatrix}
		x_1 & \ldots & x_{m}
	\end{bmatrix}\in\mathbb{R}^{n\timesm}.
\end{equation}
Then, the \textsf{DMD}\xspace approximation matrix is defined as the minimum-norm solution of
\begin{equation}
	\label{eq:DMDminFrob}
	\min_{M\in\mathbb{R}^{n\timesn}} \|Z - MX\|_F,
\end{equation}
where $\|\cdot\|_F$ denotes the Frobenius norm. It is easy to show that the minimum-norm solution is given by $A_{\mathrm{DMD}} = Z\pseudo{X}$ \cite{KutBBP16}, where $\pseudo{X}$ denotes the Moore-Penrose pseudoinverse of $X$. This motivates the following definition.

\begin{Definition}
	\label{def:exactDMD}
	Consider the data $x_i\in\mathbb{R}^{n}$ for $i=0,1,\ldots,m$ and associated data matrices $X$ and $Z$ defined in~\eqref{eq:DMDdata}. Then the matrix $A_{\mathrm{DMD}} \vcentcolon= Z\pseudo{X}$ is called the \emph{\textsf{DMD}\xspace matrix} for $(x_i)_{i=0}^{m}$.  If the eigendecomposition of $A_{\mathrm{DMD}}$ exists, then the eigenvalues and eigenvectors of $A_{\mathrm{DMD}}$ are called \emph{\textsf{DMD}\xspace eigenvalues} and \emph{\textsf{DMD}\xspace modes} of $(state_i)_{i=0}^{m}$, respectively.
\end{Definition}

The Moore-Penrose pseudoinverse, and thus also the \textsf{DMD}\xspace matrix, can be computed
via the \emph{singular value decomposition} (\textsf{SVD}\xspace); see, e.g., \cite[Ch.
5.5.4]{GolV96}: Let
 %
\begin{displaymath}
	\begin{bmatrix}
		U & \bar{U}
	\end{bmatrix}\begin{bmatrix}
		\Sigma & 0\\
		0 & 0
	\end{bmatrix}\begin{bmatrix}
		V^\top\\
		\bar{V}^\top
	\end{bmatrix} = X
\end{displaymath}
denote the \textsf{SVD}\xspace of $X$, with $r \vcentcolon= \rank(X)$,  $U\in\mathbb{R}^{n\times r}$, $\Sigma\in\mathbb{R}^{r\times r}$ and $\rank(\Sigma) = r$, and $V\in\mathbb{R}^{m\times r}$.
Then
\begin{equation}
  \label{eq:moore-penrose-def-svd}
  \pseudo X =
  \begin{bmatrix}
		V & \bar{V}
	\end{bmatrix}
  \begin{bmatrix}
    \Sigma^{-1} & 0\\
		0 & 0
	\end{bmatrix}
  \begin{bmatrix}
		U^\top\\
		\bar{U}^\top
	\end{bmatrix} = V\Sigma^{-1}U^\top
\end{equation}
and, thus,
\begin{equation}
	\label{eq:DMDrealization}
	A_{\mathrm{DMD}} = Z V\Sigma^{-1}U^T.
\end{equation}
For later reference, we call $U\Sigma V^\top = X$ the \emph{trimmed \textsf{SVD}\xspace} of $X$.

\section{System identification and error analysis}
\label{sec:errorAnalysis}

In this section we present our main results. Before discussing system identification for discrete-time (cf.~\cref{subsec:discreteTime}) and continuous-time (cf.~\cref{subsec:continuousTime}) dynamical systems via \textsf{DMD}\xspace, we study the impact of transformations of the data on \textsf{DMD}\xspace in \cref{subsec:dataTransformation}.

\subsection{Data scaling and invariance of the DMD approximation}
\label{subsec:dataTransformation}

Scaling and more general transformation of data is often used to improve the performance of the methods that work on the data. Since \textsf{DMD}\xspace is inherently related to the Moore-Penrose inverse, we first study the impact of a nonsingular matrix $T\in\GL{n}{\mathbb{R}}$ on the generalized inverse. To this purpose, consider a matrix $X\in\mathbb{R}^{n\timesm}$ with $r\vcentcolon= \rank(X)$. Let $X = U\Sigma V^\top$ denote the trimmed \textsf{SVD}\xspace of $X$ with $U\in\mathbb{R}^{n\times r}$, $\Sigma\in\GL{r}{\mathbb{R}}$ and $V\in\mathbb{R}^{m\times r}$. Let $TU = QR$ denote the QR-decomposition of $TU$ with $Q\in\mathbb{R}^{n\times n}$ and $R\in\mathbb{R}^{n\times r}$. We immediately obtain $\rank(RS) = r$. Let $R\Sigma = \widehat{U}\widehat{\Sigma}\widehat{V}^\top$ denote the trimmed \textsf{SVD}\xspace of $R\Sigma$ with $\widehat{U}\in\mathbb{R}^{n\times r}$, $\widehat{\Sigma}\in\GL{r}{\mathbb{R}}$, and $\widehat{V}\in\mathbb{R}^{r\times r}$.  We immediately infer
\begin{equation}
	\label{eqn:transformedRightSingularVector}
	\widehat{V}\widehat{V}^\top = I_r.
\end{equation}
It is easy to see that the matrices $U_T \vcentcolon= Q\widehat{U}\in\mathbb{R}^{n\times r}$, and $V_T \vcentcolon= V\widehat{V}\in\mathbb{R}^{m\times r}$ satisfy $U_T^\top U_T = I_r = V_T^\top V_T$. The trimmed \textsf{SVD}\xspace of $TX$ is thus given by
\begin{displaymath}
	TX = TU\Sigma V^\top = QR\Sigma V^\top = Q\widehat{U}\widehat{\Sigma}\widehat{V}^\top V^\top = U_T\widehat{\Sigma}V_T^\top.
\end{displaymath}
We thus obtain
\begin{equation*}
	\pseudo{(TX)}TX = V_T V_T\top = V\widehat{V}\widehat{V}^\top V^\top = VV^\top = \pseudo{X}\pseudo{X}
\end{equation*}
where we have used the identity~\eqref{eqn:transformedRightSingularVector}. We have thus shown the following result.

\begin{Proposition}
	\label{prop:MPItransformation}
	Let $X\in\mathbb{R}^{n\timesm}$ and $T\in\GL{n}{\mathbb{R}}$. Then  $\pseudo{(TX)}(TX) = \pseudo{X}{X}$.
\end{Proposition}

With these preparations, we can now show that the \textsf{DMD}\xspace approximation is partially invariant to general regular transformations applied to the training data. More precisely, a data transformation only affects the part of the \textsf{DMD}\xspace approximation that is not in the image of the data.

\begin{Theorem}
	\label{thm:invariance}
	For given data $(x_i)_{i=0}^{m}$ consider the matrices $X$ and $Z$ as defined in~\eqref{eq:DMDdata} and the corresponding \textsf{DMD}\xspace matrix $\dmdAg\in\mathbb{R}^{n\timesn}$. Consider $T\in \GL{n}{\mathbb{R}}$ and let
	%
	\begin{equation*}
		\tilde{X} \vcentcolon= TX
		\quad\text{and}\quad
		\tilde{Z} \vcentcolon= TZ
	\end{equation*}
	be the matrices of the transformed data. Let $\tdmdAg \vcentcolon= \tilde{Z}\pseudo{\tilde{X}}$ denote the \textsf{DMD}\xspace matrix for the transformed data.
	Then the \textsf{DMD}\xspace matrix is invariant under the transformation in the image of~$X$, i.e.,
	%
	\begin{equation*}
		\dmdAg X = T^{-1}\tdmdAg T X = T^{-1}\tdmdAg \tilde{X}.
	\end{equation*}
  	Moreover, if $T$ is unitary or $\rank(X) = n$, then
  	%
  \begin{equation}
  \label{eq:DMDtransformation}
    \dmdAg = T^{-1}\tdmdAg T.
  \end{equation}
\end{Theorem}

\begin{proof}
	Using \Cref{prop:MPItransformation} we obtain
	%
	\begin{equation*}
		T^{-1}\tdmdAg TX = T^{-1} TZ \pseudo{(TX)}TX = Z\pseudo{X}X = \dmdAgX.
	\end{equation*}
	If $T$ is unitary or $\rank(X) = n$, then we immediately obtain $\pseudo{(TX)} = \pseudo{X}T^{-1}$, and thus
	%
  \begin{displaymath}
  	T^{-1}\tdmdAg T= T^{-1}TZ\pseudo{TX}T = Z \pseudo{X}T^{-1} T = \dmdAg,
  \end{displaymath}
  which concludes the proof.
\end{proof}

While \Cref{thm:invariance} states that \textsf{DMD}\xspace is invariant under transformations
in the image of the data matrix, the invariance in the orthogonal complement of
the image of the data matrix, i.e., equality~\eqref{eq:DMDtransformation}, is in
general not satisfied. We illustrate this observation in the numerical simulations in a
later chapter and in the following analytical example.

\begin{Example}
	Consider the data vectors $x_i \vcentcolon= [i+1,0]^\top$ for $i=0,1,2$ and $T \vcentcolon= \left[\begin{smallmatrix}1 & 0\\ 1 & 1\end{smallmatrix}\right]$. Then,
	%
	\begin{displaymath}
		X = \begin{bmatrix}
			1 & 2\\
			0 & 0
		\end{bmatrix}, \quad Z = \begin{bmatrix}
			2 & 3\\
			0 & 0
		\end{bmatrix},  \quad \pseudo{X} = \tfrac{1}{5}\begin{bmatrix}
			1 & 0\\
			2 & 0
		\end{bmatrix},\quad TX = \begin{bmatrix}
			1 & 2\\
			1 & 2
		\end{bmatrix}, \quad \pseudo{(TX)} = \tfrac{1}{10}\begin{bmatrix}
			1 & 2\\
			1 & 2
		\end{bmatrix}.
	\end{displaymath}
	We thus obtain
	\begin{equation*}
		\dmdAg = \tfrac{1}{5}\begin{bmatrix}
			8 & 0\\
			0 & 0
		\end{bmatrix},\qquad
		\tdmdAg = \tfrac{1}{5}\begin{bmatrix}
			4 & 4\\
			4 & 4
		\end{bmatrix},\qquad \text{and}\qquad
		T^{-1}\tdmdAg T = \tfrac{1}{5}\begin{bmatrix}
			8 & 4\\
			0 & 0
		\end{bmatrix},
	\end{equation*}
	confirming that \textsf{DMD}\xspace is invariant under transformations in the image of the data, but not in the orthogonal complement.
\end{Example}

\begin{Remark}
	One can show that in the setting from \Cref{thm:invariance},  the matrix $\widehat{M} \vcentcolon= TA_{\mathrm{DMD}} T^{-1}$ is a minimizer (not necessarily the minimum-norm solution) of
	%
	\begin{equation*}

		\min_{M\in\mathbb{R}^{n\timesn}} \frobnorm{\widehat{Z}-M\widehat{X}}.
	\end{equation*}
\end{Remark}

\subsection{Discrete-time dynamics}
\label{subsec:discreteTime}

In this subsection, we focus on the identification of discrete-time dynamics, which are exemplified by the discrete-time system
\begin{equation}
	\label{eqn:discreteSystem}
	x_{i+1} = Ax_i
\end{equation}
with initial value $x_0\in\mathbb{R}^{n}$ and system matrix $A\in\mathbb{R}^{n\timesn}$.  The question that we want to answer is to what extend \textsf{DMD}\xspace is able to recover the matrix $A$ solely from data.

\begin{Proposition}
	\label{prop:discreteRealization}
	Consider data $(x_i)_{i=0}^{m}$ generated by~\eqref{eqn:discreteSystem}, associated data matrices $X, Z$ as defined in~\eqref{eq:DMDdata}, and the corresponding \textsf{DMD}\xspace matrix $A_{\mathrm{DMD}}$.  Moreover let $U\Sigma V^\top = X$ with $U\in\mathbb{R}^{n\times r}$, $\Sigma\in\GL{r}{\mathbb{R}}$, $V\in\mathbb{R}^{m\times r}$, and $r \vcentcolon= \rank(X)$ denote the trimmed \textsf{SVD}\xspace of $X$ defined in \eqref{eq:DMDdata}. Then
	%
	\begin{equation}
		\label{eq:dmdA-skinnySVD}
		A_{\mathrm{DMD}} = A UU^\top.
	\end{equation}
\end{Proposition}

\begin{proof}
	By assumption, we have
	$X = \begin{bmatrix}
			x_0 & Ax_0 & \cdots & A^{m-1}x_0
		\end{bmatrix}$ and $Z = AX = A U\Sigma V^\top$.  We conclude

	\begin{equation*}
		A_{\mathrm{DMD}} = Z\pseudo{X} = A U\Sigma V^\top V\Sigma^{-1}U^\top = A UU^\top.\qquad\qedhere
	\end{equation*}
\end{proof}

\begin{Remark}
\label{rem:controllability-and-full-rank}
We immediately conclude that \textsf{DMD}\xspace recovers the true dynamics, i.e.,
$A_{\mathrm{DMD}} = A$, whenever $\rank(X) = n$. This is the case if
and only if $(A,x_0)$ is controllable, i.e., $\mathcal C(A, x_0)$ has
dimension $n$, and the data set is sufficiently rich, i.e., $m \geq n$.
\end{Remark}

Our next theorem identifies the part of the dynamics that is exactly recovered in the case
that $\rank(X) < n$ that occurs for $(A, x_0)$ not controllable
or $m < n$.
\begin{Theorem}
	\label{thm:exactDMD}
	Consider the setting of \Cref{prop:discreteRealization}.  If $\spann\{U\}$ is $A_{\mathrm{DMD}}$-invariant, then the DMD approximation is exact in the image of $U$, i.e.,
	%
	\begin{equation}
		\label{eqn:exactDMD}
		(A^i-A_{\mathrm{DMD}}^i)x = 0\qquad\text{for all $i\geq 0$ and $x\in \spann\{U\}$.}
	\end{equation}
	If in addition, $\ker(A)\cap \spann\{U\}^\perp = \{0\}$, then also the converse direction holds.
\end{Theorem}

\begin{proof}
	Let $x\in \spann\{U\}$. Since $\spann\{U\}$ is $A_{\mathrm{DMD}}$ invariant, we conclude $A_{\mathrm{DMD}}^ix\in\spann\{U\}$ for $i\geq 0$, i.e., there exist $y_i\in\mathbb{R}^r$ such that $A_{\mathrm{\textsf{DMD}\xspace}}^ix = Uy_i$. Using \Cref{prop:discreteRealization} we conclude
	%
	\begin{equation*}
		A_{\mathrm{DMD}}^{i+1}x = A_{\mathrm{DMD}} A_{\mathrm{DMD}}^i x = A_{\mathrm{DMD}} Uy_i = Ay_i.
	\end{equation*}
	The proof of~\eqref{eqn:exactDMD} follows via induction over $i$. For the converse direction, let $x = x_U + x_U^\perp$ with $x_U\in\spann\{U\}$ and $x_U^\perp \in \spann\{U\}^\perp$.  \Cref{prop:discreteRealization} and~\eqref{eqn:exactDMD} imply
	%
	\begin{equation*}
		(A-A_{\mathrm{DMD}})x = Ax_U^\perp \neq 0,
	\end{equation*}
	which completes the proof.
\end{proof}

\begin{Remark}
	The proof of~\Cref{thm:exactDMD} details that $\spann\{U\}$ is $A_{\mathrm{DMD}}$-invariant if and only if $\spann\{U\}$ is $A$-invariant.  Moreover, $\spann\{U\} = \spann\{X\}$ implies that this condition can be checked easily during the data-generation process.  If we further assume that the data is generated via~\eqref{eqn:discreteSystem}, then this is the case,  whenever
	%
	\begin{equation*}
		\rank\left(\begin{bmatrix}
			x_0 & \cdots & x_i
		\end{bmatrix}) = \rank(\begin{bmatrix}
			x_0 & \cdots & x_{i+1}
		\end{bmatrix}\right)
	\end{equation*}
	for some $i\geq 0$.
\end{Remark}

\subsection{Continuous-time dynamics and RK approximation}
\label{subsec:continuousTime}

Suppose now that the data $(x_i)_{i=0}^{m}$ is generated from a continuous process, i.e., via the dynamical system~\eqref{eq:IVP}. In this case, we are interested in recovering the continuous dynamics from the \textsf{DMD}\xspace approximation. As a consequence of \Cref{thm:exactDMD} we immediately obtain the following results for exact sampling.

\begin{Corollary}
	\label{cor:exactDMD}
	Let $A_{\mathrm{DMD}}$ be the \textsf{DMD}\xspace matrix for the sequence $x_i = \exp(iF h)x_0\in\mathbb{R}^{n}$ for $i=1,\ldots,m$ with $m\geq n$.  Then
	%
	\begin{equation*}
		x(ih;\tilde{x}_0) = A_{\mathrm{DMD}}^i \tilde{x}_0
	\end{equation*}
	if and only if $\tilde{x}_0\in\spann\{x_0,\ldots,x_{m}\}$, where $x(t;\tilde{x}_0)$ denotes the solution of the \textsf{IVP}\xspace~\eqref{eq:IVP} with initial value $\tilde{x}_0$.
\end{Corollary}

\begin{proof}
	The assertion follows immediately from \Cref{prop:discreteRealization} with the observation that $\exp(i Fh)$ is nonsingular.
\end{proof}

We conclude that we can recover the continuous dynamics with the matrix logarithm (see \cite{Hig08} for further details), whenever $\rank(X) = n$. In practical applications, an exact evaluation of the flow map is typically not possible. Instead, a numerical time-integration method is used to approximate the continuous dynamics.

Suppose we have used a \textsf{RKM}\xspace with constant step size $h>0$ to obtain a numerical approximation $(x_i)_{i=0}^{m}\subseteq\mathbb{R}^{n}$ of the \textsf{IVP}\xspace~\eqref{eq:IVP} and used this data to construct the \textsf{DMD}\xspace matrix $A_{\mathrm{DMD}}\in\mathbb{R}^{n\timesn}$ as in \Cref{def:exactDMD}. If we now want to use the \textsf{DMD}\xspace matrix to obtain an approximation for a different initial condition, say $x(0) = \tilde{x}_0$, we are interested in quantifying the error
\begin{equation*}
	\|x(ih;\tilde{x}_0) - A_{\mathrm{DMD}}^i\tilde{x}_0\|.
\end{equation*}

\begin{Theorem}
	\label{thm:DMDapproximationError}
	Suppose that the sequence $(x_i)_{i=0}^m$, with
  $x_i\in\mathbb{R}^{n}$ for $i=0,\ldots,m$, is generated from the linear \textsf{IVP}\xspace~\eqref{eq:IVP} via a \textsf{RKM}\xspace of order $p$ and step size $h>0$ and satisfies
  %
	\begin{equation*}
		\spann\{x_0,\ldots,x_{m-1}\} = \spann\{x_0,\ldots,x_{m}\}.
	\end{equation*}
	Let $A_{\mathrm{DMD}}\in\mathbb{R}^{n\timesn}$ denote the associated \textsf{DMD}\xspace matrix. Then there exists a constant $C\geq 0$ such that
	%
	\begin{equation}
		\label{eq:errorEstimate}
		\|x(ih;\tilde{x}_0)-A_{\mathrm{DMD}}^i\tilde{x}_0\| \leq Ch^p
	\end{equation}
	holds for any $\tilde{x}_0\in\spann(\{x_0, \ldots,x_{m-1}\})$.
\end{Theorem}

\begin{proof}
	Since the data $(x_i)_{i=0}^m$ is generated from a \textsf{RKM}\xspace there
  exists a matrix $A_h\in\mathbb{R}^{n\timesn}$ such that $x_{i+1}
  = A_hx_i$ for $i=0,\ldots,m-1$. Let $\tilde{x}_0\in
  \spann(\{x_0, \ldots,x_{m-1}\})$. Then,
  \Cref{thm:exactDMD} implies $A_h^i\tilde{x}_0 =
  A_{\mathrm{DMD}}^i\tilde{x}_0$ for any $i\geq 0$. Thus the result follows
  from the classical error estimates for RKM (see, e.g.,
  \cite[Thm.~II.3.6]{HaiNW08}) and the from equality
  %
	\begin{equation*}
		\|x(ih;\tilde{x}_0) - A_{\mathrm{DMD}}^i\tilde{x}_0\| = \|x(ih;\tilde{x}_0) - A_\timeStep^i\tilde{x}_0\| \leq Ch^p
	\end{equation*}
	for some $C\geq 0$, since the \textsf{RKM}\xspace is of order $p$.
\end{proof}

The proof details that due to \Cref{prop:discreteRealization} we are essentially able to recover the discrete dynamics $A_h$ obtained from the \textsf{RKM}\xspace via \textsf{DMD}\xspace, provided that $\rank(X) = n$. As layed out in \Cref{rem:controllability-and-full-rank}, this condition is equivalent to $(A_h,x_0)$ controllable for which controllability of $(F,x_0)$ is a necessary condition.

The question that remains to be answered is whether it is possible to recover the continuous dynamic matrix $F$ from the discrete dynamics $A_{\mathrm{DMD}}$ (respectively $A_h$) provided that the Runge-Kutta scheme is known that was used to discretize the continuous dynamics. For any $1$-state Runge-Kutta method $(\alpha,\beta)$, i.e, $s=1$ in~\eqref{eq:RKmethod} this is indeed the case,  since then \eqref{eq:discretizationRungeKutta} simplifies to
\begin{equation*}
	A_h = I_{n} + h \beta (I_{n} - h\alpha F)^{-1}F,
\end{equation*}
which yields
\begin{equation*}
	F = -\frac{1}{h}(I_{n} - A_h)\left(\alpha A_h + (\beta-\alpha)I_{n}\right)^{-1}.
\end{equation*}
Combining \eqref{eq:reverseRKs1} with \Cref{prop:discreteRealization} yields the following result.

\begin{Lemma}
	\label{lem:exactRKDMD}
	Suppose that the sequence $(x_i)_{i=0}^m\subseteq\mathbb{R}^{n}$ is generated from the linear \textsf{IVP}\xspace~\eqref{eq:IVP} via the $1$-stage Runge-Kutta method $(\alpha,\beta)$ and step size $h>0$. Let $A_{\mathrm{DMD}}\in\mathbb{R}^{n\timesn}$ denote the associated \textsf{DMD}\xspace matrix. If $\rank(\{x_0,\ldots,x_{m-1}\}) = n$, then
	%
	\begin{equation}
		\label{eq:reverseRKs1}
		F = -\frac{1}{h}(I_{n} - A_{\mathrm{DMD}})\left(\alpha A_{\mathrm{DMD}} + (\beta-\alpha)I_{n}\right)^{-1},
	\end{equation}
	provided the inverse exists.
\end{Lemma}

If the assumption of \Cref{lem:exactRKDMD} holds, then we can recover the continuous dynamic matrix from the \textsf{DMD}\xspace approximation. The corresponding formula for popular one-stage methods is presented in \Cref{tab:continuousDynamicsFromDMD}.
\begin{table}[ht]
	\centering
	\caption{Identification of continous-time systems via \textsf{DMD}\xspace with one-stage Runge-Kutta methods}
	\label{tab:continuousDynamicsFromDMD}
	\begin{tabular}{lll}
		\toprule
		\textbf{method} & $(\alpha,\beta)$ & \Cref{lem:exactRKDMD}\\\midrule
		explicit Euler & $(0,1)$ & $F = -\tfrac{1}{h}(I_{n}-A_{\mathrm{DMD}})$\\
		implicit Euler & $(1,1)$ & $F = \frac{1}{h}(I_{n}-A_{\mathrm{DMD}}^{-1})$\\
		implicit midpoint rule & $(\tfrac{1}{2},1)$ & $F = \tfrac{1}{2h}(A_{\mathrm{DMD}}-I_{n})(A_{\mathrm{DMD}}+I_{n})^{-1}$\\\bottomrule
	\end{tabular}
\end{table}
In this scenario, let us emphasize that we can compute the discrete dynamics with the \textsf{DMD}\xspace approximation for any time-step.

The situation is different for $s\geq 2$, as we illustrate with the following example.

\begin{Example}
	For given $h>0$, consider $F_1 \vcentcolon= 0$ and $F_2 \vcentcolon= -\tfrac{2}{h}$.  Then, for Heun's method, i.e., $\mathcal{A}  = \left[\begin{smallmatrix} 0 & 0\\1 & 0\end{smallmatrix}\right]$ and $\beta^\top = \left[\begin{smallmatrix} \tfrac{1}{2} & \tfrac{1}{2}\end{smallmatrix}\right]$, we obtain $A_h = p(F)$ with $p(x) = 1 + hx + \tfrac{h^2}{2}x^2$, and thus $p(F_1) = p(F_2)$.  In particular, we cannot distinguish the continuous-time dynamics in this specific scenario.
\end{Example}

\section{Numerical examples}
\providecommand\inival{x_0}
\providecommand\diagmat[1]{\ensuremath{\mathsf{diag}(#1)}}

To illustrate our analytical findings, we have constructed a dynamical system that exhibits some fast dynamics that is stable but not exponentially stable and has a nontrivial but exactly computable flow map. In this way, we can check the approximation both qualitatively and quantitatively. Also, the system can be scaled to arbitrary state-space dimensions. Most importantly, for our purposes, the system is designed such that for any initial value, the space not reached by the system is as least as large as the reachable space.
The complete code of our numerical examples can be found in the
\emph{supplementary material}.

With $N\in \mathbb{N}$, $\Delta\vcentcolon= \diagmat{0,1,\dotsc,N-1}$ we consider the continuous-time dynamics~\eqref{eq:IVP} with
\begin{equation*}
	F \vcentcolon=
	\begin{bmatrix}
		0 & 2\Delta \\
		0 & -\frac 12 \Delta
	\end{bmatrix}\qquad\text{and}\qquad \exp(tF) = \begin{bmatrix}
		I & 4(I-\exp(-\frac{t}{2}\Delta)) \\
		0 & \exp(-\frac{t}{2} \Delta)
	\end{bmatrix}.
\end{equation*}
Starting with an initial value $x_0\in \mathbb{R}^{2N}$ we can thus generate exact snapshots of the solution via $x(t) = \exp(tF)x_0$, as well as the controllability space
\begin{equation*}
\mathcal{C}(F,x_0) = \spann\biggl\{
	\inival,
	\begin{bmatrix}
		0 & 2\Delta \\
		0 & -\frac 12 \Delta
	\end{bmatrix} \inival,
	\begin{bmatrix}
		0 & 2\Delta \\
		0 & -\frac 12 \Delta
	\end{bmatrix}^2 \inival,
  \dotsc,
	\begin{bmatrix}
		0 & 2\Delta \\
		0 & -\frac 12 \Delta
  \end{bmatrix}^{2N-1} \inival
\biggr\}.
\end{equation*}
It is easy to see that $\dim(\mathcal{C}(F,x_0))\leq N$ with equality if
and only if $x_0$ has no zero entries. Due to~\eqref{eq:ah-as-polynomial}, we immediately infer
\begin{equation*}
	\dim(\mathcal{C}(A_h,x_0)) \leq N
\end{equation*}
for any $A_h$ obtained by a Runge-Kutta method. We conclude that \textsf{DMD}\xspace will at most be capable to
reproduce solutions that evolve in~$\mathcal{C}(F,x_0)$. Indeed, as outlined in \mbox{\Cref{prop:discreteRealization}}, all components of another initial value $\tilde{x}_0$ that are in the orthogonal complement of
$\mathcal{C}(F,\inival)$ are set to zero in the first \textsf{DMD}\xspace iteration.

For our numerical experiments we set $N\vcentcolon=5$, $x_0\vcentcolon= [1,2,\ldots,10]^\top$, and consider the time-grid $t_i \vcentcolon= ih$ for $i=0,1,\ldots,100$ with uniform stepsize $h=0.1$.  A \textsf{SVD}\xspace of exactly sampled data
\begin{equation}
  \begin{bmatrix}
    U_1 & U_2
  \end{bmatrix}
  \begin{bmatrix}
    \Sigma_1 & 0 \\ 0 & 0
  \end{bmatrix}
  V^T =
  \begin{bmatrix}
    \inival & x(h;x_0) & x(2h;x_0) & \cdots &  x(10;x_0)
  \end{bmatrix}
\end{equation}
of the matrix of snapshots of the solution $x(t;x_0)$, reveals that the solution space
is indeed of dimension $N=5$ and defines the bases $U_1 \in \mathbb{R}^{10,5}$
and $U_2\in\mathbb{R}^{10,5}$ of $\mathcal{C}(F,x_0)$ and its orthogonal
complement, respectively.

For our numerical experiment, depicted in \Cref{fig:inivcspace}, we choose the initial values
\begin{equation*}
	\tilde{x}_0 \vcentcolon= U_1e\in \spann(U_1)\qquad\text{and}\qquad
	\widehat{x}_0 \vcentcolon= U_2e\in \spann(U_2) = \spann(U_1)^\perp,
\end{equation*}
with $e=[1,1,1,1,1]^\top$.
The exact solution for both initial values is presented in \Cref{fig:exactSolutionInReachableSpace,fig:exactSolutionOutsideReachableSpace}, respectively.  Our simulations confirm the following:
\begin{itemize}
	\item As predicted by \Cref{thm:exactDMD}, the \textsf{DMD}\xspace approximation for the initial value $\tilde{x}_0$, depicted in \Cref{fig:DMDInReachableSpace}, exactly recovers the exact solution, while the \textsf{DMD}\xspace approximation for the initial value $\widehat{x}_0$ (cf.~\Cref{fig:DMDOutsideReachableSpace}) is identically zero.
	\item If we first transform the data with the matrix
	%
\begin{equation*}
	T = \begin{bmatrix}
		1 & 1\\
		& \ddots & \ddots\\
		& & \ddots & 1\\
		& & \phantom{\ddots} & 1
	\end{bmatrix}\in \GL{2N}{\mathbb{R}},
\end{equation*}
then compute the \textsf{DMD}\xspace approximation, and then transform the results back, the \textsf{DMD}\xspace approximation for $\tilde{x}_0$ remains unchanged, see \Cref{fig:TDMDInReachableSpace}, confirming~\eqref{eq:DMDtransformation} from~\Cref{thm:invariance}. In contrast, the prediction of the dynamics for $\widehat{x}_0$ changes (see~\Cref{fig:TDMDOutsideReachableSpace}), highlighting that \textsf{DMD}\xspace is not invariant under state-space transformations in the orthogonal complement of the data.
\end{itemize}

\begin{figure}[ht]
  \centering
  \newlength\figureheight
  \setlength\figureheight{5cm}
  \pgfplotsset{yticklabel style={text width=3em, align=right}}

  \begin{subfigure}{0.49\linewidth}
    \input{txz-exact.tex}\\[-1.5em]
     \caption{Exact solution with initial value $\tilde{x}_0$}
    \label{fig:exactSolutionInReachableSpace}
  \end{subfigure}\hfill
  \begin{subfigure}{0.49\linewidth}
    \input{hxz-exact.tex}\\[-1.5em]
    \caption{Exact solution with initial value $\widehat{x}_0$}
    \label{fig:exactSolutionOutsideReachableSpace}
  \end{subfigure}\\

  \begin{subfigure}[b]{0.49\linewidth}
    \input{txz-dmd.tex}\\[-1.5em]
    \caption{\textsf{DMD}\xspace approximation with initial value $\tilde{x}_0$}
    \label{fig:DMDInReachableSpace}
  \end{subfigure}\hfill
  \begin{subfigure}[b]{0.49\linewidth}
    \input{hxz-dmd.tex}\\[-1.5em]
    \caption{\textsf{DMD}\xspace approximation with initial value $\widehat{x}_0$}
    \label{fig:DMDOutsideReachableSpace}
  \end{subfigure}

  \begin{subfigure}[b]{0.49\linewidth}
    \input{txz-tdmd.tex}\\[-1.5em]
    \label{fig:TDMDInReachableSpace}
    \caption{\textsf{DMD}\xspace with transformed data with initial value $\tilde{x}_0$}
  \end{subfigure}\hfill
  \begin{subfigure}[b]{0.49\linewidth}
    \input{hxz-tdmd.tex}\\[-1.5em]
    \label{fig:TDMDOutsideReachableSpace}
    \caption{\textsf{DMD}\xspace with transformed data with initial value $\widehat{x}_0$}
  \end{subfigure}

	 \caption{Comparison of the exact solution, \textsf{DMD}\xspace approximation, and \textsf{DMD}\xspace approximation based on transformed data, for initial values inside, the reachable subspace, i.e., $\tilde{x}_0\in\mathcal{C}(F,x_0)$, and
   outside the reachable subspace, i.e., $\widehat{x}_0\in\mathcal{C}(F,x_0)^\perp$.}
	\label{fig:inivcspace}
\end{figure}

\subsection*{Acknowledgments} We thank Dr.~Robert Altmann for inviting us to the Sion workshop, where we started this work.
 B. Unger acknowledges funding from the DFG under Germany's Excellence Strategy -- EXC 2075 -- 390740016 and is thankful for support by the Stuttgart Center for Simulation Science (SimTech).

\bibliographystyle{siam}

Numerical Analysis (math.NA); Systems and Control (eess.SY)