A simple algorithm to find the L-curve corner in the regularisation of ill-posed inverse problems

Abstract: We propose a simple algorithm to locate the "corner" of an L-curve, a function often used to select the regularisation parameter for the solution of ill-posed inverse problems. The algorithm involves the Menger curvature of a circumcircle and the golden section search method. It efficiently finds the regularisation parameter value corresponding to the maximum positive curvature region of the L-curve. The algorithm is applied to some commonly available test problems and compared to the typical way of locating the l-curve corner by means of its analytical curvature. The application of the algorithm to the data processing of an electrical resistance tomography experiment on thin conductive films is also reported.

\section{Introduction}

The solution $\bm{\hat x}$ of an ill-posed inverse problem is often formulated in terms of residuals

\begin{equation}
\begin{aligned}
\label{eqn:lsq}
\bm{\hat x} =\textup{arg }  \underset{\bm{x}}{\textup{min}} \left \{||\bm{A}\bm{x}-\bm{b}||^{2}\right\}, \quad \bm{A} \in \mathds{R}^{m \times n}, \quad m>n
\end{aligned}
\end{equation}
where the quantity $\bm{Ax}-\bm{b}$ is the vector of residuals between the experimental data vector $\bm{b}$ and the reconstructed data $\bm{A}\bm{x}$ for a given $\bm{x}$. Regularization techniques are applied to make the problem less sensitive to the noise of $\bm{b}$ and find a stable solution.
One popular regularization method is to replace the system~\ref{eqn:lsq} with
\begin{equation}
\begin{aligned}
\label{eqn:funct}
\bm{\hat x}_{\lambda}= \textup{arg }  \underset{\bm{x}}{\textup{min}} \left \{ ||\bm{A}\bm{x}-\bm{b}||^{2}+\lambda \bm{R}(\bm{x})\right \},\quad \lambda \in \mathds{R}, \quad \lambda \geq 0
\end{aligned}
\end{equation}
where the regularization term $\bm{R}(\bm{x})$ represents a cost function, which may include some prior information about the solution. The scalar factor $\lambda$ is the  \emph{regularization parameter}, serving as weighing factor of $\bm{R}(\bm{x})$. The choice of $\lambda$ is crucial for the solution to be meaningful.
As an example, we consider the regularization method named after Tikhonov~\cite{tikhonov2013numerical}, in which $\bm{R}(\bm{x}) =  ||\bm{x}||^{2}$.
Several methods~(see \cite[p.~44]{almasy2009inverse} and references therein) have been developed in order to find an optimal tuning of $\lambda$ for a given problem.
Of particular interest is the L-curve method~\cite{hansen1992analysis}.
The L-curve is a two-dimensional curve, parametric in $\lambda$, defined by points with cartesian coordinates
\begin{equation}
\label{eqn:lcurve}
P(\lambda)=(\xi(\lambda), \eta(\lambda))\rightarrow\begin{cases}
& \xi(\lambda)= \log||\bm{Ax}-\bm{b}||^2\\
&\eta(\lambda)= \log||\bm{x}||^2
\end{cases}
\end{equation}
The point of maximum positive curvature $P(\lambda_\mathrm{opt})$, the ``corner'', can be associated to the optimal reconstruction parameter $\lambda_\mathrm{opt}$.  The underlying concept is that the ``corner'' represents a compromise between the fitting to the data and the regularization of the solution~\cite{hansen1993use}.
Numerical search algorithms have been proposed for the identification of $\lambda_\mathrm{opt}$; among them we mention the splines method~\cite{hansen1992analysis,hansen2007adaptive}, the triangle method~\cite{castellanos2002triangle} and the L-ribbon method~\cite{calvetti1999estimation}.
Here we propose an alternative method which is based on an estimation of the local curvature of the L-curve from three sampled points (which define a circle), and a sampling update rule based on the golden section search. The method attempts to reduce the computational effort by minimizing the number of sampled points of the L-curve explicitly computed. A detailed algorithm is described; an application to a reconstruction problem in electrical resistance tomography is reported.
\section{Algorithm}
\label{sec:alg}
The proposed algorithm~\ref{alg} is written in pseudo-code. The algorithm calls two functions. The function P = \texttt{l\_curve\_P($\lambda$)} is based on the the specific regularization problem being solved; it is assumed that at each call, given as input the regularization parameter $\lambda$ it solves the system (1) and provides as output the point $P(\lambda)$, that is the coordinates $\xi(\lambda)$ and $\eta(\lambda)$ of the L-curve. The function $C_k = \texttt{menger($P_j$, $P_k$, $P_\ell$)}$ is defined below in Sec.~\ref{sec:curv}.
The algorithm is iterative and identifies $\lambda_\mathrm{opt}$ with the golden section search, described in Sec.~\ref{sec:gss}.
\subsection{Curvature}
\label{sec:curv}
The function $C_k = \texttt{menger($P_j$, $P_k$, $P_\ell$)}$ is based on the definition of the curvature of a circle by three points given by Menger~\cite{menger1930untersuchungen} . In our case three values $\lambda_{j}<\lambda_{k}<\lambda_{\ell}$ of the regularization parameter identify three points $P(\lambda_{j})$, $P(\lambda_{k})$ and $P(\lambda_{\ell})$ on the L-curve.
Here we follow the notation of~\ref{eqn:lcurve} for the coordinates of a generic point $P(\lambda)$. For sake of simplicity of notation the substitution~\ref{eqn:subst} is made:
 %
\begin{equation}
\begin{aligned}
\label{eqn:subst}
\xi(\lambda_i)&\rightarrow \xi_i,\\
\eta(\lambda_i)&\rightarrow \eta_i,\\
P(\lambda_i)&\rightarrow P_i.
\end{aligned}
\end{equation}
So we define a signed curvature $C_{k}$ of the circumcircle as
\begin{equation}
\begin{aligned}
\label{eqn:menga}
C_k = \frac{2\cdot(\xi_{j}\eta_{k}+\xi_{k}\eta_{\ell}+\xi_{\ell}\eta_{j}-\xi_{j}\eta_{\ell}-\xi_{k}\eta_{j}-\xi_{\ell}\eta_{k})}
{\Big(\overline{P_{j}P_{k}}\cdot \overline{P_{k}P_{\ell}}\cdot \overline{P_{\ell}P_{j})}\Big)^{1/2}},
\end{aligned}
\end{equation}
where
\begin{equation}
\begin{aligned}
\label{eqn:defs}
\overline{P_{j}P_{k}}&=(\xb-\xa)^{2}+(\yb-\ya)^{2},\\
\overline{P_{k}P_{\ell}}&=(\xc-\xb)^{2}+(\yc-\yb)^{2},\\
\overline{P_{\ell}P_{j}}&=(\xa-\xc)^{2}+(\ya-\yc)^{2},
\end{aligned}
\end{equation}
are the euclidean distances between the sampled L-curve points. Note that we choose to index the curvature with the intermediate index ($k$) of the three points.
\subsection{Golden Section Search}
\label{sec:gss}
The algorithm is initialized by assigning the search interval $[\lambda_1,\lambda_4]$. Two other values $\lambda_{2}$ and $\lambda_{3}$ are calculated as
\begin{equation}
\begin{aligned}
\label{eqn:goldenratio}
\lambda_{2} &= (\lambda_{4}+\varphi\cdot\lambda_{1})/(1+\varphi), \\
\lambda_{3} &= \lambda_{1}+(\lambda_{4}-\lambda_{2}),\\
\end{aligned}
\end{equation}
where $\varphi = (1+\sqrt{5})/2$ is the golden section\cite{ kiefer1953sequential} .
 %
Four values of $\lambda$ define four points on the L-curve and allow to calculate two curvatures, $C_{2}$ from $\{P(\lambda_{1})$, $P(\lambda_{2})$, $P(\lambda_{3})\}$ and $C_{3}$ from $\{P(\lambda_{2})$, $P(\lambda_{3})$, $P(\lambda_{4})\}$.
The curvatures $C_{2}$ and $C_{3}$ are compared; consistent reassignment and recalculation are done in order to work at each iteration with four points $P(\lambda_1)\ldots P(\lambda_4)$.
The algorithm terminates when the search interval
$[\lambda_1,\lambda_4]$ is smaller than a specified threshold $\epsilon$ and returns $\lambda_\mathrm{opt}$.

Note that it may happen that the curvature $C_3$ associated to the right-hand circle is negative at the initial stage of the search, since $C_k$ is defined with sign in~\ref{eqn:menga}. Moreover by definition the corner must always correspond to a positive curvature and it lays on the left-side of the plot.  For these reasons the algorithm performs a check, and while $C_{3} < 0$ the search extreme $\lambda_{1}$ is kept fixed, $\lambda_{4}$ is shifted toward smaller values and   $\lambda_{2}$ and  $\lambda_{3}$ are recalculated. The condition on $C_3$ is strong enough that even in case of both negative curvatures it guarantees the convergence toward the corner.

Some considerations can be done: (a) according to the golden section search method, the algorithm needs to recalculate only one $P(\lambda)$ at each iteration (except for the first iteration), the other can be simply reassigned; this limit the calculation effort;
(b) as $P(\lambda_{1})$ and $P(\lambda_{4})$ are distant at the first iterations, $C_2$ and $C_3$ are just rough approximations of the curvature of the L-curve in different regions, but become more accurate as the distance between the search extremes decreases.
\begin{algorithm}[H]
\caption{L-curve corner search}
\label{alg}
\begin{algorithmic}[1]

\STATE{Initialize  $\lambda_{1}$ and $\lambda_{4}$;}
	\COMMENT{search extremes}
\STATE{Assign $\epsilon$;}
	\COMMENT{termination threshold}
\STATE{$\varphi \leftarrow (1+\sqrt{5})/2$;}
	\COMMENT{golden section}
\STATE{$\lambda_{2} \leftarrow (\lambda_{4}+\varphi\cdot\lambda_{1})/(1+\varphi)$;}
\STATE{$\lambda_{3} \leftarrow \lambda_{1}+(\lambda_{4}-\lambda_{2})$;}
 \FOR{$i=1$ to $4$}
 	\STATE{$P_{i}\leftarrow$\texttt{l\_curve\_P}($\lambda_i$);}
		\COMMENT{func. \texttt{l\_curve\_P} returns~\ref{eqn:lcurve}}
 \ENDFOR
\REPEAT
\STATE{$C_2 \leftarrow$\texttt{menger}($P_1$,$P_2$,$P_3$);}
	\COMMENT{func. \texttt{menger} calls~\ref{eqn:menga}}
\STATE{$C_3 \leftarrow$\texttt{menger}($P_2$,$P_3$,$P_4$);}

	\REPEAT
		\STATE{$\lambda_{4} \leftarrow \lambda_{3}$;\quad $P_{4} \leftarrow P_{3}$;}
		\STATE{$\lambda_{3} \leftarrow \lambda_{2}$;\quad $P_{3} \leftarrow P_{2}$;}
		\STATE{$\lambda_{2} \leftarrow (\lambda_{4}+\varphi\cdot\lambda_{1})/(1+\varphi)$;}
		\STATE{$P_{2}\leftarrow$\texttt{l\_curve\_P}($\lambda_2$);}
		\STATE{$C_3 \leftarrow$\texttt{menger}($P_2$,$P_3$,$P_4$);}
	\UNTIL{$C_3 >0$}

\IF{$C_{2} > C_{3}$}

	\STATE{$\lambda_\mathrm{opt}\leftarrow\lambda_{2}$;}
		\COMMENT{store $\lambda_\mathrm{opt}$}
	\STATE{$\lambda_{4} \leftarrow \lambda_{3}$; \quad $P_{4} \leftarrow P_{3}$;}
	\STATE{$\lambda_{3} \leftarrow \lambda_{2}$; \quad $P_{3} \leftarrow P_{2}$;}
	\STATE{$\lambda_{2} \leftarrow (\lambda_{4}+\varphi\cdot\lambda_{1})/(1+\varphi)$;}
	\STATE{$P_{2}\leftarrow$\texttt{l\_curve\_P}($\lambda_2$);}
		\COMMENT{only $P_2$ is recalculated}
\ELSE
	\STATE{$\lambda_\mathrm{opt}\leftarrow\lambda_{3}$}
	\STATE{$\lambda_{1} \leftarrow \lambda_{2}$; \quad $P_{1} \leftarrow P_{2}$;}
	\STATE{$\lambda_{2} \leftarrow \lambda_{3}$; \quad $P_{2} \leftarrow P_{3}$;}
	\STATE{$\lambda_{3} \leftarrow \lambda_{1}+(\lambda_{4}-\lambda_{2})$;}
	\STATE{$P_{3}\leftarrow$\texttt{l\_curve\_P}($\lambda_3$);}
		\COMMENT{only $P_3$ is recalculated}
\ENDIF
\UNTIL{ $(\lambda_{4}-\lambda_{1})/\lambda_{4}<\epsilon$}
\RETURN $\lambda_\mathrm{opt}$

\end{algorithmic}
\end{algorithm}

\begin{figure}[h]
\centering
\subfloat[Iteration 1]{\label{fig:lcurves1}\includegraphics[height=9cm]{L1.eps}}
\subfloat[Iteration 6]{\label{fig:lcurves2}\includegraphics[height=9cm]{L2.eps}}
\subfloat[Iteration 28]{\label{fig:lcurves3}\includegraphics[height=9cm]{L3.eps}}
\caption{The proposed algorithm at various iterations. The reference L-curve is reported as a solid line. Solid circles represent the points $P(\lambda)$ evaluated at the present iteration. Empty circles represent the points evaluated at past iterations. In~\ref{fig:lcurves1} arrows indicate the initial search extremes. In~\ref{fig:lcurves3} the four points are no more resolved, see Fig.~\ref{fig:zoom} for clarity.}
\label{fig:lcurves}
\end{figure}
\section{Example of application}
\label{sec:experiments}

In the following we show an example of application of the algorithm to electrical resistance tomography~\cite{holder2004electrical, seo2013electrical}. This example aims to image the sheet conductance spatial distribution of tin-oxide films on glass substrates having circular geometry and with electrical contacts on the sample boundary as shown in Fig.~\ref{fig:reca}.
Four-terminal resistance measurements among the contacts are performed with a scanning setup; the values are the elements of the data vector $\bm{b}$. A detailed description of the experiment is given in~\cite{cultrera2016Electrical}.

The reconstructed image (shown in Fig.~\ref{fig:recb}) is obtained by solving a discretized Laplace equation. Tikhonov regularization is applied.
Two software packages of common usage in the solution of ERT problems (EIDORS~\cite{adler2005eidors}, Regularisation Tools~\cite{hansen1994regularization} ) are here employed running under Matlab environment. EIDORS routines are used to generate a two-dimensional circular mesh (2304 elements) with 16 contact points (corresponding to a $\bm{b}$ of size 208) on the mesh boundary, to discretize the Laplace equation and thus obtain the matrix $\bm{A}$.
The library Regularisation Tools is employed to implement the function \texttt{L\_curve\_P($\lambda$)}. Other EIDORS routines are used to graphically render the solution $\bm{x}$ as in Fig.~\ref{fig:recb}.

The proposed algorithm is implemented in Matlab as well. Figures~\ref{fig:lcurves} and~\ref{fig:zoom} show the evolution of the search for $\lambda_\mathrm{opt}$ performed by the algorithm. These figures display also a full L-curve obtained by dense sampling of \texttt{L-\_curve\_P($\lambda$)} as a reference.

The algorithm is run by choosing as initial search extremes $\lambda_{1} = 1\cdot10^{-10}$ and $\lambda_{4} = 1\cdot10^{-3}$.
Fig.~\ref{fig:lcurves} reports three snapshots of the running algorithm. Empty circles represent points visited at previous iterations, while filled circles represent the four points $P_1 \ldots P_4$ of the given iteration.
Fig.~\ref{fig:zoom} shows a detail of the last iteration. The reader can notice in Fig.~\ref{fig:zoom1} the L-curve the ``corner''. Fig.~\ref{fig:zoom2} shows the $P(\lambda_i)$ points of the last iteration, where the magnification factor does not allow anymore to appreciate the curvature.
\begin{figure}[h]
\centering
\subfloat[]{\label{fig:zoom1}\includegraphics[height=7cm]{L3Z1.eps}}
\subfloat[]{\label{fig:zoom2}\includegraphics[height=7cm]{L3Z2.eps}}
\caption{Detail of the last iteration. In~\ref{fig:zoom1} it is visible the ``corner'' of the present L-curve. In~\ref{fig:zoom2} the four $P(\lambda)$ are resolved. The label indicates $\lambda_{opt}$.}
\label{fig:zoom}
\end{figure}
Fig.~\ref{fig:conv} shows the evolution of the algorithm towards convergence. For sake of generality, the search extremes were chosen very far from each other; when knowledge about the problem allows to restrict the $\lambda$ search interval, the number of iterations can be reduced.
\begin{figure}[tbhp]
\centering
\includegraphics[width=8cm]{convergence.eps}
\caption{Behaviour of the algorithm versus iteration number for the present data with a threshold $\epsilon = 1\%$. The steep slope corresponds to lines 9-18 of the algorithm~\ref{alg}. The last point (iteration 28) corresponds to $\lambda_\mathrm{opt}$.}
\label{fig:conv}
\end{figure}
The $\lambda_\mathrm{opt}$ returned by the algorithm with a $\epsilon = 1\%$ is $1.84\cdot10^{-6}$. This result is used to perform the final image reconstruction shown in Fig.~\ref{fig:recb}.
\begin{figure}[tbhp]
\centering
\subfloat[Scheme of the sample. Colors represent nominal values of sheet conductance.]{\label{fig:reca}\includegraphics[width=6cm]{reca.eps}}
\qquad
\subfloat[Sheet conductance map reconstructed from the data with $\lambda=1.84\cdot10^{-6}$.]{\label{fig:recb}\includegraphics[width=6cm]{recb.eps}}
\caption{Sheet conductance map obtained with the optimal regularization parameter $\lambda_\mathrm{opt}$ returned by our algorithm.}
\label{fig:rec}
\end{figure}

\section{Conclusions}
\label{sec:conclusions}
The proposed algorithm allows, for a given inverse problem having the form \ref{eqn:lsq},  the determination of the regularization parameter $\lambda_\mathrm{opt}$ corresponding to the maximum positive curvature of the L-curve. The algorithm is designed for maximum simplicity of implementation on already existing solvers. In a test on real electrical resistance tomography problem, convergence is achieved in a couple of dozen iterations, each iteration corresponding to a redetermination of \ref{eqn:funct}.
\bibliographystyle{plain}


On uniqueness of the Laplace transform on time scales

Abstract: After introducing the concept of null functions, we shall present a uniqueness result in the sense of the null functions for the Laplace transform on time scales with arbitrary graininess. The result can be regarded as a dynamic extension of the well-known Lerch's theorem.

\section{Introduction}\label{intro}

The Laplace transform is one of the fundamental representatives of
integral transformations used in mathematical analysis.
This transform is essentially bijective for the majority of
practical uses. The Laplace transform has the useful property that
many relationships and operations over the originals functions correspond to
simpler relationships and operations over the image functions.
The discrete analogue of the Laplace transform is called as $Z$-transform,
which is also converts a sequence of real or complex numbers
into a complex frequency-domain representation.
This transform is also bijective.

The calculus on time scales has been initiated by Hilger (see \cite{MR1066641}) in order to
unify the theories of continuous analysis and of discrete analysis.
The Laplace transform on time scales was introduced by Hilger in \cite{MR1722974},
but in a form that tries to unify the (continuous) Laplace transform
and the (discrete) $Z$-transform.
For arbitrary time scales, the Laplace transform was
introduced by and investigated by Bohner and Peterson in \cite{MR1948468}
(see also \cite[Section~3.10]{MR1843232}).
Let $\sup\T=\infty$, for locally $\Delta$-integrable function $f:[s,\infty)_{\T}\to\C$,
i.e., $\Delta$-integrable over each compact interval of $[s,\infty)_{\T}$, the Laplace transform is defined to be
\begin{equation}
\lt{}\{f\}(z):=\int_{s}^{\infty}f(\eta)\ef_{\ominus{}z}(\sigma(\eta),s)\Delta\eta\quad\text{for}\ z\in\mathcal{D},\notag
\end{equation}
where $\mathcal{D}$ consists of such complex numbers for which the improper integral converges.
In order to determine an explicit region of convergence,
conditions on the class of the determining functions should be provided.
This was done by Davis et al.\ in \cite{MR2324337},
where some restrictions were imposed on the graininess $\mu$.
In a recent paper \cite{bo/gu/ka10}, Bohner et al.\ removed the restriction on the graininess
of the time scale and considered some fundamental properties of the
Laplace transform on time scales.
The readers may be referred to \cite{MR1129464,MR1716143,MR0622023} for the basic properties
of the usual Laplace transform.
For other results about the Laplace transform on time scales,
see \cite{MR2597442,MR2320804,MR2585078,MR2679122}.

The uniqueness property of the Laplace transform and of the $Z$-transform are well-known
(see \cite{MR1129464,MR1716143,MR0622023}), which is a necessary tool for the inverse Laplace transform.
To the best of our knowledge, nothing has been published up to now on the uniqueness of the
Laplace transform on arbitrary time scales.
In this paper, we shall provide a uniqueness result on time scales with arbitrary
graininess for the Laplace transform,
which reduces to the well-known the Lerch's theorem in the continuous case.
Our result on time scales with constant graininess ($\R$ and $\Z$),
gives a unified proof for the uniqueness of the Laplace transform
(the usual Laplace transform and the $Z$-transform).

The paper is organized as follows:
In Section~\ref{al}, we present some results that are required in the proof of
the main result.
In Section~\ref{ult}, we state and prove our main results together with some
necessary definitions.
And in Section~\ref{pts}, as an appendix, we recall a short account concerning
the time scale calculus.

\section{Auxiliary Lemmas}\label{al}

We define the minimal graininess function $\mu_{\ast}:\T\to\R_{0}^{+}$ by
\begin{equation}
\mu_{\ast}(s):=\inf\big\{\mu(t):\ t\in[s,\infty)_{\T}\big\}\quad\text{for}\ s\in\T\notag
\end{equation}
and the set of positively regressive constants $\creg{+}(\T,\C)$ by
\begin{equation}
\creg{+}(\T,\C):=\big\{z\in\C:\ 1+z\mu(t)>0\ \text{for all}\ t\in\T\big\}.\notag
\end{equation}
For $h\in\R_{0}^{+}$ and $\lambda\in\creg{+}(\T,\R)$, we also define the set $\C_{h}(\lambda)$ by
\begin{equation}
\C_{h}(\lambda):=\big\{z\in\C_{h}:\ \Rl_{h}(z)>\lambda\big\}.\notag
\end{equation}

Now, we proceed this section with a result quoted from \cite{bo/gu/ka10}.

\begin{lemma}[See {\protect\cite[Theorem~3.4(iii)]{bo/gu/ka10}}]\label{allm1}
Let $\sup\T=\infty$, $s\in\T$, $\lambda\in\creg{+}([s,\infty)_{\T},\R)$ and $z\in\C_{\mu_{\ast}(s)}(\lambda)$, then
\begin{equation}
\lim_{t\to\infty}\ef_{\lambda\ominus{}z}(t,s)=0.\notag
\end{equation}
\end{lemma}

The inclusion $\R^{+}\subset\C_{\mu_{\ast}(s)}(0)$ for any $s\in\T$ yields the following corollary.

\begin{corollary}\label{alcrl1}
Let $\sup\T=\infty$, $s\in\T$ and $x\in\R^{+}$, then
\begin{equation}
\lim_{t\to\infty}\ef_{\ominus{}x}(t,s)=0\quad\text{and}\quad\lim_{t\to\infty}\ef_{x}(t,s)=\infty.\notag
\end{equation}
\end{corollary}

Next, we present a result on asymptotic property of the time scale exponential.

\begin{lemma}\label{allm2}
Let $s,t\in\T$ and $\lambda\in\R^{+}$, then
\begin{equation}
\lim_{x\to\infty}\big[x^{\lambda}\ef_{\ominus{}x}(t,s)\big]=
\begin{cases}
0,&t>s\\
\infty,&t\leq s.
\end{cases}\notag
\end{equation}
\end{lemma}

\begin{proof}
As we will be considering the limit as $x\to\infty$, we may assume that $x\in\R^{+}$.
First, we consider the case $s,t\in\T$ with $t>s$.
We may find $n\in\N$ such that $n>\lambda$.
By the Taylor's formula, we have
\begin{equation}
\ef_{x}(t,s)=\sum_{\ell=0}^{n}x^{\ell}\hf_{\ell}(t,s)+x^{n+1}\int_{s}^{t}\hf_{n}(t,\sigma(\eta))\ef_{x}(\eta,s)\Delta\eta\geq{}x^{n}\hf_{n}(t,s).\notag
\end{equation}
Therefore, we see that
\begin{equation}
0\leq x^{\lambda}\ef_{\ominus{}x}(t,s)=\frac{x^{\lambda}}{\ef_{x}(t,s)}\leq\frac{x^{\lambda}}{x^{n}\hf_{n}(t,s)},\notag
\end{equation}
which proves $x^{\lambda}\ef_{\ominus{}x}(t,s)\to0$ by letting $x\to\infty$.
Next, let $s,t\in\T$ with $t\leq s$, then $\ef_{\ominus{}x}(t,s)=\ef_{x}(s,t)\geq1$ and thus we have $x^{\lambda}\ef_{\ominus{}x}(t,s)\geq{}x^{\lambda}$, which shows that $x^{\lambda}\ef_{\ominus{}x}(t,s)\to\infty$ as $x\to\infty$.
This completes the proof.
\end{proof}

Let us introduce the function $\Lambda:\creg{}(\T,\R)\times\T\times\T\to\R$ defined by
\begin{equation}
\Lambda(x;t,s):=\exp\big\{-x\ef_{\ominus{}x}(t,s)\big\}\quad\text{for}\ x\in\creg{}(\T,\R)\ \text{and}\ s,t\in\T.\label{aleq1}
\end{equation}

\begin{corollary}\label{alcrl2}
Let $s,t\in\T$, then
\begin{equation}
\lim_{x\to\infty}\Lambda(x;t,s)=\chi_{(-\infty,t)_{\T}}(s),\notag
\end{equation}
where $\chi_{D}:\R\to\{0,1\}$ is the characteristic function of the set $D\subset\R$.
\end{corollary}

\section{Uniqueness of the Laplace Transform}\label{ult}

In this section, we shall always assume that $\sup\T=\infty$.
We first start with the definition of the set of null functions.

\begin{definition}\label{ultdf1}
A function $f:[s,\infty)_{\T}\to\C$ is called a \emph{null function} if
\begin{equation}
\int_{s}^{t}f(\eta)\Delta\eta=0\quad\text{for all}\ t\in[s,\infty)_{\T}.\notag
\end{equation}
The set of null functions on will be denoted by $\nf([s,\infty)_{\T},\C)$.
\end{definition}

Next, we give some properties of the null functions some of
which will be required in the proof of the main result.

\begin{lemma}\label{ultlm2}
Let $f\in\nf([s,\infty)_{\T},\C)$ and $g\in\crd{1}([s,\infty)_{\T},\C)$, then $fg^{\sigma}\in\nf([s,\infty)_{\T},\C)$.
\end{lemma}

\begin{proof}
Performing an integration by parts, for any $t\in[s,\infty)_{\T}$, we have
\begin{equation}
\int_{s}^{t}f(\eta)g^{\sigma}(\eta)\Delta\eta=\Bigg[\bigg[\int_{s}^{\eta}f(\zeta)\Delta\zeta\bigg]g(\eta)\Bigg]_{\eta=s}^{\eta=t}-\int_{s}^{t}\bigg[\int_{s}^{\eta}f(\zeta)\Delta\zeta\bigg]g^{\Delta}(\eta)\Delta\eta=0,\notag
\end{equation}
which proves the claim.
\end{proof}

\begin{corollary}\label{ultcrl1}
Let $f\in\nf([s,\infty)_{\T},\C)$ and $g\in\reg{}([s,\infty)_{\T},\C)$, then $f\ef_{g}(\sigma(\cdot),s)\in\nf([s,\infty)_{\T},\C)$.
\end{corollary}

\begin{corollary}\label{ultcrl1a}
Let $f\in\nf([s,\infty)_{\T},\C)$, then
\begin{equation}
\int_{s}^{\infty}f(\eta)\ef_{\ominus z}(\sigma(\eta),s)\Delta\eta=0\quad\text{for any}\ z\in\creg{}([s,\infty)_{\T},\C).\label{ultcrl1aeq1}
\end{equation}
\end{corollary}

We have now filled the necessary background for the proof of our main result.

\begin{theorem}[Lerch's theorem]\label{lerchthm}
Assume that $f:[s,\infty)_{\T}\to\C$, there exist an increasing divergent sequence $\{\varsigma_{k}\}_{k\in\N_{0}}\subset\R_{0}^{+}$ and $\alpha\in\creg{+}([s,\infty)_{\T},\C)$ such that
\begin{equation}
\lt{}\{f\ef_{\ominus(n\odot\varsigma_{k})}(\sigma(\cdot),s)\}(\alpha)=0\quad\text{for all}\ n,k\in\N_{0}.\label{lerchthmeq1}
\end{equation}
Then $f\in\nf([s,\infty)_{\T},\C)$.
\end{theorem}

\begin{proof}
Define the function $g:[s,\infty)_{\T}\to\C$ by $g(t):=f(t)\ef_{\ominus\alpha}(\sigma(t),s)$ for $t\in[s,\infty)_{\T}$, then we have
\begin{align}
\int_{s}^{\infty}g(\eta)\ef_{\ominus(n\odot\varsigma_{k})}(\sigma(\eta),s)\Delta\eta=&\int_{s}^{\infty}f(\eta)\ef_{\ominus(n\odot\varsigma_{k})}(\sigma(\eta),s)\ef_{\ominus\alpha}(\sigma(\eta),s)\Delta\eta\notag\\
=&\int_{s}^{\infty}f(\eta)\ef_{\ominus(\alpha\oplus(n\odot\varsigma_{k}))}(\sigma(\eta),s)\Delta\eta=0\label{lerchthmprfeq1}
\end{align}
for all $n,k\in\N_{0}$.
Let $r\in[s,\infty)_{\T}$, and define $h:[s,\infty)_{\T}\to\C$ by
\begin{equation}
h_{r}(t):=\int_{r}^{t}g(\eta)\Delta\eta\quad\text{for}\ t\in[s,\infty)_{\T}.\notag
\end{equation}
It follows from \eqref{lerchthmeq1} with $n=0$ that
\begin{equation}
\int_{s}^{\infty}g(\eta)\Delta\eta=0,\label{lerchthmprfeq2}
\end{equation}
which shows that $\lim_{t\to\infty}h_{r}(t)$ exists.
So we can find $M_{r}\in\R^{+}$ such that $|h_{r}(t)|\leq M_{r}$ for all $t\in[r,\infty)_{\T}$.
We may (and do) assume that $M_{r}\to0$ as $r\to\infty$.
Using \eqref{lerchthmprfeq1}, and performing integration by parts, we get
\begin{align}
\int_{s}^{r}g(\eta)\ef_{\ominus(n\odot\varsigma_{k})}(\sigma(\eta),s)\Delta\eta=&-\int_{r}^{\infty}g(\eta)\ef_{\ominus(n\odot\varsigma_{k})}(\sigma(\eta),s)\Delta\eta\notag\\
\begin{split}
=&-\bigg[\big[\ef_{\ominus(n\odot\varsigma_{k})}(\eta,s)h_{r}(\eta)\big]_{\eta=r}^{\eta\to\infty}\\
&-\int_{r}^{\infty}\ef_{\ominus(n\odot\varsigma_{k})}^{\Delta_{1}}(\eta,s)h_{r}(\eta)\Delta\eta\bigg]\\
\end{split}\notag\\
\begin{split}
=&-\bigg[\big[\big(\ef_{\ominus\varsigma_{k}}(\eta,s)\big)^{n}h_{r}(\eta)\big]_{\eta=r}^{\eta\to\infty}\\
&+\int_{r}^{\infty}(n\odot\varsigma_{k})(\eta)\ef_{\ominus(n\odot\varsigma_{k})}(\sigma(\eta),s)h_{r}(\eta)\Delta\eta\bigg]
\end{split}\notag\\
=&-\int_{r}^{\infty}(n\odot\varsigma_{k})(\eta)\ef_{\ominus(n\odot\varsigma_{k})}(\sigma(\eta),s)h_{r}(\eta)\Delta\eta\label{lerchthmprfeq3}
\end{align}
for all $n,k\in\N_{0}$.
Note that above have used Corollary~\ref{alcrl1} while passing to the last step.
Now multiplying both sides of \eqref{lerchthmprfeq3} with $\ef_{\ominus(n\odot\varsigma_{k})}(s,r)$, we have
\begin{equation}
\int_{s}^{r}g(\eta)\ef_{\ominus(n\odot\varsigma_{k})}(\sigma(\eta),r)\Delta\eta=-\int_{r}^{\infty}(n\odot\varsigma_{k})(\eta)\ef_{\ominus(n\odot\varsigma_{k})}(\sigma(\eta),r)h_{r}(\eta)\Delta\eta,\notag
\end{equation}
which yields
\begin{equation}
\bigg|\int_{s}^{r}g(\eta)\ef_{\ominus(n\odot\varsigma_{k})}(\sigma(\eta),r)\Delta\eta\bigg|\leq M_{r}\int_{r}^{\infty}(n\odot\varsigma_{k})(\eta)\ef_{\ominus(n\odot\varsigma_{k})}(\sigma(\eta),r)\Delta\eta=M_{r}.\notag
\end{equation}
By the series expansion of the exponential function, we know that
\begin{equation}
\sum_{\ell\in\N_{0}}\frac{(-1)^{\ell}\varsigma_{k}^{\ell}}{\ell!}\ef_{\ominus(\ell\odot\varsigma_{k})}(t,s)=\Lambda(\varsigma_{k};t,s)\quad\text{for}\ s,t\in\T\ \text{and}\ k\in\N_{0},\notag
\end{equation}
where $\Lambda$ is defined by \eqref{aleq1}.
Thus, for all $t\in[s,r)_{\T}$ and all $k\in\N_{0}$, we can estimate that
\begin{align}
\bigg|\int_{s}^{r}g(\eta)\Lambda(\varsigma_{k};\sigma(\eta),t)\Delta\eta\bigg|=&\bigg|\sum_{\ell\in\N_{0}}\frac{(-1)^{\ell-1}\varsigma_{k}^{\ell}}{\ell!}\int_{s}^{r}g(\eta)\ef_{\ominus(\ell\odot\varsigma_{k})}(\sigma(\eta),t)\Delta\eta\bigg|\notag\\
\leq&\sum_{\ell\in\N_{0}}\frac{\varsigma_{k}^{\ell}}{\ell!}\ef_{\ominus(\ell\odot\varsigma_{k})}(r,t)\bigg|\int_{s}^{r}g(\eta)\ef_{\ominus(\ell\odot\varsigma_{k})}(\sigma(\eta),r)\Delta\eta\bigg|\notag\\
\leq&M_{r}\sum_{\ell\in\N_{0}}\frac{\varsigma_{k}^{\ell}}{\ell!}\big(\ef_{\ominus\varsigma_{k}}(r,t)\big)^{\ell}=M_{r}\exp\big\{\varsigma_{k}\ef_{\ominus\varsigma_{k}}(r,t)\big\}.\notag
\end{align}
Letting $r\to\infty$, we have $M_{r}\to0$ and $\ef_{\ominus\varsigma_{k}}(r,t)\to0$ by Corollary~\ref{alcrl1}, which yields $M_{r}\exp\{\varsigma_{k}\ef_{\ominus\varsigma_{k}}(r,t)\}\to0$ as $r\to\infty$.
We can therefore write
\begin{equation}
\int_{s}^{\infty}g(\eta)\Lambda(\varsigma_{k};\sigma(\eta),t)\Delta\eta=0\quad\text{for all}\ k\in\N_{0}.\label{lerchthmprfeq4}
\end{equation}
By \eqref{lerchthmprfeq2}, the function $g$ is integrable over $[s,\infty)_{\T}$ and the characteristic function $\chi$ is piecewise constant.
Letting $k\to\infty$ in \eqref{lerchthmprfeq4}, we get
\begin{equation}
\int_{s}^{\infty}g(\eta)\chi_{(-\infty,t)_{\T}}(\sigma(\eta))\Delta\eta=0\quad\text{for all}\ t\in[s,\infty)_{\T}\label{lerchthmprfeq5}
\end{equation}
by Lebesque's dominated convergence theorem and Corollary~\ref{alcrl2}.
Now, we are in a position to prove that
\begin{equation}
\int_{s}^{t}g(\eta)\Delta\eta=0\quad\text{for all}\ t\in[s,\infty)_{\T}.\label{lerchthmprfeq6}
\end{equation}
From \eqref{lerchthmprfeq5}, for all $t\in[s,\infty)_{\T}$, we have
\begin{align}
\int_{s}^{\infty}g(\eta)\chi_{(-\infty,t)_{\T}}(\sigma(\eta))\Delta\eta=&\int_{s}^{t}g(\eta)\chi_{[s,t)_{\T}}(\sigma(\eta))\Delta\eta\notag\\
=&\int_{s}^{t}g(\eta)\big[\chi_{[s,t)_{\T}}(\eta)+\mu(\eta)\chi_{[s,t)_{\T}}^{\Delta}(\eta)\big]\Delta\eta\notag\\
=&\int_{s}^{t}g(\eta)\chi_{[s,t)_{\T}}(\eta)\Delta\eta,\notag
\end{align}
which together with the definition of the characteristic function $\chi$ and \eqref{lerchthmprfeq5} gives \eqref{lerchthmprfeq6}.
Therefore, we learn that $g$ is a null function.
An application of Corollary~\ref{ultcrl1} shows that $f=g\ef_{\alpha}(\sigma(\cdot),s)$ is a null function too.
This completes the proof.
\end{proof}

\begin{corollary}
Assume that $f,g:[s,\infty)_{\T}\to\C$, there exist an increasing divergent sequence $\{\varsigma_{k}\}_{k\in\N_{0}}\subset\R^{+}$ and $\alpha\in\creg{+}([s,\infty)_{\T},\C)$ such that
\begin{equation}
\lt{}\{f\ef_{\ominus(n\odot\varsigma_{k})}(\sigma(\cdot),s)\}(\alpha)=\lt{}\{g\ef_{\ominus(n\odot\varsigma_{k})}(\sigma(\cdot),s)\}(\alpha)\quad\text{for all}\ n,k\in\N_{0}.\notag
\end{equation}
Then $f-g\in\nf([s,\infty)_{\T},\C)$.
\end{corollary}

\begin{corollary}
Assume that the graininess function $\mu$ is constant and there exists $\alpha\in\creg{+}([s,\infty)_{\T},\C)$ such that
\begin{equation}
\lt{}\{f\}(z)=0\quad\text{for all}\ z\in\C_{\mu_{\ast}(s)}(\alpha).\notag
\end{equation}
Then $f\in\nf([s,\infty)_{\T},\C)$.
\end{corollary}

\begin{proof}
In this case, for any fixed $\beta\in\R_{\mu_{\ast}(s)}(\alpha)\subset\C_{\mu_{\ast}(s)}(\alpha)$, we have
\begin{equation}
\lt{}\{f\}(\beta)=0,\notag
\end{equation}
which yields $\beta\oplus((nk)\odot\varsigma)\in\R_{\mu_{\ast}(s)}(\alpha)\subset\C_{\mu_{\ast}(s)}(\alpha)$ for all $n,k\in\N_{0}$ and all $t\in[s,\infty)_{\T}$, where $\varsigma\in\R^{+}$, i.e.,
\begin{equation}
\lt{}\{f\}(\beta\oplus((nk)\odot\varsigma))=\lt{}\{f\ef_{\ominus((nk)\odot\varsigma)}(\sigma(\cdot),s)\}(\beta)=0\quad\text{for all}\ n,k\in\N_{0}.\notag
\end{equation}
This shows that the conditions of Theorem~\ref{lerchthm} hold with $\varsigma_{k}:=k\odot\varsigma$ for $k\in\N_{0}$.
\end{proof}

\section{Appendix: Time Scales Essentials}\label{pts}

A \emph{time scale}, which inherits the standard topology on $\R$,
is a nonempty closed subset of reals.
Throughout this paper, the time scale is assumed to be unbounded above and
will be denoted by the symbol $\T$,
and the intervals with a subscript $\T$ are used to denote
the intersection of the usual interval with $\T$.
For $t\in\T$, we define the \emph{forward jump operator}
$\sigma:\T\to\T$ by $\sigma(t):=\inf(t,\infty)_{\T}$
while the \emph{graininess function}
$\mu:\T\to\R_{0}^{+}$ is defined to be $\mu(t):=\sigma(t)-t$.
A point $t\in\T$ is called \emph{right-dense} if $\sigma(t)=t$;
otherwise, it is called \emph{right-scattered},
and similarly \emph{left-dense} and \emph{left-scattered} points
are defined in terms of the so-called backward jump operator.
A function $f:\T\to\C$ is said to be \emph{Hilger differentiable}
(or $\Delta$-differentiable) at the point $t\in\T$ if there exists $\ell\in\C$ such that for any
$\varepsilon>0$ there exists a neighborhood $U$ of $t$ such that
\begin{equation}
\big|[f(\sigma(t))-f(s)]-\ell[\sigma(t)-s]\big|\leq\varepsilon|\sigma(t)-s|\quad\text{for all}\ s\in U,\notag
\end{equation}
and in this case we denote $f^{\Delta}(t)=\ell$.
A function $f$ is called \emph{rd-continuous}
provided that it is continuous at right-dense points in $\T$,
and has finite limits at left-dense points,
and the set of rd-continuous functions is denoted by $\crd{}(\T,\C)$.
The set of functions $\crd{1}(\T,\C)$ includes the functions whose
derivative is in $\crd{}(\T,\C)$ too.
For $f\in\crd{1}(\T,\C)$, we have
\begin{equation}
f^{\sigma}=f+\mu f^{\Delta}\quad\text{on}\ \T^{\kappa},\notag
\end{equation}
where $f^{\sigma}:=f\circ\sigma$ and $\T^{\kappa}:=\T\backslash\{\sup\T\}$ if $\sup\T=\max\T$ and satisfies $\rho(\max\T)\neq\max\T$; otherwise, $\T^{\kappa}:=\T$.
For $s,t\in\T$ and a function $f\in\crd{}(\T,\C)$,
the $\Delta$-integral of $f$ is defined by
\begin{equation}
\int_{s}^{t}f(\eta)\Delta\eta=F(t)-F(s)\quad\text{for}\ s,t\in\T,\notag
\end{equation}
where $F:\T\to\C$ is an antiderivative of $f$,
i.e., $F^{\Delta}=f$ on $\T^{\kappa}$.

A function $f\in\crd{}(\T,\C)$
is called \emph{regressive} if $1+\mu f\neq0$ on $\T$,
and \emph{positively regressive} if it is real valued and $1+\mu f>0$ on $\T$.
The set of regressive functions and the set of positively regressive functions
are denoted by $\reg{}(\T,\C)$ and $\reg{+}(\T,\R)$, respectively,
and $\reg{-}(\T,\R)$ is defined similarly.
For simplicity, we denote by $\creg{}(\T,\C)$ the set of complex regressive constants,
and similarly, we define the sets $\creg{+}(\T,\R)$ and $\creg{-}(\T,\R)$.

Let $f\in\reg{}(\T,\C)$.
Then the \emph{exponential function} $\ef_{f}(\cdot,s)$ is defined
to be the unique solution of the initial value problem
\begin{equation}
\begin{cases}
x^{\Delta}=fx\quad\text{on}\ \T^{\kappa}\\
x(s)=1
\end{cases}\notag
\end{equation}
for some fixed $s\in\T$.
For $h>0$, set
\begin{equation}
\C_{h}:=\big\{z\in\C:\ z\neq-1/h\big\}\quad\text{and}\quad\Z_{h}:=\big\{z\in\C:\-\pi/h<\Img(z)\leq\pi/h\big\},\notag
\end{equation}
and $\C_{0}:=\Z_{0}:=\C$.
For $h\in\R_{0}^{+}$, the Hilger \emph{real part} and \emph{imaginary part}
of a complex number are given by
\begin{equation}
\Rl_{h}(z):=\lim_{\nu\to h}\frac{1}{\nu}\big(|1+\nu z|-1\big)\quad\text{and}\quad\Img_{h}(z):=\lim_{\nu\to h}\frac{1}{\nu}\Arg(1+\nu z),\notag
\end{equation}
respectively, where $\Arg$ denotes the principle argument function,
i.e., $\Arg:\C\to(-\pi,\pi]_{\R}$.
For $h\in\R_{0}^{+}$ and any fixed $z\in\C_{h}$, the Hilger real part $\Rl_{h}(z)$ is a nondecreasing function of $h\in\R_{0}^{+}$, i.e., $\Rl_{h_{1}}(z)\geq\Rl_{h_{2}}(z)$ for $h_{1},h_{2}\in\R_{0}^{+}$ with $h_{1}\geq h_{2}$.
For $h\in\R_{0}^{+}$, we define the \emph{cylinder transformation}
$\xi_{h}:\C_{h}\to\Z_{h}$ by
\begin{equation}
\xi_{h}(z):=\lim_{\nu\to h}\frac{1}{\nu}\Log(1+\nu z)\quad\text{for}\ z\in\C_{h}.\notag
\end{equation}
Then the exponential function can also be written in the form
\begin{equation}
\ef_{f}(t,s):=\exp\bigg\{\int_{s}^{t}\xi_{\mu(\eta)}\big(f(\eta)\big)\Delta\eta\bigg\}\quad\text{for}\ s,t\in\T.\notag
\end{equation}

It is known that the exponential function $\ef_{f}(\cdot,s)$ is
strictly positive on $[s,\infty)_{\T}$
provided that $f\in\reg{+}([s,\infty)_{\T},\R)$,
while $\ef_{f}(\cdot,s)$ alternates in sign at
right-scattered points of the interval $[s,\infty)_{\T}$
provided that $f\in\reg{-}([s,\infty)_{\T},\R)$.
For $h\in\R_{0}^{+}$ and $w,z\in\C_{h}$, the \emph{circle plus} and the \emph{circle minus}
are defined by
\begin{equation}
z\oplus_{h}w:=z+w+hzw\quad\text{and}\quad z\ominus_{\mu}w:=\frac{z-w}{1+hw},\notag
\end{equation}
respectively. It is known that $(\reg{}(\T,\C),\oplus_{\mu})$ is a group,
and the inverse of $f\in\reg{}(\T,\C)$ is $\ominus_{\mu}f:=0\ominus_{\mu}f$.
Moreover, $\creg{+}(\T,\C)$ is a subgroup of $\creg{}(\T,\C)$.
For $\lambda\in\C$ and $z\in\C_{h}$, the \emph{circle dot} is defined by
\begin{equation}
\lambda\odot_{h}z:=\lim_{\nu\to h}\frac{1}{\nu}\big((1+\nu z)^{\lambda}-1\big).\notag
\end{equation}
With this multiplication, $(\reg{}(\T,\C),\oplus_{\mu},\odot_{\mu})$ becomes a complex vector space.
It should be noted that
\begin{equation}
\ef_{\lambda\odot_{\mu}f}(t,s)=\big(\ef_{f}(t,s)\big)^{\lambda}\quad\text{for}\ s,t\in\T,\notag
\end{equation}
where $\lambda\in\C$ and $f\in\reg{}(\T,\C)$.
For simplicity in the notation, we shall use $\oplus,\ominus$ and $\odot$ instead of $\oplus_{\mu},\ominus_{\mu}$ and $\odot_{\mu}$, respectively.

The definition of the generalized monomials on time scales
(see \cite[\S~1.6]{MR1843232}) $\hf_{n}:\T\times\T\to\R$ is given as
\begin{equation}
\hf_{n}(t,s):=
\begin{cases}
1,&n=0,\\
\displaystyle\int_{s}^{t}\hf_{n-1}(\eta,s)\Delta\eta,&n\in\N
\end{cases}\quad\text{for}\ s,t\in\T.\notag
\end{equation}
Using induction, it is easy to see that
$\hf_{n}(t,s)\geq0$ holds for all $n\in\N_{0}$
and all $s,t\in\T$ with $t\geq s$,
and $(-1)^{n}\hf_{n}(t,s)\geq 0$ holds for all $n\in\N$
and all $s,t\in\T$ with $t\leq s$.

The readers are referred to \cite{MR1843232}
for fundamentals of time scale theory.