Learning Regularity in Skeleton Trajectories for Anomaly Detection in Videos

Abstract: Appearance features have been widely used in video anomaly detection even though they contain complex entangled factors. We propose a new method to model the normal patterns of human movements in surveillance video for anomaly detection using dynamic skeleton features. We decompose the skeletal movements into two sub-components: global body movement and local body posture. We model the dynamics and interaction of the coupled features in our novel Message-Passing Encoder-Decoder Recurrent Network. We observed that the decoupled features collaboratively interact in our spatio-temporal model to accurately identify human-related irregular events from surveillance video sequences. Compared to traditional appearance-based models, our method achieves superior outlier detection performance. Our model also offers "open-box" examination and decision explanation made possible by the semantically understandable features and a network architecture supporting interpretability.

\section{Introduction}

\input{cr_introduction.tex}

\section{Related Work}

\input{cr_related_work.tex}

\section{Method}

\input{cr_method.tex}

\section{Experiments}

\input{cr_experiments.tex}

\section{Discussion}

\input{cr_discussion.tex}

\section{Conclusions}

\input{cr_conclusions.tex}

{\small{}\bibliographystyle{ieee}

\subsection{ShanghaiTech Campus Dataset}

The ShanghaiTech Campus dataset \cite{luo2017revisit} is considered
one of the most comprehensive and realistic datasets for video anomaly
detection currently available. It combines footage of 13 different
cameras around the ShanghaiTech University campus with a wide spectrum
of anomaly types. Because of the sophistication of the anomaly semantics,
current methods struggle to get adequate performance on it.

Most of the anomaly events in the ShanghaiTech dataset are related
to humans, which are the target of our method. We left out 6/107 test
videos whose abnormal events were not related to humans and kept the
other 101 videos as a subset called Human-related (HR) ShanghaiTech.
Most of the experiments discussed in this section are conducted on
the HR-ShanghaiTech dataset.

\subsubsection{Comparison with Appearance-based Methods\label{subsec:Comparison-with-Appearance-based}}

\begin{table}
\caption{Frame-level ROC AUC performance of MPED-RNN and other state-of-the-art
methods on the ShanghaiTech dataset and its human-related subset.
We use the reported results of the referenced methods on ShanghaiTech
and carry out their identical experiments on HR-ShanghaiTech whenever
possible.\label{tab:Performances-SHT}}

\centering{}%
\begin{tabular}{clcc}
\toprule
\multicolumn{2}{c}{} & HR-ShanghaiTech & ShanghaiTech\tabularnewline
\midrule
\multicolumn{2}{l}{Conv-AE \cite{hasan2016learning}} & 0.698 & 0.704\tabularnewline
\addlinespace
\multicolumn{2}{l}{TSC sRNN \cite{luo2017revisit}} & N/A & 0.680\tabularnewline
\addlinespace
\multicolumn{2}{l}{Liu \etal \cite{liu2018anopred}} & 0.727 & 0.728\tabularnewline
\addlinespace
\midrule
\multicolumn{2}{l}{MPED-RNN} & \textbf{0.754} & \textbf{0.734}\tabularnewline
\bottomrule
\addlinespace
\end{tabular}
\end{table}
We train MPED-RNN on all training videos, which is the practice adopted
in previous works. Table \ref{tab:Performances-SHT} compares the
frame-level ROC AUC of MPED-RNN against three state-of-the-art methods.
We observe that on HR-ShanghaiTech, MPED-RNN outperforms all the compared
methods. For completeness, we also evaluate MPED-RNN on the original
dataset where non-human related anomalies are present and MPED-RNN
still attains the highest frame-level ROC AUC.

To understand how the detection of anomalies is made by all models,
we visually compare in Figure \ref{fig:comparison_between_methods}
the map of anomaly scores produced by MPED-RNN to those produced by
Conv-AE \cite{hasan2016learning} and Liu \etal \cite{liu2018anopred}.
As we can observe, our method avoids many irrelevant aspects of the
scene since we focus on skeletons. On the other hand, the other two
methods try to predict the whole scene and are more susceptible to
noise in it.

\begin{figure}

\begin{centering}
\includegraphics[width=0.95\columnwidth]{images/comparison_between_methods_fixed}
\par\end{centering}
\caption{\label{fig:comparison_between_methods} Anomaly score map of Conv-AE
\cite{hasan2016learning}, Liu \etal \cite{liu2018anopred} and MPED-RNN
in jet color map. Higher scores are represented closer to red while
lower scores are represented closer to blue. The first row shows the
original input frames and subsequent rows show the score map of each
method. Since MPED-RNN focuses on skeletons it does not produce any
score on background pixels.}

\end{figure}
\begin{center}
\begin{figure*}
\begin{centering}
\includegraphics[width=0.9\textwidth]{images/model_components_overview_normal_plus_abnormal}
\par\end{centering}
\caption{\label{fig:Visualization-of-the-generated-data}Visualization of the
predicted features (red) compared to input features (black) in a sample
case for a normal trajectory and an anomalous trajectory.}
\end{figure*}
\par\end{center}

\subsubsection{Interpreting Open-box MPED-RNN}

For a deeper understanding on how MPED-RNN works under the hood, we
visualize the features generated from the global and local predicting
decoders, and the predicted skeleton in image space. For comparison,
we also draw the corresponding features of the input sequence. Figure
\ref{fig:Visualization-of-the-generated-data} shows two example sequences
from the same scene, a normal example and an anomalous example. This
scene is of the walking area in the campus, where regular activities
include people standing and walking casually. In the normal sequence,
the predictions follow the input closely in all three domains, which
shows that MPED-RNN encodes enough information to predict the normal
sequence. On the other hand, the abnormal event contains a person
running. Its predicted global bounding box lags behind the input bounding
box, indicating that the expected movement is slower than the observed
one. The local prediction also struggles to reproduce the running
pose and ends up predicting a walking gait remotely mimicking the
original poses.

\subsubsection{Ablation Study}

Table~\ref{tab:ablation_study} reports the results of simplified
variants of MPED-RNN. It confirms that RNN is needed for this problem,
and when both global and local sub-processes are modeled, message
passing between the sub-processes is necessary. It also shows that
the dual decoders are valuable for regularizing the model and detecting
anomalies.

\begin{table}
\caption{Ablation study about the components of MPED-RNN. We show the frame-level
ROC AUC of simpler models that compose MPED-RNN on the HR-ShanghaiTech
dataset. AE: Frame-level Autoencoder, ED: Encoder-Decoder, G+L: Global
and Local features without message passing. The columns stand for
different ways the loss is calculated; Rec: reconstruction only, Pred:
prediction ony, Rec+Pred: reconstruction and prediction combined.
\label{tab:ablation_study}}

\centering{}%
\begin{tabular}{lccc}
\toprule
 & \multicolumn{3}{c}{HR-ShanghaiTech}\tabularnewline
\midrule
 & Rec. & Pred. & Rec. + Pred.\tabularnewline
\midrule
AE/Image & 0.674 & N/A & N/A\tabularnewline
\addlinespace
ED-RNN/Global & 0.680 & 0.688 & 0.689\tabularnewline
\addlinespace
ED-RNN/Local & 0.700 & 0.714 & 0.715\tabularnewline
\addlinespace
ED-RNN/G+L & 0.699 & 0.722 & 0.713\tabularnewline
\midrule
\addlinespace
MPED-RNN & \textbf{0.744} & \textbf{0.745} & \textbf{0.754}\tabularnewline
\bottomrule
\addlinespace
\end{tabular}
\end{table}

\subsubsection{Error Mode Analysis}

\begin{figure}
\begin{centering}
\includegraphics[width=0.95\columnwidth]{images/error_analysis}
\par\end{centering}
\caption{\label{fig:error_analysis}: Error mode examples. (a) Skeleton detection
inaccuracy: bad detection of the person reflected in the glass lead
to bad predictions by MPED-RNN. (b) Confusion in feature space: The
person riding the bicycle (red) has a moving pattern ``similar''
to a person walking.}
\end{figure}
Even though MPED-RNN outperforms related methods, it still makes incorrect
decisions. To understand the weaknesses of MPED-RNN, we sorted the
test sequences by decreasing level of error made by MPED-RNN and looked
for the root causes of the major mistakes.

The most prominent source of errors is from the inaccuracy of the
skeleton detection and tracking. All of the skeleton detection methods
we tried produced inaccurate skeletons in several common difficult
cases such as low resolution of human area or unwanted lighting, contrast
or shadow. Moreover, when there is occlusion or multiple people crossing
each other, the tracking IDs can get lost or swapped and confuse MPED-RNN.
Figure \ref{fig:error_analysis}.a shows an example frame containing
a badly detected skeleton.

Apart from the input noise, a small portion of error comes from a
more interesting phenomenon when the abnormal action of subjects produce
similar skeletons to normal ones. Figure \ref{fig:error_analysis}.b
shows the case of a person slowly riding a bicycle with motion and
posture similar to walking, which tricks our model into a false negative.
This issue is a predicted downside of geometrical skeleton features,
where all appearance features have been filtered out. Augmenting the
skeleton structure with visual features is a future work towards solving
this issue.

\subsection{CUHK Avenue dataset}

We also tested MPED-RNN on the CUHK Avenue dataset, which is another
representative dataset for video anomaly detection. It contains 16
training videos and 21 testing videos captured from a single camera.
Based on earlier error analysis on the ShanghaiTech dataset, we understand
that the unstable skeleton inputs are the most important source of
inaccuracy. To avoid this issue, we manually leave out a set of video
frames where the main anomalous event is non-human related, or the
person involved is non-visible (\eg person out of view throwing an
object into the scene), or the main subject cannot be detected and
tracked. This selection is detailed in the Appendix A. We called the
remaining dataset HR-Avenue. On HR-Avenue, we achieved a frame-level
ROC AUC of 0.863, against 0.862 and 0.848 achieved by Liu \etal \cite{liu2018anopred}
and Conv-AE \cite{hasan2016learning}, respectively.

\subsection{Skeleton Motion Decomposition\label{subsec:Skeleton-Motion-Decomposition}}

\begin{figure}[h]
\begin{centering}
\includegraphics[width=0.95\columnwidth]{images/global_local_decomposition}
\par\end{centering}
\caption{Global and local decomposition of a skeleton in a frame. Based on
the canonical local reference frame defined by the green bounding
box, the location vector of the left knee joint$f_{t}$ (dashed red)
is decomposed into global $f_{t}^{g}$(dashed blue) and local $f_{t}^{l}$
(dashed green) components. The bounding box's width and height are
included as global features and used to normalize local features.}

\label{fig:global_local_decomposition}
\end{figure}
Naturally, human motion consists of two factors: rigid movement of
the whole body and non-rigid deformation of the skeleton joints. The
simplest way to model human motion using a recurrent network is by
feeding it the raw sequence of skeleton trajectories in image coordinates
$f_{t}=\left(x_{t}^{i},y_{t}^{i}\right)$ \cite{fragkiadaki2015recurrent,villegas2017learning},
implicitly merging the global and local factors together. This solution
performs well in videos with uniform skeleton scales and types of
activities where the contribution of the two factors is consistent.
On realistic surveillance videos, however, the scales of human skeletons
vary largely depending on their location and actions. For skeletons
in the near field, the observed motion is mainly influenced by the
local factor. Meanwhile, for skeletons in the far field, the motion
is dominated by the global movement while local deformation is mostly
ignored.

Inspired by the natural composition of human skeleton motion and motivated
by the factorization models widely used in statistical modeling, we
propose to decompose the skeletal motion into ``global'' and ``local''
components. The global component carries information about the shape,
size and rigid movement of the human bounding box. The local component
models the internal deformation of the skeleton and ignores the skeleton's
absolute position in relation to the environment.

Geometrically, we set a canonical reference frame attached to the
human body (called \emph{local frame}), which is rooted at the center
of the skeleton's bounding box. The global component is defined as
the absolute location of the local frame center within the original
image frame. On the other hand, the local component is defined as
the residue after subtracting the global component from the original
motion. It represents the relative position of skeleton joints with
respect to the bounding box. This decomposition is illustrated in
Figure~\ref{fig:global_local_decomposition} and can be written in
2D vector space as:
\begin{equation}
f_{t}^{i}=f_{t}^{g}+f_{t}^{l,i}\label{eq:decompose_vector}
\end{equation}

In 2D image space, xy-coordinates alone poorly represent the real
location in the scene because the depth is missing. However, the size
of a skeleton's bounding box is correlated with the skeleton's depth
in the scene. To bridge this gap, we augment the global component
with the width and height of the skeleton's bounding box $f^{g}=(x^{g},y^{g},w,h)$
and use them to normalize the local component $f^{l,i}=(x^{l,i},y^{l,i})$.
These features can be calculated from the input features as:
\begin{align}
x^{g}=\frac{max(x^{i})+min(x^{i})}{2}; & \quad y^{g}=\frac{max(y^{i})+min(y^{i})}{2}\nonumber \\
w=max(x^{i})-min(x^{i}); & \quad h=max(y^{i})-min(y^{i})\label{eq:decompose_global}\\
x^{l,i}=\frac{x^{i}-x^{g}}{w}; & \quad y^{l,i}=\frac{y^{i}-y^{g}}{h}\label{eq:decompose_local}
\end{align}

The global and local dynamics can be modeled separately as two concurrent
sub-processes. In generic videos, these two processes can even manifest
independently. For example, a person can move her limbs around while
keeping her global location relatively still. Similarly, a person
riding a motorbike can move around while having a relatively fixed
pose. However, given a specific context, regular human activities
contain a strong correlation between these two components. Therefore
breaking the cross-component correlation is also a sign of abnormality.
In the previous examples, if those actions occurred in the scene where
people were normally walking, they would be valid anomaly events.
In the next section, we present how both individual dynamic patterns
and the relationship between these two components are modeled in our
MPED-RNN model.
\begin{center}
\begin{figure*}[h]
\centering{}\includegraphics[width=0.95\textwidth]{images/mped-rnn}\caption{MPED-RNN consists of two interacting branches for two skeleton feature
components. The local branch is drawn in green with shaded GRU blocks
and the global branch is drawn in blue with transparent GRU blocks.
The two components interact through messages (purple dashed) exchanged
between the branches. The outputs are generated by a set of MLPs,
represented by black rectangles.\label{fig:comprae_architecture}}
\end{figure*}
\par\end{center}

\subsection{MPED-RNN Architecture}

MPED-RNN models the global and local components as two interacting
sub-processes where the internal state of one process is used as extra
features to the input of the other process. More specifically, the
model consists of two recurrent encoder-decoder network branches,
each of them dedicated to one of the components. Each branch of the
model has the single-encoder-dual-decoder architecture with three
RNNs: Encoder, Reconstructing Decoder and Predicting Decoder. This
structure is similar to the composite LSTM autoencoder (LSTM AE) of
Srivastava \etal \cite{srivastava2015unsupervised}. However, unlike
LSTM AE, MPED-RNN does not only model the dynamics of each individual
component, but also the interdependencies between them through a cross-branch
message-passing mechanism. We use Gated Recurrent Units (GRU) \cite{cho2014learning}
in every segment of MPED-RNN for its simplicity and similar performance
to LSTM \cite{greff2017lstm}. At each time step, the GRU unit of
one branch receives a message from the other branch informing its
internal state at the previous time step. This message is incorporated
into the GRU structure by treating it as an additional input. The
same procedure is applied to the other branch. MPED-RNN's architecture
is depicted in Figure~\ref{fig:comprae_architecture}.

Given an input skeleton segment of length $T$, we first initialize
the hidden states of all the GRUs to null. Then, for each time step
$t$, the skeleton $f_{t}$ is decomposed into $f_{t}^{g}$ and $f_{t}^{l}$
(using Eqs.~(\ref{eq:decompose_vector}), (\ref{eq:decompose_global})
and (\ref{eq:decompose_local})), which are input to the global encoder
($E^{g}$) and to the local encoder ($E^{l}$), respectively. The
messages to be exchanged between the global and local branches are
computed as specified by Eqs. \ref{eq:msg_local_to_global} and \ref{eq:msg_global_to_local}
below.
\begin{align}
m_{t}^{l\rightarrow g} & =\sigma\big(W^{l\rightarrow g}h_{t-1}^{l}+b^{l\rightarrow g}\big)\label{eq:msg_local_to_global}\\
m_{t}^{g\rightarrow l} & =\sigma\big(W^{g\rightarrow l}h_{t-1}^{g}+b^{g\rightarrow l}\big)\label{eq:msg_global_to_local}
\end{align}

For $t=1,2,\ldots,T$, the global and local segments are encoded using
Eqs. \ref{eq:global_enc} and \ref{eq:local_enc}:
\begin{align}
E^{ge}:h_{t}^{ge} & =\textrm{GRU}\left(\left[f_{t}^{g},m_{t}^{le\rightarrow ge}\right],h_{t-1}^{ge}\right)\label{eq:global_enc}\\
E^{le}:h_{t}^{le} & =\textrm{GRU}\left(\left[f_{t}^{l},m_{t}^{ge\rightarrow le}\right],h_{t-1}^{le}\right)\label{eq:local_enc}
\end{align}

After encoding the input segments, the global and local Reconstructing
Decoders initialize their hidden states as $h_{T}^{gr}=h_{T}^{ge}$
and $h_{T}^{lr}=h_{T}^{le}$, respectively, and for $t=T,T-1,...,1$,
we have:
\begin{align}
D_{r}^{g} & :h_{t-1}^{gr}=\textrm{GRU}(m_{t}^{lr\rightarrow gr},h_{t}^{gr})\label{eq:rec_global}\\
D_{r}^{l} & :h_{t-1}^{lr}=\textrm{GRU}(m_{t}^{gr\rightarrow lr},h_{t}^{lr})\label{eq:rec_local}
\end{align}

Similarly, the global and local Predicting Decoders initialize their
hidden states as $h_{T}^{gp}=h_{T}^{ge}$ and $h_{T}^{lp}=h_{T}^{le}$,
respectively, and for $t=T+1,T+2,\ldots,T+P$, we have:
\begin{align}
D_{p}^{g} & :h_{t}^{gp}=\textrm{GRU}(m_{t}^{lp\rightarrow gp},h_{t-1}^{gp})\label{eq:pred_global}\\
D_{p}^{l} & :h_{t}^{lp}=\textrm{GRU}(m_{t}^{gp\rightarrow lp},h_{t-1}^{lp})\label{eq:pred_local}
\end{align}

In training, the dual decoders in the MPED-RNN's architecture jointly
enforce the encoder to learn a compact representation rich enough
to reconstruct its own input and predict the unseen future. Meanwhile,
in testing, the abnormal patterns cannot be properly predicted because
they were neither seen before nor follow the normal dynamics.

In each decoder network, the projected features of the corresponding
decoders, $\hat{f_{t}^{g}}$ and $\hat{f_{t}^{l}}$, are independently
generated from the hidden states $h_{t}^{g}$ and $h_{t}^{l}$ by
fully-connected layers. These two projected features are concatenated
and input to another fully-connected layer, which generates the projected
perceptual feature $\hat{f}_{t}$ in the original image space. Ideally,
$\hat{f_{t}}$ can be calculated from $\hat{f_{t}^{g}}$ and $\hat{f_{t}^{l}}$
by inverting Eqs.~(\ref{eq:decompose_global}) and (\ref{eq:decompose_local}).
However, by being projections into low-dimensional subspaces, a direct
computation is unlikely to be optimal. Thus, using a fully-connected
layer to learn the inverse mapping allows the computation to be robust
to noise. These projected features are used to evaluate the conformity
of an input sequence of skeletons to the learned normal behavior and
hence are used to build the loss function for training and score function
for testing. These procedures are detailed next.

\subsection{Training MPED-RNN\label{subsec:Training-MPED-RNN}}

\paragraph*{Training setup}

The trajectory of a person can span many frames in a video. However,
recurrent networks are trained on fixed-size sequences. To cope with
this issue, we extract fixed-size segments from every skeleton's trajectory
using a sliding-window strategy. Therefore, each segment is computed
as:
\begin{equation}
\textrm{seg}_{i}=\{f_{t}\}_{t=b_{i}..e_{i}}\label{eq:sliding_window}
\end{equation}
where $b_{i}$ and $e_{i}$ are beginning and ending indices of the
$i$-th segment calculated from the chosen sliding stride $s$ and
segment length $T$:
\begin{equation}
b_{i}=s\times i;\:e_{i}=s\times i+T\label{eq:window_ends}
\end{equation}

During training, batches of training segments are decomposed into
global and local features, which are input to MPED-RNN.

\paragraph*{Loss functions}

We consider three loss functions defined in three related coordinate
frames. The Perceptual loss $L_{p}$ constrains MPED-RNN to produce
the normal sequences in the image coordinate system. The Global loss
$L_{g}$ and the Local loss $L_{p}$ act as regularization terms that
enforce that each encoder-decoder branch of MPED-RNN work as designed.
Each of the losses includes the mean squared error made by the reconstructing
and predicting decoders:
\begin{equation}
L_{*}(\textrm{seg}_{i})=\frac{1}{2}\left(\frac{1}{T}\sum_{t=b_{i}}^{e_{i}}\left\Vert \hat{f_{t}^{*}}-f_{t}^{*}\right\Vert _{2}^{2}+\frac{1}{P}\sum_{t=e_{i}+1}^{e_{i}+P}\left\Vert \hat{f_{t}^{*}}-f_{t}^{*}\right\Vert _{2}^{2}\right)\label{eq:loss_calculation}
\end{equation}
where $P$ denotes the prediction length and $*$ represents one of
$l$, $g$ or $p$. In case of $p$ notice that it makes $f_{t}^{p}$
equal to $f_{t}$ of Section \ref{subsec:Skeleton-Motion-Decomposition}.
The prediction loss is truncated if the end of trajectory is reached
within the prediction length.

The three losses contribute to the combined loss by a weighted sum:
\begin{equation}
L(\textrm{seg}_{i})=\lambda_{g}L_{g}(\textrm{seg}_{i})+\lambda_{l}L_{l}(\textrm{seg}_{i})+\lambda_{p}L_{p}(\textrm{seg}_{i})\label{eq:loss}
\end{equation}
where $\left\{ \lambda_{g},\lambda_{l},\lambda_{p}\right\} \ge0$
are corresponding weights to the losses.

In training, we minimize the combined loss in Eq.~(\ref{eq:loss})
by optimizing the parameters of GRU cells of the RNN networks, message
building transformations in Eqs. \ref{eq:msg_local_to_global} and
\ref{eq:msg_global_to_local}, and the output MLPs.

\paragraph*{Model regularization}

When training autoencoder style models for anomaly detection, a major
challenge is that even if the model learns to generate normal data
perfectly, there is still no guarantee that the model will produce
high errors for abnormal sequences \cite{liu2018anopred}. In training
MPED-RNN, we address this challenge by empirically searching for the
smallest latent space that still adequately covers the normal patterns
so that outliers fall outside the manifold represented by this subspace.

We implement this intuition by splitting the normal trajectories into
training and validation subsets, and use them to regularize the network's
hyperparameters that govern the capacity of the model (\eg number
of hidden units). More specifically, we train a high capacity network
and record the lowest loss on the validation set. The validation set
is also used for early stopping. Then, we train a network with lower
capacity and record the lowest loss on the validation set again. We
repeat this procedure until we find the network with the smallest
capacity that is still within 5\% of the initial validation loss attained
by the high capacity network.

\subsection{Detecting Video Anomalies}

To estimate the anomaly score of each frame in a video, we follow
a four-step algorithm:
\begin{enumerate}
\item \emph{Extract segments}: With each trajectory, we select the overlapping
skeleton segments by using a sliding window of size $T$ and stride
$s$ on the trajectory, similar to Eqs.~(\ref{eq:sliding_window})
and (\ref{eq:window_ends}).
\item \emph{Estimate segment losses}: We decompose the segment using Eq.~(\ref{eq:decompose_vector})
and feed all segment features to the trained MPED-RNN, which outputs
the normality loss as in Eq.~(\ref{eq:loss}).
\item \emph{Gather skeleton anomaly score: }To measure the conformity of
a sequence to the model given both the past and future context, we
propose a voting scheme to gather the losses of related segments into
an anomaly score for each skeleton instance:
\begin{equation}
\alpha_{f_{t}}=\frac{\sum_{u\in S_{t}}L_{p}(u)}{|S_{t}|}\label{eq:instance_loss}
\end{equation}
 where $S_{t}$ denotes the set of decoded segments that contain $f_{t}$
from both reconstruction and prediction. For each of those segments
$u$, the corresponding perceptual loss, $L_{p}(u)$, is calculated
by Eq.~(\ref{eq:loss_calculation}).
\item \emph{Calculate frame anomaly score:} The anomaly score of a video
frame $v_{t}$ is calculated from the score of all skeleton instances
appearing in that frame by a max pooling operator:
\begin{equation}
\alpha_{v_{t}}=max\left(\alpha_{f_{t}}\right)_{f_{t}\in\textrm{Skel}(v_{t})}\label{eq:frame_loss}
\end{equation}
where $\textrm{Skel}(v_{t})$ stands for the set of skeleton instances
appearing in the frame. The choice of max pooling over other aggregation
functions is to suppress the influence of normal trajectories present
in the scene, since the number of normal trajectories can vary largely
in real surveillance videos. We then use $\alpha_{v_{t}}$ as the
frame-level anomaly score of $v_{t}$ and use it to calculate all
accuracy measurements.
\end{enumerate}

\subsection{Implementation Details}

To detect skeletons in the videos, we utilized Alpha Pose \cite{fang2017rmpe}
to independently detect skeletons in each video frame. To track the
skeletons across a video, we combined sparse optical flow with the
detected skeletons to assign similarity scores between pairs of skeletons
in neighboring frames, and solved the assignment problem using the
Hungarian algorithm \cite{kuhn1955hungarian}. The global and local
components of the skeleton trajectories are standardized by subtracting
the median of each feature, and scaling each feature relative to the
10\%-90\% quantile range. All recurrent encoder-decoder networks have
similar architectures but are trained with independent weights. The
regularization of MPED-RNN's hyperparameters is done for each data
set, following the method described in Section \ref{subsec:Training-MPED-RNN}.

\subsection{Video anomaly detection}

Unsupervised video anomaly detection methods have been an old-timer
topic in the video processing and computer vision communities. Traditional
approaches consider video frames as separate data samples and model
them using one-class classification methods, such as one-class SVM
\cite{xu2017detecting} and mixture of probabilistic PCA \cite{kim2009observe}.
These methods usually attain suboptimal performance when processing
large scale data with a wide variety of anomaly types.

Recent approaches rejuvenate the field by using convolutional neural
networks (CNN) to extract high-level features from video frame intensity
and achieve improved results. Some of these methods include Convolutional
autoencoder \cite{hasan2016learning}, spatio-temporal autoencoder
\cite{chong2017abnormal}, 3D Convnet AE \cite{zhao2017spatio}, and
Temporally-coherent Sparse Coding Stacked-RNN \cite{luo2017revisit}.
Acknowledging the limitation of the intensity based features such
as sensitivity to appearance noise, Liu \etal \cite{liu2018anopred}
proposed to use the prediction of optical flow in their temporal coherent
loss, effectively filtering out parts of the noise in pixel appearance.
However, optical flow is costly to extract and still far from the
semantic nature of the events.

Structured representations have recently attracted increased attention
for its potential to get closer to the semantic concepts present in
the anomalies. In \cite{yuan2015online}, object trajectories were
used to guide the pooling of the visual features so that interesting
areas are paid more attention to. Towards model interpretability,
Hinami \etal \cite{hinami2017joint} proposed to use object, attribute,
and action detection labels to understand the reason of abnormality
scores. Although it works well for a number of events, their method
fails in many cases due to the incompleteness of the label sets and
the distraction from unrelated information in the labels.

Our method of using skeleton features is another step towards using
low-dimensional semantic-rich features for anomaly detection. We also
advance the research efforts toward interpretability of the anomaly
detection models by providing the ability to explain every abnormal
event in our factorized semantic space.

\subsection{Human trajectory modeling}

Human motion in video scenes is an important factor for studying social
behavior. It has been applied in multiple computer vision applications,
mostly with supervised learning tasks such as action recognition \cite{du2016representation}
and person re-identification \cite{elaoud2017analysis}. Recently,
more effort has been invested into unsupervised learning of human
motion in social settings \cite{alahi2016social,gupta2018social,villegas2017learning}
and single pose configuration \cite{fragkiadaki2015recurrent}. In
this work, we propose to expand the application of skeleton motion
features to the task of video anomaly detection. In MPED-RNN, we share
the encoder-decoder structure with most unsupervised prediction models.
However, instead of perfectly generating the expected features, we
aim at distilling only the principal feature patterns so that anomalies
are left out. This involves building a highly regulated autoencoder.

Regarding feature representation and modeling, apart from traditional
methods that rely on hand-crafted local features and state machines,
several recent works proposed to use interacting recurrent networks
for motion modeling in social settings \cite{alahi2016social,gupta2018social}.
In these approaches, the input data are in the form of whole body
xy-location sequences while local postures are ignored. To bridge
this gap, in \cite{fragkiadaki2015recurrent,villegas2017learning}
the input of the RNN is extended to the skeleton joint locations.
Recently, Du \etal \cite{du2016representation} proposed to divide
the skeleton joints into five parts, which are jointly modeled in
a five-branch bidirectional neural network. Different to previous
approaches, we factorize skeleton motion based on natural decomposition
of human motion into global movement/local deformation and model them
jointly in an interactive recurrent network.

Computer Vision and Pattern Recognition (cs.CV)


NuSTAR Non-detection of a Faint Active Galactic Nucleus in an Ultraluminous IR Galaxy with Kpc-scale Fast Wind

Abstract: Large-scale outflows are generally considered as a possible evidence that active galactic nuclei (AGNs) can severely affect their host galaxies. Recently an ultraluminous IR galaxy (ULIRG) at $z=0.49$, AKARI J0916248+073034, was found to have a galaxy-scale [OIII] $\lambda$5007 outflow with one of the highest energy-ejection rates at $z<1.6$. However, the central AGN activity estimated from its torus mid-IR (MIR) radiation is weak relative to the luminous [OIII] emission. In this work we report the first NuSTAR hard X-ray follow-up of this ULIRG to constrain its current AGN luminosity. The intrinsic 2-10 keV luminosity shows a 90% upper-limit of $3.0\times10^{43}$ erg s$^{-1}$ assuming Compton-thick obscuration ($N_{\rm H}=1.5\times10^{24}$ cm$^{-2}$), which is only 3.6% of the luminosity expected from the extinction corrected [OIII] luminosity. With the NuSTAR observation, we succeed to identify that this ULIRG has a most extreme case of X-ray deficit among local ULIRGs. A possible scenario to explain the drastic declining in both of the corona (X-ray) and torus (MIR) is that the primary radiation from the AGN accretion disk is currently in a fading status, as a consequence of a powerful nuclear wind suggested by its powerful ionized outflow in the galaxy scale.

\subsubsection*{#1}}

\pagestyle{headings}
\markright{Reference sheet: \texttt{natbib}}

\usepackage{shortvrb}
\MakeShortVerb{\|}

\begin{document}
\thispagestyle{plain}

\newcommand{\textsc{Bib}\TeX}{\textsc{Bib}\TeX}
\newcommand{\texttt{#1}\def\filedate{#2}\def\fileversion{#3}}}{\texttt{#1}\def\filedate{#2}\def\fileversion{#3}}}
\begin{center}{\bfseries\Large
    Reference sheet for \texttt{#1}\def\filedate{#2}\def\fileversion{#3}}\ usage}\\
    \large(Describing version \fileversion\ from \filedate)
\end{center}

\begin{quote}\slshape
For a more detailed description of the \texttt{#1}\def\filedate{#2}\def\fileversion{#3}}\ package, \LaTeX\ the
source file \texttt{#1}\def\filedate{#2}\def\fileversion{#3}}\texttt{.dtx}.
\end{quote}
\head{Overview}
The \texttt{#1}\def\filedate{#2}\def\fileversion{#3}}\ package is a reimplementation of the \LaTeX\ |\cite| command,
to work with both author--year and numerical citations. It is compatible with
the standard bibliographic style files, such as \texttt{plain.bst}, as well as
with those for \texttt{harvard}, \texttt{apalike}, \texttt{chicago},
\texttt{astron}, \texttt{authordate}, and of course \texttt{#1}\def\filedate{#2}\def\fileversion{#3}}.

\head{Loading}
Load with |\usepackage[|\emph{options}|]{|\texttt{#1}\def\filedate{#2}\def\fileversion{#3}}|}|. See list of
\emph{options} at the end.

\head{Replacement bibliography styles}
I provide three new \texttt{.bst} files to replace the standard \LaTeX\
numerical ones:
\begin{quote}\ttfamily
 plainnat.bst \qquad abbrvnat.bst \qquad unsrtnat.bst
\end{quote}
\head{Basic commands}
The \texttt{#1}\def\filedate{#2}\def\fileversion{#3}}\ package has two basic citation commands, |\citet| and
|\citep| for \emph{textual} and \emph{parenthetical} citations, respectively.
There also exist the starred versions |\citet*| and |\citep*| that print
the full author list, and not just the abbreviated one.
All of these may take one or two optional arguments to add some text before
and after the citation.
\begin{quote}
\begin{tabular}{l@{\quad$\Rightarrow$\quad}l}
  |\citet{jon90}| & Jones et al. (1990)\\
  |\citet[chap.~2]{jon90}| & Jones et al. (1990, chap.~2)\\[0.5ex]
  |\citep{jon90}| & (Jones et al., 1990)\\
  |\citep[chap.~2]{jon90}| & (Jones et al., 1990, chap.~2)\\
  |\citep[see][]{jon90}| & (see Jones et al., 1990)\\
  |\citep[see][chap.~2]{jon90}| & (see Jones et al., 1990, chap.~2)\\[0.5ex]
  |\citet*{jon90}| & Jones, Baker, and Williams (1990)\\
  |\citep*{jon90}| & (Jones, Baker, and Williams, 1990)
\end{tabular}
\end{quote}
\head{Multiple citations}
Multiple citations may be made by including more than one
citation key in the |\cite| command argument.
\begin{quote}
\begin{tabular}{l@{\quad$\Rightarrow$\quad}l}
  |\citet{jon90,jam91}| & Jones et al. (1990); James et al. (1991)\\
  |\citep{jon90,jam91}| & (Jones et al., 1990; James et al. 1991)\\
  |\citep{jon90,jon91}| & (Jones et al., 1990, 1991)\\
  |\citep{jon90a,jon90b}| & (Jones et al., 1990a,b)
\end{tabular}
\end{quote}

\head{Numerical mode}
These examples are for author--year citation mode. In numerical mode, the
results are different.
\begin{quote}
\begin{tabular}{l@{\quad$\Rightarrow$\quad}l}
  |\citet{jon90}| & Jones et al. [21]\\
  |\citet[chap.~2]{jon90}| & Jones et al. [21, chap.~2]\\[0.5ex]
  |\citep{jon90}| & [21]\\
  |\citep[chap.~2]{jon90}| & [21, chap.~2]\\
  |\citep[see][]{jon90}| & [see 21]\\
  |\citep[see][chap.~2]{jon90}| & [see 21, chap.~2]\\[0.5ex]
  |\citep{jon90a,jon90b}| & [21, 32]
\end{tabular}
\end{quote}
\head{Suppressed parentheses}
As an alternative form of citation, |\citealt| is the same as |\citet| but
\emph{without parentheses}. Similarly, |\citealp| is |\citep| without
parentheses. Multiple references, notes, and the starred variants
also exist.
\begin{quote}
\begin{tabular}{l@{\quad$\Rightarrow$\quad}l}
  |\citealt{jon90}| & Jones et al.\ 1990\\
  |\citealt*{jon90}| & Jones, Baker, and Williams 1990\\
  |\citealp{jon90}| & Jones et al., 1990\\
  |\citealp*{jon90}| & Jones, Baker, and Williams, 1990\\
  |\citealp{jon90,jam91}| & Jones et al., 1990; James et al., 1991\\
  |\citealp[pg.~32]{jon90}| & Jones et al., 1990, pg.~32\\
  |\citetext{priv.\ comm.}| & (priv.\ comm.)
\end{tabular}
\end{quote}
The |\citetext| command
allows arbitrary text to be placed in the current citation parentheses.
This may be used in combination with |\citealp|.
\head{Partial citations}
In author--year schemes, it is sometimes desirable to be able to refer to
the authors without the year, or vice versa. This is provided with the
extra commands
\begin{quote}
\begin{tabular}{l@{\quad$\Rightarrow$\quad}l}
  |\citeauthor{jon90}| & Jones et al.\\
  |\citeauthor*{jon90}| & Jones, Baker, and Williams\\
  |\citeyear{jon90}|   & 1990\\
  |\citeyearpar{jon90}| & (1990)
\end{tabular}
\end{quote}
\head{Forcing upper cased names}
If the first author's name contains a \textsl{von} part, such as ``della
Robbia'', then |\citet{dRob98}| produces ``della Robbia (1998)'', even at the
beginning of a sentence. One can force the first letter to be in upper case
with the command |\Citet| instead. Other upper case commands also exist.
\begin{quote}
\begin{tabular}{rl@{\quad$\Rightarrow$\quad}l}
  when & |\citet{dRob98}| & della Robbia (1998) \\
  then & |\Citet{dRob98}| & Della Robbia (1998) \\
     &   |\Citep{dRob98}| & (Della Robbia, 1998) \\
     &   |\Citealt{dRob98}| & Della Robbia 1998 \\
     &   |\Citealp{dRob98}| & Della Robbia, 1998 \\
     &   |\Citeauthor{dRob98}| & Della Robbia
\end{tabular}
\end{quote}
These commands also exist in starred versions for full author names.

\head{Citation aliasing}
Sometimes one wants to refer to a reference with a special designation,
rather than by the authors, i.e. as Paper~I, Paper~II. Such aliases can be
defined and used, textual and/or parenthetical with:
\begin{quote}
\begin{tabular}{lcl}
  |\defcitealias{jon90}{Paper~I}|\\
  |\citetalias{jon90}| & $\Rightarrow$ & Paper~I\\
  |\citepalias{jon90}| & $\Rightarrow$ & (Paper~I)
\end{tabular}
\end{quote}
These citation commands function much like |\citet| and |\citep|: they may
take multiple keys in the argument, may contain notes, and are marked as
hyperlinks.
\head{Selecting citation style and punctuation}
Use the command |\bibpunct| with one optional and 6 mandatory arguments:
\begin{enumerate}
\item the opening bracket symbol, default = (
\item the closing bracket symbol, default = )
\item the punctuation between multiple citations, default = ;
\item the letter `n' for numerical style, or `s' for numerical superscript
      style, any other letter for
      author--year, default = author--year;
\item the punctuation that comes between the author names and the year
\item the punctuation that comes between years or numbers when common author
      lists are suppressed (default = ,);
\end{enumerate}

The optional argument is the character preceding a post-note, default is a
comma plus space. In redefining this character, one must include a space if
one is wanted.

Example~1, |\bibpunct{[}{]}{,}{a}{}{;}| changes the output of
\begin{quote}
  |\citep{jon90,jon91,jam92}|
\end{quote}
into [Jones et al. 1990; 1991, James et al. 1992].

Example~2, |\bibpunct[; ]{(}{)}{,}{a}{}{;}| changes the output of
\begin{quote}
  |\citep[and references therein]{jon90}|
\end{quote}
into (Jones et al. 1990; and references therein).

\head{Other formatting options}
Redefine |\bibsection| to the desired sectioning command for introducing
the list of references. This is normally |\section*| or |\chapter*|.

Define |\bibpreamble| to be any text that is to be printed after the heading but
before the actual list of references.

Define |\bibfont| to be a font declaration, e.g.\ |\small| to apply to
the list of references.

Define |\citenumfont| to be a font declaration or command like |\itshape|
or |\textit|.

Redefine |\bibnumfmt| as a command with an argument to format the numbers in
the list of references. The default definition is |[#1]|.

The indentation after the first line of each reference is given by
|\bibhang|; change this with the |\setlength| command.

The vertical spacing between references is set by |\bibsep|; change this with
the |\setlength| command.

\head{Automatic indexing of citations}
If one wishes to have the citations entered in the \texttt{.idx} indexing
file, it is only necessary to issue |\citeindextrue| at any point in the
document. All following |\cite| commands, of all variations, then insert
the corresponding entry to that file. With |\citeindexfalse|, these
entries will no longer be made.

\head{Use with \texttt{chapterbib} package}

The \texttt{#1}\def\filedate{#2}\def\fileversion{#3}}\ package is compatible with the \texttt{chapterbib} package
which makes it possible to have several bibliographies in one document.

The package makes use of the |\include| command, and each |\include|d file
has its own bibliography.

The order in which the \texttt{chapterbib} and \texttt{#1}\def\filedate{#2}\def\fileversion{#3}}\ packages are loaded
is unimportant.

The \texttt{chapterbib} package provides an option \texttt{sectionbib}
that puts the bibliography in a |\section*| instead of |\chapter*|,
something that makes sense if there is a bibliography in each chapter.
This option will not work when \texttt{#1}\def\filedate{#2}\def\fileversion{#3}}\ is also loaded; instead, add
the option to \texttt{#1}\def\filedate{#2}\def\fileversion{#3}}.

Every |\include|d file must contain its own
|\bibliography| command where the bibliography is to appear. The database
files listed as arguments to this command can be different in each file,
of course. However, what is not so obvious, is that each file must also
contain a |\bibliographystyle| command, \emph{preferably with the same
style  argument}.
\head{Sorting and compressing citations}
Do not use the \texttt{cite} package with \texttt{#1}\def\filedate{#2}\def\fileversion{#3}}; rather use one of the
options \texttt{sort} or \texttt{sort\&compress}.

These also work with author--year citations, making multiple citations appear
in their order in the reference list.

\head{Long author list on first citation}
Use option \texttt{longnamesfirst} to have first citation automatically give
the full list of authors.

Suppress this for certain citations with |\shortcites{|\emph{key-list}|}|,
given before the first citation.

\head{Local configuration}
Any local recoding or definitions can be put in \texttt{#1}\def\filedate{#2}\def\fileversion{#3}}\texttt{.cfg} which
is read in after the main package file.

\head{Options that can be added to \texttt{\char`\\ usepackage}}
\begin{description}
\item[\ttfamily round] (default) for round parentheses;
\item[\ttfamily square] for square brackets;
\item[\ttfamily curly] for curly braces;
\item[\ttfamily angle] for angle brackets;
\item[\ttfamily colon] (default) to separate multiple citations with
     colons;
\item[\ttfamily comma] to use commas as separaters;
\item[\ttfamily authoryear] (default) for author--year citations;
\item[\ttfamily numbers] for numerical citations;
\item[\ttfamily super] for superscripted numerical citations, as in
     \textsl{Nature};
\item[\ttfamily sort] orders multiple citations into the sequence in
     which they appear in the list of references;
\item[\ttfamily sort\&compress] as \texttt{sort} but in addition multiple
     numerical citations are compressed if possible (as 3--6, 15);
\item[\ttfamily longnamesfirst] makes the first citation of any reference
     the equivalent of the starred variant (full author list) and subsequent
     citations normal (abbreviated list);
\item[\ttfamily sectionbib] redefines |\thebibliography| to issue
     |\section*| instead of |\chapter*|; valid only for classes with a
     |\chapter| command; to be used with the \texttt{chapterbib} package;
\item[\ttfamily nonamebreak] keeps all the authors' names in a citation on
     one line; causes overfull hboxes but helps with some \texttt{hyperref}
     problems.
\end{description}
\end{document}

\section{Introduction} \label{sec:intro}

Ultraluminous IR galaxies ($L_{\rm IR}$\,$>$\,$10^{12}$\,$L_{\odot}$, ULIRGs) are a population of galaxies emitting nearly entire energy in IR band
\citep{Sanders1996}.
The high $L_{\rm IR}$ originates from dust heated by UV\,/\,optical radiation of vigorous starbursts and/or active galactic nuclei (AGNs).
ULIRGs are thought to represent a rapidly growing phase of massive galaxies in the transition from disk to elliptical galaxies, as gas and dust are swept out by starburst- and\,/\,or AGN-induced outflows \citep[e.g.,][]{Hopkins2008}.

\citet{Chen2020} reported a new follow-up program for sources in the AKARI Far-Infrared Surveyor (FIS) Bright Source Catalogue\footnote{https://www.ir.isas.jaxa.jp/AKARI/Observation/update/\\20160425\_preliminary\_release.html}\,(ver.2)
to construct a statistical flux-limited sample of ULIRGs at intermediate redshifts ($z$\,=\,0.5\,--\,1).
Among the sources, AKARI J0916248+073034 (hereafter J0916a) at $z_{\rm spec}$\,=\,0.49, indicates signatures of an extremely strong ionized-gas outflow in the Subaru\,/\,FOCAS long-slit spectroscopic image \citep[with slit width of 0.5\arcsec,][]{Chen2019}.
The \hbox{[O\sc iii]\,$\lambda$5007}\ emission line has a FWHM of 1830\,km\,s$^{-1}$\ and a shift of $-770$\,km\,s$^{-1}$\ relative to stellar absorption lines.
The long-slit spectroscopic image shows that the outflow extends to a radius of 4 kpc.
The mass-loss and energy-ejection ($\dot{E}_{\rm k}$) rates are estimated to be 500\,$M_{\odot}$\,yr$^{-1}$\ and $10^{44.6}$\,erg\,s$^{-1}$, respectively,
implying that J0916a has one of the highest $\dot{E}_{\rm k}$ ionized outflows among ULIRGs\,/\,AGNs at $z$\,$<$\,1.6 and it is comparable to the most powerful outflows in quasars at $z$\,$\sim$\,2 \citep[e.g.,][]{Harrison2012, Zakamska2016}.
Emission line ratios indicate that the outflow is driven by AGN.

The strong \hbox{[O\sc iii]}\ emission line ($10^{43.8\pm0.5}$\,erg\,s$^{-1}$\ after extinction correction\footnote{
The extinction is estimated to be $E(B-V)$\,=\,$1.0\pm0.3$ using Balmer decrement, which is close to the typical amount of dust attenuation in local ULIRGs \citep[e.g.,][]{Garcia2009}.})
implies that the AGN is luminous with bolometric luminosity\footnote{Throughout the paper we use $L_{\rm band,\,indicator}$ to denote the luminosity in a given band or wavelength range estimated from the employed indicator.}\,($L_{\rm bol,\,[OIII]}$) of $10^{46.3\pm0.5}$\,erg\,s$^{-1}$\
using the empirical relationships \citep{Ueda2015, Ricci2017}.
However, the mid-IR (MIR) radiation originating from dusty torus in the vicinity ($\sim$\,10\,pc) of the SMBH is weak.
The 5--38\,\micron\ MIR luminosity ($L_{\rm 5-38\,\mu m}$) of J0916a is $10^{44.9\pm0.1}$\,erg\,s$^{-1}$,
which is integrated using the best-fit SED of AGN component reported in \citet{Chen2019}\footnote{There is a mistake in Table 3 of \citet{Chen2019}. The reported value of $L_{\rm bol}^{\rm AGN}$ was not the bolometric luminosity of AGN, but the total integrated luminosity of the best-fit AGN SED including the torus thermal and scattering radiation and the transmitted primary emission.}.
The corresponding bolometric luminosity with the empirical function \citep{Ichikawa2019s}
is $L_{\rm bol,\,torus}$\,=\,$10^{45.8\pm0.1}$\,erg\,s$^{-1}$, which is only 32\% of $L_{\rm bol,\,[OIII]}$
and would indicate that the central engine of the AGN in J0916a is declining,
i.e., the AGN is currently less active than its past epoch,
while the observed strong \hbox{[O\sc iii]}\ emission with extreme outflow reflect a historical effect of the AGN during its preceding active phase,
due to the time-lag between AGN activity in the nuclear region and outflow in the galaxy scale \citep[e.g.,][]{Harrison2017}.

Recent works reported the luminosity declining of AGN within a timescale of $10^{3}$--$10^{4}$ years in a population called ``fading AGN'' or ``dying AGN'' \citep[e.g.,][]{Schawinski2010}. This population shows AGN signatures in large spatial scales, e.g., radio jets and\,/\,or bright \hbox{[O\sc iii]}\ line in the kpc-scale narrow line region (NLR), but lack the features in small scales, e.g., weak or lack of X-ray (corona) and\,/\,or MIR (torus) emission.
The faintness in small scales of those objects implies a transient stage that the central engine was active in the past, but currently seems quenched \citep{Kawamuro2017, Ichikawa2019a, Ichikawa2019b, Cooke2020}.
The ``changing-look AGN'' is another population of AGNs which shows drastically declining by an order of magnitude
in 1--10 years \citep[e.g.,][]{LaMassa2015, MacLeod2016} as their accretion states change from bright (standard disk) phase to faint (radiatively inefficient accretion flow) phase \citep[e.g.,][]{Noda2018, Ruan2019}.
Recent X-ray studies of ULIRGs presented that the coronae in ULIRGs could be intrinsically weak compared to normal AGNs \citep[e.g.,][]{Teng2015}.

In order to constrain the current activity of the AGN in J0916a, hard X-ray observation over 10 keV is required with its power to penetrate the heavy obscuration in the nuclear region \citep[e.g.,][]{Ricci2015}.
There is no previous X-ray observation for J0916a and it is not detected in the {\rm Swift}/BAT 14-195 keV survey due to its faintness at a relatively high redshift.
In this letter we report the first hard X-ray follow-up of J0916a with NuSTAR \citep{Harrison2013}.
Thanks to a wide energy range over 10 keV with great sensitivity,
NuSTAR makes it capable to directly constrain the intrinsic AGN luminosity in J0916a even in the case with Compton-thick absorption, e.g., gas column density ($N_{\rm H}$) of at least $1.5\times10^{24}$\,cm$^{-2}$.
Throughout the paper we adopt the cosmological parameters, $H_0=$\,70\,km\,s$^{-1}$\,Mpc$^{-1}$, $\Omega_{\rm M}=0.3$ and $\Omega_{\Lambda}=0.7$.

\begin{figure*}[ht!]
    \begin{center}
	\includegraphics[width=0.32\textwidth]{J0916a_image.pdf}
	\includegraphics[width=0.32\textwidth]{J0916a_xspec.pdf}
	\includegraphics[width=0.32\textwidth]{J0916a_Lx_nH.pdf}
    \end{center}
    \vspace{-25pt}
	\caption{
	\textbf{Left:} NuSTAR 6--24 keV image in units of counts per pixel. The image is co-added using the FPMA and FPMB data from the two observation epochs, and smoothed using a Gaussian profile with a radius of 2 pixels.
	The source (circular) and background (annular) regions are shown in orange and blue, respectively.
	\textbf{Middle:} NuSTAR 3--50 keV spectra extracted from the source (orange) and background (blue) regions shown in the left panel.
	\textbf{Right:}
	Estimated 90\% upper-limit of intrinsic $L_{\rm 2-10\,keV}$\ with different assumptions of photon index ($\Gamma$) and intrinsic obscuration ($N_{\rm H}$). The two horizontal lines denote the $L_{\rm 2-10\,keV}$\ converted from \hbox{[O\sc iii]\,$\lambda$5007}\ (dashed) and 5--38 \micron\ (dotted) luminosities. The vertical dash-dotted line shows the threshold of Compton-thick obscuration. The open circle denotes the fiducial estimation in the discussion.
	}
	\label{fig:iamge_spec}
\end{figure*}

\section{NuSTAR Constraint on the Intrinsic X-ray luminosity of J0916a} \label{sec:data}

J0916a was observed by NuSTAR on 2020 June 16 and 17 with a total on-source exposure of 105.6 ksec (NuSTAR GO cycle-6 program 06108, PI:X.Chen).
The data was reduced using the NuSTAR data analysis pipeline (\textit{nupipeline}, ver.1.9.2) with the latest HEASARC's calibration database (CALDB, ver.20200720).
The South Atlantic Anomaly (SAA) filtering is adopted to reduce the observation time intervals affected by the enhancement of background event rates from passage through the SAA and the so-called ``tentacle'' region with the \textit{nupipeline} configuration of \texttt{saacalc=1 saamode=optimized tentacle=yes}.
The calculation algorithm ``1'' is chosen since it provides the best noise removal as shown in the background filtering reports for both of the two observation epochs\footnote{
The default setting \texttt{saacalc=3 eliminatesource=yes} evaluates count rates after the exclusion of the contribution of the brightest sources in the field of view, which could results in noise remnants for this dataset, because the object is very weak and the brightest sources can be dominated by noise.}.
We use the ``optimized'' mode since it provides comparable noise removal result with the ``strict'' mode but does not lose large amount of exposure as the later one ($\sim10\%$).
After removal of bad time intervals, the final exposure is 37.3 ksec (96.6\%) and 67.0 ksec (99.8\%) on source for the first and second observation epochs, respectively.
Totally four cleaned events are created from the data obtained by the two focal plane modules (FPMA and FPMB) during the two epochs.

The images from the four cleaned events are merged using the FTOOLS package \textit{fimage} and the co-added 6--24 keV image is shown in the left panel of Figure \ref{fig:iamge_spec}.
No serendipitous sources are detected in the fields of view of the NuSTAR observations.
A circular region with a radius of 30\arcsec\ centered at the optical position of J0916a is employed as the source region, following the suggestion for faint objects in Section 4.3 of the NuSTAR Data Analysis Software Guide\footnote{
We also checked the spectrum extracted using a larger radius of 60\arcsec\ with EEF of 90\%.
The net spectrum shows -39.6 counts ($-1.5\sigma$) in 6--24 keV.
The difference of estimated fluxes is about 5\%, thus having little impact on our conclusion.}.
A radius of 30\arcsec\ corresponds to a fraction of encircled energy (EEF) of 65\%, which is taken into account in the later analysis.
A surrounding annular region with radii of 90\arcsec\ and 150\arcsec\ is used to estimate the background level.
For each of the four cleaned events the spectra are extracted from the source and background regions.
The co-added source and background (scaled to the source region) spectra
obtained with the FTOOLS package \textit{addspec} are shown in the middle panel of Figure \ref{fig:iamge_spec}.
There is no significant difference between the source and background spectra.
The net spectrum (i.e., source\,$-$\,background) shows
$-9.9$ counts in 3--6 keV,
$-16.9$ counts in 6--24 keV, and
$8.5$ counts in 24--50 keV,
which correspond to $-1.1\sigma$, $-1.3\sigma$, and $0.6\sigma$, respectively,
where $\sigma$ is estimated from the poisson noise within the source region in each energy range.
Therefore we conclude that the object is not detected.

Spectral analysis is not feasible as the spectrum is dominated by background.
In order to estimate the upper-bound of the X-ray luminosity,
we employed a fixed, putative torus model of \citet{Ikeda2009} following \citet{Ichikawa2019b},
which takes account of an torus-absorbed and Compton scattered power-law component,
a reflected continuum and an accompanying fluorescent iron K$\alpha$ line.
Only the normalization of the power-law component is set as a free parameter.
The cut-off energy of the power-law component is fixed to 360 keV.
The opening angle of the torus is fixed to 60\arcdeg, which reflects a typical covering factor for X-ray selected AGNs \citep[e.g.,][]{Stalevski2016, Ichikawa2019s}.
An inclination angle of 80\arcdeg\ is selected since J0916a is identified as a Seyfert 2 galaxy from its optical spectrum\footnote{
We have confirmed that the choice of the opening angle (45\arcdeg--70\arcdeg) and inclination angle (70\arcdeg--89\arcdeg) does not significantly affect our conclusion.}.
We consider two values of photon index ($\Gamma$), i.e., 1.8, which is a typical value of normal Seyfert galaxies \citep[e.g.,][]{Ricci2017},
and 1.5, as shown in the harder spectra found in several ULIRGs \citep{Teng2014, Teng2015, Oda2017}.
Galactic absorption of $N_{\rm H}$\,=\,$2.6\times10^{20}$\,cm$^{-2}$, which is given by the FTOOLS package \textit{nh},
and
intrinsic obscuration with $N_{\rm H}$\ from $10^{23}$ to $10^{25}$\,cm$^{-2}$\ are employed in the estimation.
We estimate the upper-limit of the intrinsic 2--10 keV luminosity ($L_{\rm 2-10\,keV}$) by simulating artificial spectra with the above assumed models to achieve net counts of 3$\sigma$ in 6--24 keV range.
The estimated 3$\sigma$ upper-limits with different assumptions of $\Gamma$ and $N_{\rm H}$\ are then converted to 90\% upper-limits considering that the 90\% confidence level corresponds to 1.645$\sigma$ for a normal distribution, and the results are shown in the right panel of Figure \ref{fig:iamge_spec}.

In the later discussion, we consider the estimated 90\% upper-limit, $L_{\rm 2-10\,keV}$\ $<3.0\times10^{43}$\,erg\,s$^{-1}$
with $\Gamma$\,=\,$1.5$ and $N_{\rm H}$\,=\,$1.5\times10^{24}$\,cm$^{-2}$,
as a fiducial value unless otherwise stated\footnote{We also estimate the upper-limit using Xspec fit with C-statistic. The upper-limits from the two methods are consistent within a factor of 1.1.}.
The X-ray studies of ULIRGs \citep{Teng2014, Teng2015, Iwasawa2017, Iwasawa2018, Oda2017, Tombesi2017, Xu2017, Toba2020} show that $N_{\rm H}$\ varies in a range from $10^{23}$\,cm$^{-2}$\ (e.g., IRAS F05189–2524) to $3\times10^{24}$\,cm$^{-2}$\ (e.g., IRAS F13120–5453),
hence $N_{\rm H}$\,=\,$1.5\times10^{24}$\,cm$^{-2}$\ is a reasonable assumption to account for Compton-thick obscuration.

Using the empirical relation of \citet{Lehmer2010}, the estimated $L_{\rm 2-10\,keV}$\ contributed by high-mass X-ray binaries (HMXBs) in the host galaxy is
$\sim$\,2$\times10^{42}$\,erg\,s$^{-1}$\ with stellar mass of $10^{11}$\,$M_{\odot}$\ and star formation rate of 1000\,$M_{\odot}$\,yr$^{-1}$, which is much lower than the 90\% upper-limit $L_{\rm 2-10\,keV}$.
Therefore hereafter we ignore the contribution of HMXBs and consider the 90\% upper-limit $L_{\rm 2-10\,keV}$\ as the upper-bound of AGN X-ray luminosity.

\begin{figure*}[ht!]
    \begin{center}
    \hspace{-38pt}
	\includegraphics[width=0.45\textwidth]{LX_LOIII.pdf}
	\includegraphics[width=0.45\textwidth]{LX_LMIR_LOIII.pdf}
    \end{center}
    \vspace{-25pt}
	\caption{
	\textbf{Left:}
	Intrinsic $L_{\rm 2-10\,keV}$\ vs. corrected $L_{\rm [OIII]}$ of J0916a compared to ULIRGs \citep{Teng2015, Oda2017} and normal AGNs from the BASS DR1 sample \citep{Koss2017}.
	The red circle and downward arrow show the upper-limit $L_{\rm 2-10\,keV}$\ of J0916a estimated assuming Compton-thick ($N_{\rm H}$\,=\,$1.5\times10^{24}$\,cm$^{-2}$) and Compton-thin obscuration ($10^{23}$\,cm$^{-2}$), respectively.
	The blue square and rightward arrow of F13120 denote the converted $L_{\rm [OIII]}$ from $L_{\rm [OIV]}$ using an empirical ratio of Seyfert 2 galaxies \citep{LaMassa2010} and an average $L_{\rm [OIII]}/L_{\rm [OIV]}$ ratio of the other ULIRGs, respectively.
	The blue square and rightward arrow of Mrk\,231 denote the uncorrected and corrected $L_{\rm [OIII]}$ with a typical dust extinction of Seyfert 1 galaxies \citep{LaMassa2010}, respectively.
	The orange contours show the 68\% ($1\sigma$) and 95\% ($2\sigma$) distribution ranges of the BASS DR1 AGNs (grey dots).
	The grey dashed and dotted lines show the empirical $L_{\rm 2-10\,keV}$-$L_{\rm [OIII]}$ relation from \citet{Ueda2015} and the $-1$ dex position under the relation, respectively.
	\textbf{Right:}
	$L_{\rm 2-10\,keV}$/$L_{\rm 5-38\,\mu m}$\ vs. $L_{\rm 5-38\,\mu m}$/$L_{\rm [OIII]}$.
	A small $y$-value denotes the corona ($<$\,10\,pc) fading compared to torus ($\sim$\,10\,pc),
	while a small $x$-value denotes the torus fading compared to NLR (1--10 kpc).
	The horizontal and vertical dotted lines show the median values of BASS DR1 AGNs.
	Other legends are the same as in the left panel.
	J0916a is the most extreme ULIRG with both fading corona and torus relative to the normal AGN sample.
	}
	\label{fig:LX_LMIR_LOIII}
\end{figure*}

\section{Discussions} \label{sec:discussions}
\subsection{X-ray faintness relative to NLR emission} \label{sec:discuss_X_NLR}

Figure \ref{fig:LX_LMIR_LOIII} (left panel) shows the intrinsic $L_{\rm 2-10\,keV}$\ and extinction corrected $L_{\rm [OIII]}$ of J0916a compared to six well-studied nearby ($z<0.1$) ULIRGs from \citet{Teng2014, Teng2015} and \citet{Oda2017}.
Four of the referred ULIRGs show Compton-thin obscuration, i.e., IRAS F05189–2524 (hereafter F05189),
Mrk\,231\footnote{We employ the intrinsic $L_{\rm 2-10\,keV}$\ from MYTorus model fitting in \citet{Teng2014}.},
Mrk\,273, and
Superantennae\footnote{Since the reported $L_{\rm 2-10\,keV}$\ of SA in \citet{Teng2015} was estimated without intrinsic obscuration,
we replace with the result of \citet{Brightman2011} for SA.}
(IRAS F19254–7245, hereafter SA);
the rest two ULIRGs host a Compton-thick level absorber, i.e., IRAS F13120–5453 (hereafter F13120) and
UGC\,5101\footnote{We employ the intrinsic $L_{\rm 2-10\,keV}$\ from ``Model II'' fitting in \citet{Oda2017}.}.
The corrected $L_{\rm [OIII]}$ of the referred ULIRGs are collected from
\citet[][F05189 and Mrk\,273]{Veilleux1999}, \citet[][SA]{Buchanan2006}, \citet[][UGC\,5101]{Moustakas2006}, and
\citet[][Mrk\,231]{Singh2011}\footnote{Since the Balmer decrement is not available, the $L_{\rm [OIII]}$ of Mrk\,231 is not corrected and shown as lower-limit in Figure \ref{fig:LX_LMIR_LOIII}.}.
The \hbox{[O\sc iii]}\ detection is not available for F13120 and we employ the $L_{\rm [OIII]}$ converted from $L_{\rm [OIV]}$
with the typical ratio of Seyfert 2 galaxies\footnote{
Note that the converted $L_{\rm [OIII]}$ of F13120 could be underestimated,
since the average $L_{\rm [OIII]}/L_{\rm [OIV]}$ ratio of the four ULIRGs (F05189, Mrk\,273, SA, UGC\,5101), $\sim$\,1.0\,dex,
seems higher than the ratio of Seyfert galaxies \citep[0.59\,dex,][]{LaMassa2010}.
}\,\citep{LaMassa2010}.
The contribution to $L_{\rm [OIII]}$ from star formation in the ULIRGs is estimated using the empirical relation of starbursts \citep{Gurkan2015},
which is only 0.5\%--2\% of the total $L_{\rm [OIII]}$ and thus,
we ignore the star formation contamination and consider that the $L_{\rm [OIII]}$ fully accounts for AGN activity.

In order to compare J0916a and other ULIRGs to normal AGNs, we also include the catalog of the Swift-BAT AGN Spectroscopic Survey \citep[BASS DR1,][]{Koss2017}.
In total, 243 AGNs are selected with S\,/\,N\,$>$\,3 for H$\alpha$, H$\beta$, and \hbox{[O\sc iii]}\ emission lines,
which consists of 135 Seyfert 1 galaxies (including Seyfert 1.2 to 1.9) and 108 Seyfert 2 galaxies.
The corrected $L_{\rm [OIII]}$ and $L_{\rm 2-10\,keV}$, which are converted from the Swift 14--195 keV luminosity and empirical ratio of \citet{Ricci2017},
are shown in the left panel of Figure \ref{fig:LX_LMIR_LOIII} with 68\% ($1\sigma$) and 95\% ($2\sigma$) distribution contours.

The ratio, $L_{\rm 2-10\,keV}$\,$/\,L_{\rm [OIII]}$, can be considered
as an indicator of the current X-ray faintness in the nuclear region relative to the past AGN activity.
All of the ULIRGs (except for F13120) in Figure \ref{fig:LX_LMIR_LOIII} (left panel) show lower $L_{\rm 2-10\,keV}$\,$/\,L_{\rm [OIII]}$ compared to the normal AGNs.
If we adopt a modified faintness ratio, $f_{\rm X}$\,=\,$L_{\rm 2-10\,keV}\,/\,L_{\rm X,\,[OIII]}$,
where $L_{\rm X,\,[OIII]}$ is the 2--10 keV luminosity converted from $L_{\rm [OIII]}$ using the empirical relation of normal AGNs \citep{Ueda2015},
then the referred ULIRGs (except for F13120) possess an average $f_{\rm X}$ of 10\%,
implying a general trend of X-ray deficit in the ULIRGs.
J0916a shows $f_{\rm X}$\,$<$\,3.6\% assuming $N_{\rm H}$\,=\,$1.5\times10^{24}$\,cm$^{-2}$,
which is even lower than the lowest $f_{\rm X}$\,$=$\,5.2\% of SA in the referred ULIRGs.
The $f_{\rm X}$ of J0916a can be much lower ($<1.6\%$) if we consider Compton-thin obscuration ($N_{\rm H}$\,=\,$10^{23}$\,cm$^{-2}$).
The extremely low $f_{\rm X}$ of J0916a suggests a most extreme case of X-ray declining among the ULIRGs, which is possibly related to a strong nuclear wind implied by its highest $\dot{E}_{\rm k}$ ionized outflow in the galaxy scale (see Section \ref{sec:discuss_feedback} for a detailed discussion).

\subsection{Fading AGN central engine indicated by both faint corona and torus radiation} \label{sec:discuss_fading}

The MIR emission from the dusty torus can be used as an intermediate indicator of AGN activity with its spatial scale ($\sim$\,10\,pc) between
X-ray emitting corona \citep[$<$\,0.1\,pc,][]{Dai2010} and NLR (1--10 kpc),
and it traces AGN activity in the last several 10 years \citep[e.g.,][]{Ichikawa2017b}.
In order to make a fair comparison to J0916a, we collect the optical-IR photometries from
the Sloan Digital Sky Survey (SDSS),
the Two Micron All Sky Survey (2MASS),
the Wide-field Infrared Survey Explorer (WISE),
the Spitzer Space Telescope,
the Infrared Astronomical Satellite (IRAS),
and AKARI for the six referred ULIRGs,
and then perform SED fitting with \texttt{CIGALE} \citep{Boquien2019} following the configuration of \citet{Chen2019}.
The $L_{\rm 5-38\,\mu m}$ of the referred ULIRGs are integrated with the best-fit AGN SEDs including the torus thermal and scattering radiation as well as the transmitted primary emission.
The $L_{\rm 5-38\,\mu m}$ of the BASS AGN sample are adopted from \citet{Ichikawa2019s}.

The right panel of Figure \ref{fig:LX_LMIR_LOIII} shows the values of two ratios, i.e., $L_{\rm 2-10\,keV}$/$L_{\rm 5-38\,\mu m}$\ and $L_{\rm 5-38\,\mu m}$/$L_{\rm [OIII]}$.
A low $L_{\rm 2-10\,keV}$/$L_{\rm 5-38\,\mu m}$\ relative to normal AGNs suggests AGN fading in the core region (0.1\,pc compared to 10\,pc),
while a low $L_{\rm 5-38\,\mu m}$/$L_{\rm [OIII]}$ denotes AGN fading in the circumnuclear region (10\,pc compared to several kpc).
With this diagram the ULIRGs can be separated into three groups:
1) F13120 shows the properties similar to normal AGNs;
2) SA and Mrk\,231 possess decayed coronae but their tori are still luminous;
3) the other four ULIRGs including J0916a show both faint corona and torus radiation.
However, the fading ratios of F05189, Mrk\,273, and UGC\,5101 are moderate and within the 95\% ($2\sigma$) distribution range of the BASS AGN sample.
J0916a locates at a unique position out of the 95\% range of the BASS sample, which indicates that
both of its core (corona) and circumnuclear (torus) AGN emission are drastic declining.

\subsection{Powerful outflow with fading central engine: the cumulative effect of AGN feedback can be limited} \label{sec:discuss_feedback}

A possible scenario to explain both of the faintness in corona (X-ray) and torus (MIR) in J0916a is that
the primary radiation from the AGN accretion disk is currently in a fading status.
Suggested by the connection between the multi-phase outflows observed in nearby ULIRGs such as Mrk\,231 \citep{Feruglio2015} and F05189 \citep{Smith2019},
the powerful galaxy-scale ionized outflow in J0916a could imply an ultrafast nuclear wind
when the \hbox{[O\sc iii]}\ outflow was launched with
a super-Eddington accretion.
The Eddington ratio ($\lambda_{\rm Edd}$) is estimated to be 5.7, with the bolometric luminosity converted from $L_{\rm [OIII]}$
and the mass of SMBH ($2.7\times10^7$\,$M_{\odot}$) estimated using the stellar mass of the host galaxy\footnote{To be compared, the $\lambda_{\rm Edd}$ estimated from $L_{\rm bol,\,torus}$ and $L_{\rm bol,\,corona}$ are 1.4 and $<0.3$, respectively.}.
The nuclear wind could blow out the surrounding gas and dust, weaken the development of corona and torus, and suppress the fueling to the SMBH.

With the extent of the \hbox{[O\sc iii]}\ outflow (4\,kpc) and the maximum outflow velocity ($\sim$\,2000\,km\,s$^{-1}$),
the fading process could happen in an outflow-traveling timescale of $\sim$\,2\,Myr, or a light-traveling timescale of $\sim$\,$10^4$ years.
Namely, the fading timescales are much shorter than the duration of starburst in ULIRGs, i.e., $\sim$\,100\,Myr \citep[e.g.,][]{Hopkins2008},
implying that
although the AGN can drive an powerful, fast wind in the galaxy,
e.g., the outflow velocity of J0916a even exceeds the escape velocity of the host halo \citep{Chen2020},
it can be decayed in a relatively short period,
and the cumulative effect of AGN feedback on the stellar build-up in the galaxy can be limited
as indicated by the high star formation rate of 1000\,$M_{\odot}$\,yr$^{-1}$.

\subsection{Other possibilities and future work} \label{subsec:discuss_other}

In the above discussion a Compton-thick level absorber, $N_{\rm H}$\,=\,$1.5\times10^{24}$\,cm$^{-2}$, is assumed,
which accounts for the heavy obscuration in ULIRGs \citep[e.g.,][]{Teng2015}.
However, it is hard to rule out the possibility of a very Compton-thick absorber, e.g., $N_{\rm H}$\,$\sim$\,$10^{25}$\,cm$^{-2}$, locating on the line of sight and shielding the X-ray emitting corona.
Significant constraint on the nuclear gas column density in J0916a is over the capability of the current X-ray instruments due to its faintness at a relatively high redshift.
Sub-millimeter (submm) observations of dust emission with a high spatial resolution, e.g., ALMA, provide an alternative method to study such heavily obscured environment in galaxies \citep[e.g.,][]{Scoville2015}.
Note that although a very Compton-thick absorber may explain the observed X-ray faintness in J0916a,
we still need other scenarios for the explanation on the MIR faintness of the torus.

Recent studies showed that the weakness of X-ray emission is associated to high $\lambda_{\rm Edd}$ \citep[e.g.,][]{Toba2019} and fast disk winds \citep[e.g.,][]{Zappacosta2020}, in which the X-ray deficit does not suggest the fading of the primary accretion disk radiation, but could be explained with the weakening of corona when the disk inner-edge moves inwards, or the cooling of corona due to the dense, so-called ``failed wind''.
Within those scenarios, the high $\lambda_{\rm Edd}$\,=\,5.7 of J0916a from its extended \hbox{[O\sc iii]}\ emission could reflect not only the past, but also the current AGN activity, i.e., the AGN is still active.
However, the expected $L_{\rm 5-38\,\mu m}$\ in this active scenario could be over three times brighter than the observed value,
considering that the covering factor of torus keeps nearly constant with $\lambda_{\rm Edd}$\,$>$\,0.03 \citep{Ricci2017}.
With the observed low $L_{\rm 5-38\,\mu m}$/$L_{\rm [OIII]}$, we tend to adopt the fading scenario as discussed in Section \ref{sec:discuss_feedback}, although it is difficult to rule out the active scenario due to the uncertainty in the estimation of NLR radiation.
In this work the \hbox{[O\sc iii]\,$\lambda$5007}\ line is used as the indicator of AGN NLR radiation.
Compared to the IR \hbox{[O\textsc{iv}]\,25.9\,\micron}\ emission line, \hbox{[O\sc iii]}\ emission is more likely contaminated by the ionized gas surrounding young O\,/\,B type stars,
and is more sensitive to the dust extinction.
We estimate the amount of star formation contamination in the total $L_{\rm [OIII]}$, which is only 0.6\% and can be ignored.
However, the uncertainty in the extinction estimation due to the weakness of H$\beta$\ line can results in a variation of 0.5 dex in the corrected $L_{\rm [OIII]}$.
High quality optical spectrum is required to reduce the uncertainty of extinction correction, which will be achieved with the awarded Gemini/GMOS IFU follow-up for J0916a.
The IFU observation can also help us to better constrain the extent the size of the outflowing region.

In addition to the fading AGN scenario where the central AGN activity indicated by X-ray and MIR radiation is finally quenched,
there is another possibility that the AGN in J0916a may brighten up again as shown in the ``changing-look AGNs'' (CLAGNs),
which have strong variability by an order of magnitude and can rebrighten when their accretion states change from faint phase to bright phase in a timescale of 1--10 years \citep[e.g.,][]{Ricci2020}.
If J0916a has a CLAGN and its X-ray emitting corona would recover $L_{\rm 2-10\,keV}$\ of $\sim9\times10^{44}$\,erg\,s$^{-1}$\
as expected from the corrected $L_{\rm [OIII]}$,
then the AGN can be significantly detected by NuSTAR, e.g.,
S\,/\,N\,$>$\,7 in 3--20 keV with an exposure of 100 ksec in a Compton-thick case ($N_{\rm H}$\,$\sim$\,$10^{24}$\,cm$^{-2}$).
Therefore the future NuSTAR follow-up in a few years is necessary to test the CLAGN scenario.
The submm observation with a high spatial resolution, e.g., ALMA, can be also helpful to constrain the CLAGN scenario.
Considering the spectral coverage of ALMA at $z$\,=\,0.49, CO\,J=4-3 line can be employed as a tracer of molecular gas in J0916a.
The spatial resolution of ALMA can reach 0.01\arcsec\ (80\,pc) at Band 7 with the maximum baselines of 16.2 km,
which provides the capability to determine the molecular gas reservoir in the circumnuclear region (100--200\,pc) of the AGN.
If the ALMA observation reveals that the cold molecular gas has been cleaned up in the circumnuclear region,
the possibility of AGN rebrightening could be reduced without fueling to the SMBH.

\acknowledgments

We thank the anonymous referee for the valuable comments and constructive suggestions.
We thank Drs. Junxian Wang and Teng Liu for the fruitful discussion on mechanisms of X-ray faintness.
This research has made use of the NuSTAR Data Analysis Software (NuSTARDAS) jointly developed by the ASI Space Science Data Center (SSDC, Italy) and the California Institute of Technology (Caltech, USA).

\facilities{NuSTAR}

\software{NuSTARDAS, CIGALE}