Abstract Recently, deep learning methods have made a significant improvement in compressive sensing image reconstruction task. In the existing methods, the scene is measured block by block due to the high computational complexity. This results in block-effect of the recovered images. In this paper, we propose a fully convolutional measurement network, where the scene is measured as a whole. The proposed method powerfully removes the block-effect since the structure information of scene images is preserved. To make the measure more flexible, the measurement and the recovery parts are jointly trained. From the experiments, it is shown that the results by the proposed method outperforms those by the existing methods in PSNR, SSIM, and visual effect.
In order to keep the information of the training data, the adaptive measurement is proposed. Methods including improved ReconNet @cite_16 , Adp-Rec Adp-Rec stands for adaptive measurement network for CS image reconstruction, proposed in our previous work. @cite_1 , and DeepCodec @cite_10 are all based on adaptive measurement. In cases of the improved ReconNet and Adp-Rec, a fully-connected layer is used to measure the signals, which allows for a jointly learning of the measurement and reconstruction stages. With the learned measurement matrix, a significant gain in terms of PSNR is achieved. DeepCodec, closely related to the DeepInverse, learns a transformation for dimensionality reduction. Learning measurements from the original signals helps to preserve more information compared with taking random measurements.
@cite_10 @cite_16 @cite_1
2734857877 2750537432 2762145983
In this paper we develop a novel computational sensing framework for sensing and recovering structured signals. When trained on a set of representative signals, our framework learns to take undersampled measurements and recover signals from them using a deep convolutional neural network. In other words, it learns a transformation from the original signals to a near-optimal number of undersampled measurements and the inverse transformation from measurements to signals. This is in contrast to traditional compressive sensing (CS) systems that use random linear measurements and convex optimization or iterative algorithms for signal recovery. We compare our new framework with @math -minimization from the phase transition point of view and demonstrate that it outperforms @math -minimization in the regions of phase transition plot where @math -minimization cannot recover the exact solution. In addition, we experimentally demonstrate how learning measurements enhances the overall recovery performance, speeds up training of recovery framework, and leads to having fewer parameters to learn. Traditional algorithms for compressive sensing recovery are computationally expensive and are ineffective at low measurement rates. In this work, we propose a data driven non-iterative algorithm to overcome the shortcomings of earlier iterative algorithms. Our solution, ReconNet, is a deep neural network, whose parameters are learned end-to-end to map block-wise compressive measurements of the scene to the desired image blocks. Reconstruction of an image becomes a simple forward pass through the network and can be done in real-time. We show empirically that our algorithm yields reconstructions with higher PSNRs compared to iterative algorithms at low measurement rates and in presence of measurement noise. We also propose a variant of ReconNet which uses adversarial loss in order to further improve reconstruction quality. We discuss how adding a fully connected layer to the existing ReconNet architecture allows for jointly learning the measurement matrix and the reconstruction algorithm in a single network. Experiments on real data obtained from a block compressive imager show that our networks are robust to unseen sensor noise. Finally, through an experiment in object tracking, we show that even at very low measurement rates, reconstructions using our algorithm possess rich semantic content that can be used for high level inference. Conventional compressive sensing (CS) reconstruction is very slow for its characteristic of solving an optimization problem. Convolutional neural network can realize fast processing while achieving comparable results. While CS image recovery with high quality not only depends on good reconstruction algorithms, but also good measurements. In this paper, we propose an adaptive measurement network in which measurement is obtained by learning. The new network consists of a fully-connected layer and ReconNet. The fully-connected layer which has low-dimension output acts as measurement. We train the fully-connected layer and ReconNet simultaneously and obtain adaptive measurement. Because the adaptive measurement fits dataset better, in contrast with random Gaussian measurement matrix, under the same measurement rate, it can extract the information of scene more efficiently and get better reconstruction results. Experiments show that the new network outperforms the original one.