Multimodal sensor fusion. Fusion among different types of sensing modalities for improved quality and functionality is an interesting topic. A related problem to ours is to spatially upsample functional sensors, e.g., depth or hyperspectral sensors, with a high resolution guide image. The fusion problem can be formulated as joint image filtering via bilateral [1]}, multi-lateral filters [2]} or Convolutional Neural Network (CNN) based approach [3]}. For high-speed video sensing, a fusion strategy can be employed between high-speed video cameras (low spatial resolution) and high spatial resolution still cameras (low speed) [4]}, [5]}, [6]}, [7]}, [8]}.
