When we watch a video, in which human hands manipulate objects, these hands may obscure some parts of those objects. We are willing to make clear how the objects are manipulated by making the image of hands semi-transparent, and showing the complete images of the hands and the object. By carefully choosing a Half-Diminished Reality method, this paper proposes a method that can process the video in real time and verifies that the proposed method works well.
He and Zhang @cite_3 use a time shift approach. Since only a single camera is used in this approach, the information complementing the background image comes from the previous images. In this approach, the region that is regarded as the foreground part is not updated. As a result, the past images are used to complement the region that is currently concealed by a foreground object. The background image is updated by the current image in only the part where the image is regarded as stable. A nice feature of He and Zhang's approach is the ability to update the background. Please note that the change of background is inevitably delayed in order to judge its stability. Since they aimed to recover the information from a white board, in other words, they aimed at DR only, they did not need to consider the interaction between the foreground image and the background image. Therefore, this delay was not an issue for them.
@cite_3
2100286961
This paper describes our recently developed system which captures pen strokes on physical whiteboards in real time using an off-the-shelf video camera. Unlike many existing tools, our system does not instrument the pens or the whiteboard. It analyzes the sequence of captured video images in real time, classifies the pixels into whiteboard background, pen strokes and foreground objects (e.g., people in front of the whiteboard), extracts newly written pen strokes, and corrects the color to make the whiteboard completely white. This allows us to transmit whiteboard contents using very low bandwidth to remote meeting participants. Combined with other teleconferencing tools such as voice conference and application sharing, our system becomes a powerful tool to share ideas during online meetings