CROSS REFERENCE TO RELATED APPLICATION

The present application claims priority to KR10-2019-0031685, filed 2019 Mar. 20, KR10-2019-0032271, filed 2019 Mar. 21, and KR10-2020-0034454, filed 2020 Mar. 20, the entire contents of which are incorporated herein for all purposes by this reference.

BACKGROUND

Field

The present invention relates to a processing/synthesizing method for an immersive video supporting motion parallax for rotational and translation motions.

Description of Related Art

Virtual reality service evolves towards maximizing senses of immersion and realism by generating an omni-directional video in a realistic or CG (Computer Graphics) format and reproducing the video on an HMD (Head Mounted Display), a smart phone and the like. It is currently known that 6 DoF (Degrees of Freedom) needs to be supported in order to play a natural and highly immersive omni-directional video through an HMD. A 6 DoF video provided on an HMD should be a free video in six directions including (1) the horizontal movement, (2) the vertical rotation, (3) the vertical movement and (4) the horizontal rotation. However, most omni-directional videos based on real images are currently supporting only rotational movements. Therefore, researches on such technical fields as the acquisition and reproduction of 6 DoF omni-directional videos are actively under way.

SUMMARY

For providing a large-capacity immersive video service supporting motion parallax, the present invention aims to provide a file format enabling video reproduction that supports motion parallax only by transmitting as small a video and as little metadata as possible.

Also, the present invention aims to provide a method of removing duplicate data among additional view videos.

Also, the present invention aims to provide a method of rendering transformation information as metadata in patch packing.

The technical objects of the present invention are not limited to the above-mentioned technical objects, and other technical objects that are not mentioned will be clearly understood by those skilled in the art through the following descriptions.

An immersive video processing method according to the present invention may include classifying a multiplicity of view videos into a base view and an additional view, generating a residual video for the additional view video classified as an additional view, packing patches, which are generated based on the residual video, into an atlas video, and generating metadata for the patch. Herein, the metadata may include transformation information of the patch.

In an immersive video processing method according to the present invention, the transformation information may include information of horizontal translation, information of vertical translation and information of rotation for the patch.

In an immersive video processing method according to the present invention, the transformation information may further include scaling information of the patch.

In an immersive video processing apparatus and an immersive video synthesizing method according to the present invention, the residual video may be generated by subtracting a base view video and a layered video of the base view video from the additional view video.

In an immersive video processing method according to the present invention, the layered video may be generated based on temporary residual videos, each of the temporary residual videos may be generated by subtracting the base view video from each of a multiplicity of additional view videos, and the layered video may be generated by removing duplicate data between the base view video and the temporary residual videos.

In an immersive video processing apparatus and an immersive video synthesizing method according to the present invention, the residual video may be generated through pruning with another additional view video that belongs to the same group as the additional view video but has a higher priority than the additional view video.

In an immersive video processing apparatus and an immersive video synthesizing method according to the present invention, the residual video may be generated by subtracting a base view video and a global residual video from the additional view video.

In an immersive video processing apparatus and an immersive video synthesizing method according to the present invention, the global residual video may be generated based on the additional view video and temporary residual videos of view videos belonging to the same group as the additional view video.

The features briefly summarized above with respect to the present invention are merely exemplary aspects of the detailed description below of the present invention, and do not limit the scope of the present invention.

According to the present invention, a file format may be provided which enables video reproduction supporting motion parallax by transmitting as small a video and metadata as possible.

According to the present invention, an amount of data for immersive video processing may be reduced by removing duplicate data among additional view videos.

According to the present invention, an immersive video processing efficiency may be enhanced by rendering transformation information as metadata in patch packing.

Effects obtained in the present invention are not limited to the above-mentioned effects, and other effects not mentioned above may be clearly understood by those skilled in the art from the following description.

