CROSS REFERENCE TO RELATED APPLICATION

The present application claims priority to Korean Patent Application No. 10-2019-0081605, filed Jul. 5, 2019, No. 10-2019-0119176, filed Sep. 26, 2019, and No. 10-2020-0082200, filed Jul. 3, 2020, the entire contents of which are incorporated herein for all purposes by this reference.

BACKGROUND OF THE INVENTION

Field of the Invention

The present disclosure relates to a processing/synthesizing method for an immersive video supporting motion parallax for rotational and translation motions.

Description of the Related Art

Virtual reality service evolves towards maximizing senses of immersion and realism by generating an omni-directional video in realistic or CG (Computer Graphics) format and reproducing the video on an HMD (Head Mounted Display), a smart phone and the like. It is currently known that 6 DoF (Degrees of Freedom) needs to be supported in order to play a natural and highly immersive omni-directional video through an HMD. A 6 DoF video provided on an HMD should be a free video in six directions including (1) left-and-right rotation, (2) up-and-down rotation, (3) left-and-right translation, and (4) up-and-down translation. However, most omni-directional videos based on real images are currently supporting only rotational movements. Therefore, researches on such technical fields as the acquisition and reproduction of 6 DoF omni-directional videos are actively under way.

SUMMARY OF THE INVENTION

For providing a large-capacity immersive video service supporting motion parallax, the present disclosure is directed to provide a file format enabling video reproduction that supports motion parallax only by transmitting as small a video and as little metadata as possible.

Also, the present disclosure is directed to provide a method of removing duplicate data among additional view videos.

Also, the present disclosure is directed to provide a method of determining a priority order of pruning among additional view videos.

The technical objects of the present disclosure not limited to the above-mentioned technical objects, and other technical objects that are not mentioned will be clearly understood by those skilled in the art from the following description.

An immersive video processing method according to the present disclosure may include determining a priority order of pruning for source view videos, generating a residual video for an additional view video based on the priority order of pruning, packing a patch generated based on the residual video into an atlas video, and encoding the atlas video. Herein, the determining of the priority order of pruning may include determining a basic view video among the source view videos and determining a priority order of pruning for additional view videos except the basic view video.

In an immersive video processing method according to the present disclosure, the basic view video may have the highest priority of pruning.

In an immersive video processing method according to the present disclosure, the priority order of pruning among the additional view videos may be determined based on a size of an overlapping area with the basic view video.

In an immersive video processing method according to the present disclosure, when a pruning priority for at least one of the additional view videos is determined, pruning priorities for the remaining additional view videos may be determined based on a size of an overlapping area with each of higher-priority view videos, and the higher-priority view videos may include the basic view video and at least one additional view video with a pruning priority being determined.

In an immersive video processing method according to the present disclosure, pruning priorities for the remaining additional view videos may be determined based on a size of an area that is obtained by summing overlapping areas for each of the higher-priority view videos.

In an immersive video processing method according to the present disclosure, a priority order of pruning for the additional view videos may be determined based on whether the additional view videos include a region of interest.

The features briefly summarized above with respect to the present disclosure are merely exemplary aspects of the detailed description below of the present disclosure, and do not limit the scope of the present disclosure.

According to the present disclosure, a file format may be provided which enables video reproduction supporting motion parallax by transmitting as small a video and as little metadata as possible.

According to the present disclosure, an amount of data for immersive video processing may be reduced by removing duplicate data among additional view videos.

According to the present disclosure, immersive video processing efficiency may be improved by adaptively determining a priority order of pruning for additional view videos.

Effects obtained in the present disclosure are not limited to the above-mentioned effects, and other effects not mentioned above may be clearly understood by those skilled in the art from the following description.

