CROSS REFERENCE TO PRIOR APPLICATION

This application is a National Stage Patent Application of PCT International Patent Application No. PCT/JP2016/082027 (filed on Oct. 28, 2016) under 35 U.S.C. § 371, which claims priority to Japanese Patent Application No. 2015-221236 (filed on Nov. 11, 2015), which are all hereby incorporated by reference in their entirety.

TECHNICAL FIELD

The present disclosure relates to an image processing apparatus and an image processing method, and particularly to an image processing apparatus and an image processing method by which three-dimensional data can be generated with high accuracy on the basis of two-dimensional image data and depth image data.

BACKGROUND ART

In a multi-view stereo technology, a transmission system has been devised which records, encodes, transmits, decodes and displays three-dimensional data including three-dimensional position information and two-dimensional image data of a three-dimensional object picked up by a plurality of cameras (for example, refer to NPL 1). As an encoding method of three-dimensional data, an MPEG (Moving Picture Experts Group phase) method and so forth are available (for example, refer to NPL 2).

Further, a transmission system has been devised by which a plurality of pieces of two-dimensional image data of different viewpoints and depth image data including depths indicative of positions of pixels in the depthwise direction of an image pickup object (direction perpendicular to an image pickup plane), both obtained from a plurality of cameras, are recorded, encoded, transmitted, decoded and displayed as they are. As a method for encoding two-dimensional image data and depth image data, an MVCD (Multiview and depth video coding) method, an AVC (Advanced Video Coding) method, an HEVC (High Efficiency Video Coding) method and so forth are available.

CITATION LIST

Non Patent Literature

[NPL 1]

Ming Chuang, Pat Sweeney, Don Gillett, Dennis Evseev, David Calabrese, Hugues Hoppe, Adam Kirk, Steve Sullivan, “High-Quality Streamable Free-Viewpoint Video, Alvaro Collet,” Microsoft Corporation

[NPL 2]

Marius Preda, “MPEG Graphics Compression Model” MPEG document: N9892, May 2008

SUMMARY

Technical Problems

However, in the case where three-dimensional information of an image pickup object is transmitted as three-dimensional data, a processing unit of a high function that processes three-dimensional data is required on the reception side.

Further, in the case where three-dimensional information of an image pickup object is transmitted in the form of two-dimensional image data and depth image data obtained by a plurality of cameras, although the processing on the reception side is facilitated, a color shift sometimes occurs in two-dimensional image data of viewpoints. In this case, three-dimensional data cannot be generated with high accuracy on the basis of the two-dimensional image data and the depth image data of the viewpoints.

The present disclosure has been made in view of such a situation as described above, and it is an object of the present disclosure to make it possible to generate three-dimensional data with high accuracy on the basis of two-dimensional image data and depth image data.

Solution to Problems

The image processing apparatus according to a first aspect of the present disclosure is an image processing apparatus, including: a color shift correction data generation unit that generates color shift correction data for correcting a color shift between two-dimensional image data of a first viewpoint and two-dimensional image data of a second viewpoint; and a transmission unit that transmits color shift correction information including the color shift correction data generated by the color shift correction data generation unit, first encoded data that is encoded data of the two-dimensional image data of the first viewpoint and depth image data indicative of a position of each of pixels in a depthwise direction of an image pickup object with respect to a third viewpoint and second encoded data that is encoded data of the two-dimensional image data of the second viewpoint and depth image data of a fourth viewpoint.

The image processing method according to the first aspect of the present disclosure corresponds to the image processing apparatus of the first aspect of the present disclosure.

In the first aspect of the present disclosure, color shift correction data for correcting a color shift between two-dimensional image data of a first viewpoint and two-dimensional image data of a second viewpoint is generated, and color shift correction information including the generated color shift correction data, first encoded data that is encoded data of the two-dimensional image data of the first viewpoint and depth image data indicative of a position of each of pixels in a depthwise direction of an image pickup object with respect to a third viewpoint and second encoded data that is encoded data of the two-dimensional image data of the second viewpoint and depth image data of a fourth viewpoint are transmitted.

The image processing apparatus according to a second aspect of the present disclosure is an image processing apparatus, including: a decoding unit that decodes first encoded data that is encoded data of two-dimensional image data of a first viewpoint and depth image data indicative of a position of each of pixels in a depthwise direction of an image pickup object with respect to a second viewpoint and second encoded data that is encoded data of two-dimensional image data of a third viewpoint and depth image data of a fourth viewpoint; and a color correction unit that performs color correction of the two-dimensional image data of the third viewpoint obtained as a result of the decoding by the decoding unit on the basis of color shift correction information including color shift correction data of the two-dimensional image data of the first viewpoint and the two-dimensional image data of the third viewpoint.

The image processing method and program according to the second aspect of the present disclosure correspond to the image processing apparatus of the second aspect of the present disclosure.

In the second aspect of the present disclosure, first encoded data that is encoded data of two-dimensional image data of a first viewpoint and depth image data indicative of a position of each of pixels in a depthwise direction of an image pickup object with respect to a second viewpoint and second encoded data that is encoded data of two-dimensional image data of a third viewpoint and depth image data of a fourth viewpoint are decoded. On the basis of color shift correction information including color shift correction data of the two-dimensional image data of the first viewpoint and the two-dimensional image data of the third viewpoint, color correction of the two-dimensional image data of the third viewpoint obtained as a result of the decoding is performed.

It is to be noted that the image processing apparatus in the first aspect and the second aspect can be implemented by causing a computer to execute a program.

Further, in order to implement the image processing apparatus of the first aspect and the second aspect, the program to be executed by the computer can be provided by transmitting the same through a transmission medium or by recording the same on a recording medium.

Advantageous Effects of Invention

With the first aspect of the present disclosure, image processing can be performed. Further, with the first aspect of the present disclosure, the image processing can be performed such that three-dimensional data can be generated with high accuracy on the basis of two-dimensional image data and depth image data.

With the second aspect of the present disclosure, image processing can be performed. Further, with the second aspect of the present disclosure, three-dimensional data can be generated with high accuracy on the basis of two-dimensional image data and depth image data.

It is to be noted that the effects described here are not necessarily restrictive and any one of the effects described in the present disclosure may be applied.

