CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a national phase entry under 35 USC 371 of International Patent Application No. PCT/CN2019/127423 filed on Dec. 23, 2019, which claims priority to Chinese Patent Application No. 201910002289.3, filed on Jan. 2, 2019, which are incorporated herein by reference in their entirety.

TECHNICAL FIELD

The present disclosure relates to the field of display technologies, and in particular, to a video processing method, a video processing control apparatus, a display control apparatus and a display apparatus.

BACKGROUND

A virtual reality (VR) system is a computer simulation system that can create and experience a virtual world. In the application of the VR system, image delay affects quality of displayed images. For example, for moving images (videos), a blur phenomenon may occur.

SUMMARY

In one aspect, a video processing method is provided. The method includes: receiving motion information of a display apparatus; determining, according to the motion information of the display apparatus and a motion threshold of the display apparatus, whether a motion state of the display apparatus affects an effect of the display apparatus using a frame rate up-conversion image processing method based on motion compensation to process a video that is to be displayed by the display apparatus; if yes, stopping using the frame rate up-conversion image processing method based on motion compensation to process the video that is to be displayed by the display apparatus; if no, continuing to use the frame rate up-conversion image processing method based on motion compensation to process the video that is to be displayed by the display apparatus.

In some embodiments, the motion information of the display apparatus includes an X-axis acceleration Accel_X, a Y-axis acceleration Accel_Y and a Z-axis acceleration Accel_Z of the display apparatus in a three-dimensional coordinate system, and the motion threshold includes an acceleration threshold Accel_Threshold;

determining, according to the motion information of the display apparatus and the motion threshold of the display apparatus, whether the motion state of the display apparatus affects the effect of the display apparatus using the frame rate up-conversion image processing method based on motion compensation to process the video that is to be displayed by the display apparatus, includes:

determining whether the motion information and the motion threshold of the display apparatus meet:
Sqrt(Accel_X2+Accel_Y2+Acecl_Z2)≥Accel_Threshold;

if yes, determining that the motion state of the display apparatus affects the effect of the display apparatus using the frame rate up-conversion image processing method based on motion compensation to process the video that is to be displayed by the display apparatus; and if no, determining that the motion state of the display apparatus does not affect the effect of the display apparatus using the frame rate up-conversion image processing method based on motion compensation to process the video that is to be displayed by the display apparatus.

In some embodiments, receiving the motion information of the display apparatus includes: receiving m pieces of motion information of the display apparatus one by one within a first preset time period, wherein m is an integer greater or equal to 2; and determining, according to the motion information of the display apparatus and the motion threshold of the display apparatus, whether the motion state of the display apparatus affects the effect of the display apparatus using the frame rate up-conversion image processing method based on motion compensation to process the video that is to be displayed by the display apparatus, includes:

determining one by one, according to respective pieces of motion information in the m pieces of motion information and the motion threshold of the display apparatus, whether respective motion states in m motion states of the display apparatus affect the effect of the display apparatus using the frame rate up-conversion image processing method based on motion compensation to process the video that is to be displayed by the display apparatus; if it is determined that the m motion states of the display apparatus all affect the effect of the display apparatus using the frame rate up-conversion image processing method based on motion compensation to process the video that is to be displayed by the display apparatus, determining that the motion state of the display apparatus affects the effect of the display apparatus using the frame rate up-conversion image processing method based on motion compensation to process the video that is to be displayed by the display apparatus; and if it is determined that the m motion states of the display apparatus do not all affect the effect of the display apparatus using the frame rate up-conversion image processing method based on motion compensation to process the video that is to be displayed by the display apparatus, determining that the motion state of the display apparatus does not affect the effect of the display apparatus using the frame rate up-conversion image processing method based on motion compensation to process the video that is to be displayed by the display apparatus.

In some embodiments, before determining, according to the motion information of the display apparatus and the motion threshold of the display apparatus, whether the motion state of the display apparatus affects the effect of the display apparatus using the frame rate up-conversion image processing method based on motion compensation to process the video that is to be displayed by the display apparatus, the video processing method further includes:

receiving the video that is to be displayed by the display apparatus, the video including data of multiple frames; determining whether data of consecutive k frames in the data of the multiple frames are the same, wherein k is an integer greater than or equal to 2; if yes, stopping using the frame rate up-conversion image processing method based on motion compensation to process the video that is to be displayed by the display apparatus; and if no, determining, according to the motion information of the display apparatus and the motion threshold of the display apparatus, whether the motion state of the display apparatus affects the effect of the display apparatus using the frame rate up-conversion image processing method based on motion compensation to process the video that is to be displayed by the display apparatus.

In some embodiments, if the data of the consecutive k frames are not the same, before determining, according to the motion information of the display apparatus and the motion threshold of the display apparatus, whether the motion state of the display apparatus affects the effect of the display apparatus using the frame rate up-conversion image processing method based on motion compensation to process the video that is to be displayed by the display apparatus, the video processing method further includes:

determining, according to the motion information of the display apparatus and a static threshold of the display apparatus, whether the display apparatus is still or approximately still; if yes, stopping using the frame rate up-conversion image processing method based on motion compensation to process the video that is to be displayed by the display apparatus; and if no, determining, according to the motion information of the display apparatus and the motion threshold of the display apparatus, whether the motion state of the display apparatus affects the effect of the display apparatus using the frame rate up-conversion image processing method based on motion compensation to process the video that is to be displayed by the display apparatus.

In some embodiments, the motion information of the display apparatus includes an X-axis angular velocity Gyro_X, a Y-axis angular velocity Gyro_Y and a Z-axis angular velocity Gyro_Z of the display apparatus in a three-dimensional coordinate system; the static threshold includes an angular velocity threshold GYRO_Threshold;

determining, according to the motion information of the display apparatus and the static threshold of the display apparatus, whether the display apparatus is still or approximately still, includes: determining whether the motion information and the static threshold of the display apparatus meet:
Sqrt(Gyro_X2+Gyro_Y2+Gyro_Z2)≤GYRO_Threshold;

if it is determined that the n states of the display apparatus are all static states or approximately static states, determining that the display apparatus is still or approximately still; and if it is determined that the n states of the display apparatus are not all static states or approximately static states, determining that the display apparatus is in a motion state.

In some embodiments, receiving the motion information of the display apparatus, includes: receiving n pieces of motion information of the display apparatus one by one within a second preset time period, wherein n is an integer greater than or equal to 2. Determining, according to the motion information of the display apparatus and the static threshold of the display apparatus, whether the display apparatus is still or approximately still, includes: determining one by one, according to respective pieces of motion information in the n pieces of motion information and the static threshold of the display apparatus, whether respective states in n states of the display apparatus are static or approximately static; if yes, determining that the display apparatus is still or approximately still; and if no, determining that the display apparatus is in the motion state.

In another aspect, a video processing control apparatus is provided, and the video processing control apparatus includes a processor and a memory. The memory is configured to store computer program instructions that, when executed by the processor, cause the processor to perform one or more of following steps: receiving motion information of a display apparatus; determining, according to the motion information of the display apparatus and a motion threshold of the display apparatus, whether the motion state of the display apparatus affects an effect of the display apparatus using the frame rate up-conversion image processing method based on motion compensation to process a video that is to be displayed by the display apparatus; outputting a determination result; according to the determination result, outputting a first control signal that stops using the frame rate up-conversion image processing method based on motion compensation to process the video that is to be displayed by the display apparatus in a case where the motion state of the display apparatus affects the effect of the display apparatus using the frame rate up-conversion image processing method based on motion compensation to process the video that is to be displayed by the display apparatus; and outputting a second control signal that continues to use the frame rate up-conversion image processing method based on motion compensation to process the video that is to be displayed by the display apparatus in a case where the motion state of the display apparatus does not affect the effect of the display apparatus using the frame rate up-conversion image processing method based on motion compensation to process the video that is to be displayed by the display apparatus.

In some embodiments, the motion information of the display apparatus includes an X-axis acceleration Accel_X, a Y-axis acceleration Accel_Y and a Z-axis acceleration Accel_Z of the display apparatus in a three-dimensional coordinate system; the motion threshold includes an acceleration threshold Accel_Threshold.

When the computer program instructions are executed by the processor, the computer program instructions cause the processor further to perform: determining whether the motion information and the motion threshold of the display apparatus meet:
Sqrt(Accel_X2+Accel_Y2+Accel_Z2)≥Accel_Threshold;

if yes, determining that the motion state of the display apparatus affects the effect of the display apparatus using the frame rate up-conversion image processing method based on motion compensation to process the video that is to be displayed by the display apparatus; and if no, determining that the motion state of the display apparatus does not affect the effect of the display apparatus using the frame rate up-conversion image processing method based on motion compensation to process the video that is to be displayed by the display apparatus.

In some embodiments, when the computer program instructions are executed by the processor, the computer program instructions cause the processor further to perform: receiving m pieces of motion information of the display apparatus one by one within a first preset time period, wherein m is an integer greater than or equal to 2; determining one by one, according to respective pieces of motion information in the m pieces of motion information and the motion threshold of the display apparatus, whether respective motion states in m motion states of the display apparatus affect the effect of the display apparatus using the frame rate up-conversion image processing method based on motion compensation to process the video that is to be displayed by the display apparatus; if it is determined that the m motion states of the display apparatus all affect the effect of the display apparatus using the frame rate up-conversion image processing method based on motion compensation to process the video that is to be displayed by the display apparatus, determining that the motion state of the display apparatus affects the effect of the display apparatus using the frame rate up-conversion image processing method based on motion compensation to process the video that is to be displayed by the display apparatus; and if it is determined that the m motion states of the display apparatus do not all affect the effect of the display apparatus using the frame rate up-conversion image processing method based on motion compensation to process the video that is to be displayed by the display apparatus, determining that the motion state of the display apparatus does not affect the effect of the display apparatus using the frame rate up-conversion image processing method based on motion compensation to process the video that is to be displayed by the display apparatus.

In some embodiments, when the computer program instructions are executed by the processor, the computer program instructions cause the processor further to perform: receiving the video that is to be displayed by the display apparatus; before determining, according to the motion information and the motion threshold of the display apparatus, whether the motion state of the display apparatus affects the effect of the display apparatus using the frame rate up-conversion image processing method based on motion compensation to process the video that is to be displayed by the display apparatus, determining whether data of consecutive k frames in the data of the multiple frames are the same, wherein k is an integer greater than or equal to 2; in a case where the data of the consecutive k frames are not the same, determining, according to the motion information and the motion threshold of the display apparatus, whether the motion state of the display apparatus affects the effect of the display apparatus using the frame rate up-conversion image processing method based on motion compensation to process the video that is to be displayed by the display apparatus; and outputting the first control signal that stops using the frame rate up-conversion image processing method based on motion compensation to process the video that is to be displayed by the display apparatus in a case where the data of the consecutive k frames are the same.

In some embodiments, when the computer program instructions are executed by the processor, the computer program instructions cause the processor further to perform: in the case where the data of the consecutive k frames are not the same, determining, according to the motion information of the display apparatus and a static threshold of the display apparatus, whether the display apparatus is still or approximately still before determining, according to the motion information and the motion threshold of the display apparatus, whether the motion state of the display apparatus affects the effect of the display apparatus using the frame rate up-conversion image processing method based on motion compensation to process the video that is to be displayed by the display apparatus; in a case where the display apparatus is in a motion state, determining, according to the motion information and the motion threshold of the display apparatus, whether the motion state of the display apparatus affects the effect of the display apparatus using the frame rate up-conversion image processing method based on motion compensation to process the video that is to be displayed by the display apparatus; and outputting the first control signal that stops using the frame rate up-conversion image processing method based on motion compensation to process the video that is to be displayed by the display apparatus in a case where the display apparatus is still or relatively still.

In some embodiments, the motion information of the display apparatus includes an X-axis angular velocity Gyro_X, a Y-axis angular velocity Gyro_Y and a Z-axis angular velocity Gyro_Z of the display apparatus in a three-dimensional coordinate system; the static threshold includes an angular velocity threshold GYRO_Threshold. When the computer program instructions are executed by the processor, the computer program instructions cause the processor further to perform: determining whether the motion information and the static threshold of the display apparatus meet:

Sqrt(Gyro_X2+Gyro_Y2+Gyro_Z2)≤GYRO_Threshold; if yes, determining that the display apparatus is still or approximately still; and if no, determining that the display apparatus is in a motion state.

In some embodiments, when the computer program instructions are executed by the processor, the computer program instructions cause the processor further to perform: receiving n pieces of motion information of the display apparatus one by one within a second preset time period, wherein n is an integer greater than or equal to 2; determining one by one, according to respective pieces of motion information in the n pieces of motion information and the static threshold of the display apparatus, whether respective states in n states of the display apparatus are static or approximately static; if it is determined that the n states of the display apparatus are all static states or approximately static states, determining that the display apparatus is still or approximately still; and if it is determined that the n states of the display apparatus are not all static states or approximately static states, determining that the display apparatus is in the motion state.

In yet another aspect, a display control apparatus is provided, and the display control apparatus includes a video processor and the video processing control apparatus as above. The video processor is configured to use the frame rate up-conversion image processing method based on motion compensation to process a video that is to be displayed by a display apparatus. The processor included in the video processing control apparatus is coupled to the video processor, and is configured to output a control signal to the video processor.

In yet another aspect, a display apparatus is provided. The display apparatus includes a motion sensing unit and the display control apparatus as described above, and the display control apparatus is coupled to the motion sensing unit.

In yet another aspect, a computer-readable storage medium is provided. The computer-readable storage medium has stored therein computer program instructions that, when executed by a processor, cause the processor to perform one or more steps of the video processing method as described in any of the above embodiments.

In yet another aspect, a computer program product stored in a non-transitory computer-readable storage medium is provided. The computer program product includes computer program instructions that, when run on a computer, cause the computer to perform one or more steps of the video processing method as described in any of the above embodiments.

In yet another aspect, a computer program is provided. When run on a computer, the computer program causes the computer to perform one or more steps of the video processing method as described in any of the above embodiments.

