BACKGROUND

A gesture is an important human-computer interaction feature in image and video information. The key task of a gesture recognition algorithm is to give an image containing the hand and determine the category of the gesture in the image.

SUMMARY

Embodiments of the present disclosure relate to image processing technologies, and in particular, to methods and apparatuses for recognizing a dynamic gesture, and control methods and apparatuses using gesture interaction.

The embodiments of the present disclosure provide technical solutions of dynamic gesture recognition and technical solutions of gesture interaction control.

According to an aspect of the embodiments of the present disclosure, a method for recognizing a dynamic gesture is provided, including: positioning a dynamic gesture in a video stream to be detected to obtain a dynamic gesture box; capturing an image block corresponding to the dynamic gesture box from each of multiple image frames of the video stream; generating a detection sequence based on the captured image blocks; and performing dynamic gesture recognition according to the detection sequence.

According to another aspect of the embodiments of the present disclosure, a dynamic gesture recognition model establishment method is provided, including: collecting one or more sample video streams involving different categories of dynamic gestures; annotating dynamic gesture boxes of the different categories of dynamic gestures; capturing image blocks corresponding to annotation information of the dynamic gesture boxes from multiple image frames of the sample video stream to form an image sequence; and training a first dynamic gesture recognition model by using categories of the dynamic gestures as supervision data and using the image sequence as training data.

According to still another aspect of the embodiments of the present disclosure, an apparatus for recognizing a dynamic gesture is provided, including: a gesture positioning unit, configured to position a dynamic gesture in a video stream to be detected to obtain a dynamic gesture box; a processing unit, configured to capture an image block corresponding to the dynamic gesture box from multiple image frames of the video stream; a detection sequence generation unit, configured to generate a detection sequence based on the captured image block; and a gesture recognition unit, configured to perform dynamic gesture recognition according to the detection sequence.

According to still another aspect of the embodiments of the present disclosure, an electronic device is provided, including: a memory storing processor-executable instructions; and a processor, configured to execute the stored processor-executable instructions to perform operations of: positioning a dynamic gesture in a video stream to be detected to obtain a dynamic gesture box; capturing an image block corresponding to the dynamic gesture box from each of multiple image frames of the video stream; generating a detection sequence based on the captured image blocks; and performing dynamic gesture recognition according to the detection sequence.

According to still another aspect of the embodiments of the present disclosure, a dynamic gesture recognition model establishment apparatus is provided, including: a first dynamic gesture recognition model establishment unit, where the first dynamic gesture recognition model establishment unit includes: a sample collection subunit, configured to collect one or more sample video streams involving different categories of dynamic gestures; a gesture box annotating subunit, configured to annotate dynamic gesture boxes of the different categories of dynamic gestures; an image sequence forming subunit, configured to capture image blocks corresponding to annotation information of the dynamic gesture boxes from multiple image frames of the sample video stream to form an image sequence; and a training subunit, configured to train a first dynamic gesture recognition model by using the categories of the dynamic gestures as supervision data and using the image sequence as training data.

According to still another aspect of the embodiments of the present disclosure, a control method using gesture interaction is provided, including: obtaining a video stream; determining a dynamic gesture recognition result of the video stream by the method for recognizing a dynamic gesture according to any of the above; and controlling a device to execute an operation corresponding to the dynamic gesture recognition result.

According to still another aspect of the embodiments of the present disclosure, a control apparatus using gesture interaction is provided, including: a video stream obtaining module, configured to obtain a video stream; a result obtaining module, configured to determine a dynamic gesture recognition result of the video stream by the apparatus for recognizing a dynamic gesture according to any of the above; and an operation execution module, configured to control a device to execute an operation corresponding to the dynamic gesture recognition result.

According to still another aspect of the embodiments of the present disclosure, an electronic device is provided, including a processor, where the processor includes the apparatus for recognizing a dynamic gesture according to any of the above, or the dynamic gesture recognition model establishment apparatus according to any of the above, or the control apparatus using gesture interaction according to any of the above.

According to still another aspect of the embodiments of the present disclosure, an electronic device is provided, including: a memory, configured to store executable instructions; and a processor, configured to communicate with the memory to execute the executable instructions to complete operations of the method for recognizing a dynamic gesture according to any of the above, or the dynamic gesture recognition model establishment method according to any of the above, or the control method using gesture interaction according to any of the above.

According to still another aspect of the embodiments of the present disclosure, a non-transitory computer-readable storage medium is provided, having stored thereon computer-readable instructions that, when executed by a processor, cause the processor to perform operations of a method for recognizing a dynamic gesture, the method including: positioning a dynamic gesture in a video stream to be detected to obtain a dynamic gesture box; capturing an image block corresponding to the dynamic gesture box from each of multiple image frames of the video stream; generating a detection sequence based on the captured image blocks; and performing dynamic gesture recognition according to the detection sequence.

According to yet another aspect of the embodiments of the present disclosure, a non-transitory computer program product is provided, including a computer-readable code, where when the computer-readable code is run on a device, a processor in the device executes instructions for implementing the method for recognizing a dynamic gesture according to any of the above, or the dynamic gesture recognition model establishment method according to any of the above, or the control method using gesture interaction according to any of the above.

The following further describes in detail the technical solutions of the present disclosure with reference to the accompanying drawings and embodiments.

