CROSS-REFERENCE TO RELATED APPLICATION

This is a U.S. national stage application, filed under 37 U.S.C. § 371, of International Patent Application No. PCT/CN2020/100034, filed on Jul. 3, 2020, which is based on and claims priority to Chinese Patent Application No. 202010128305.6 filed with the China National Intellectual Property Administration on Feb. 28, 2020, the disclosures of which are incorporated herein by reference in their entirety.

TECHNICAL FIELD

The present disclosure relates to the field of image processing, for example, to Internet technologies. Specifically, an emoticon package generation method and apparatus, a device and a medium are provided in the embodiments of the present disclosure.

BACKGROUND

In recent years, with the popularization of instant messaging socialization, original content of a user on the Internet has been continuously enriched, and the trend of rich media in a text input scenario has become more and more apparent. As a special image language, emoticon packages are widely used in the input scenario.

At present, the product that provides emoticon resources for Internet users is mainly emoticon search, that is, a user can manually input text, and the system can automatically generate a relevant emoticon package that matches the text.

However, the emoticon search, as a content-based product, provides results strongly depending on emoticon package resources which are currently produced manually with a long production period and high cost.

SUMMARY

The present disclosure provides an emoticon package generation method and apparatus, a device and a medium so as to automatically and accurately generate an emoticon package.

An emoticon package generation method is provided in the embodiments of the present disclosure. The method includes steps described below.

At least one of associated text of an emoticon picture or a similar emoticon package of an emoticon picture is determined, where the associated text of the emoticon picture includes at least one of main part information, scenario information, emotion information, action information or connotation information. Target matching text is determined from the at least one of the associated text of the emoticon picture or associated text of the similar emoticon package. The target matching text is superimposed on the emoticon picture to generate a new emoticon package.

According to the embodiments of the present disclosure, at least one of associated text of an emoticon picture or a similar emoticon package of an emoticon picture are determined and at least one of the associated text of the emoticon picture or associated text of the similar emoticon package is used as candidate matching text so that the candidate matching text can be automatically determined.

The target matching text is determined from the candidate matching text. The associated text of the emoticon picture includes at least one of main part information, scenario information, emotion information, action information or connotation information. Moreover, the similar emoticon package and the emoticon picture have similar characteristics. Therefore, the content information of the emoticon picture is described in the determined candidate matching text. Compared with target matching text determined from preset text, the target matching text determined in the embodiments of the present disclosure can more accurately describe the emoticon picture, that is, the accuracy of the target matching text is improved. The accurately determined target matching text is finally superimposed on the emoticon picture, and thus an emoticon package is automatically and accurately generated.

Other aspects can be understood after the drawings and the detailed description are read and understood.

Further, the step of determining the associated text of the emoticon picture includes a step described below.

The associated text of the emoticon picture is determined according to the associated text of the similar emoticon package. A determination dimension of the associated text of the emoticon picture is enriched on the basis of the technical feature that the associated text of the emoticon picture is determined according to the associated text of the similar emoticon package in the embodiments of the present disclosure.

Further, the step of determining the associated text of the emoticon picture according to the associated text of the similar emoticon package includes steps described below.

Target text is determined from the associated text of the similar emoticon package based on a word use frequency. The associated text of the emoticon picture is determined from the target text. The accuracy of the associated text of the emoticon picture is improved on the basis of the technical feature that target text is determined from the associated text of the similar emoticon package based on a word use frequency and the associated text of the emoticon picture is determined from the target text in the embodiments of the present disclosure.

Further, the step of determining the associated text of the emoticon picture from the target text includes steps described below.

A recognition result of the emoticon picture is matched with the target text. Repeated text is determined according to a matching result. The repeated text is filtered out from the recognition result of the emoticon picture and the target text to obtain the associated text of the emoticon picture, where the recognition result of the emoticon picture includes the emotion information and the main part information.

The text content of the associated text is enriched on the basis of the technical feature that the recognition result of the emoticon picture and the target text are fused and the fused text is used as the associated text of the emoticon picture in the embodiments of the present disclosure.

Since the recognition result of the emoticon picture includes emotion information and main part information, the associated text determined based on the recognition result of the emoticon picture includes information of at least two dimensions, that is, the text dimension of the associated text is enriched. Therefore, the determined associated text of the emoticon picture is richer and more diverse based on the determination manner in the embodiments of the present disclosure.

Further, the step of determining the similar emoticon package of the emoticon picture includes steps described below.

Image information of the emoticon picture is matched with image information of an existing emoticon package, and information about the associated text of the emoticon picture is matched with information about associated text of the existing emoticon package. In response to an image matching degree or a text matching degree satisfying a set condition, the existing emoticon package is used as the similar emoticon package.

On the basis of the technical feature that the similar emoticon package is determined from two information dimensions of image information and associated text information in the embodiments of the present disclosure, the recall rate of the similar emoticon package is improved, and the recall rate of the candidate matching text of the emoticon picture is further improved based on the associated text of the similar emoticon package.

Further, the image information includes emoticon package category information and object category information.

The accuracy of the similar emoticon package is improved on the basis of the technical feature that the similar emoticon package is determined from the existing emoticon package based on emoticon package category information and object category information in the embodiments of the present disclosure.

Further, the step of determining the target matching text from the at least one of the associated text of the emoticon picture or the associated text of the similar emoticon package includes a step described below.

The target matching text is determined from candidate matching text based on at least one of a word use frequency, a word length or word semantics, where the candidate matching text includes the at least one of the associated text of the emoticon picture or the associated text of the similar emoticon package.

The accuracy of determining the target matching text is further improved on the basis of the technical feature that the target matching text is determined from candidate matching text based on at least one of a word use frequency, a word length or word semantics in the embodiments of the present disclosure.

Further, the step of determining the target matching text from the candidate matching text based on the word length includes a step described below.

In response to a word length of the candidate matching text being within a set length range, the candidate matching text is determined as the target matching text.

The target matching text is accurately determined on the basis of the technical feature that whether a word length of the candidate matching text is within a set length range is determined so that the target matching text is determined from the candidate matching text in the embodiments of the present disclosure.

Further, the step of determining the target matching text from the candidate matching text based on the word semantics includes steps described below.

It is determined that word semantics of the candidate matching text includes word information about at least one of an emotion word, a popular word or an entity word. The target matching text is determined from the candidate matching text according to the word information.

The target matching text is accurately determined on the basis of the technical feature that the target matching text is determined from the candidate matching text according to the fact that word semantics of the candidate matching text includes the semantics information about at least one of an emotion word, a popular word or an entity word in the embodiments of the present disclosure.

Further, before determining the at least one of the associated text of the emoticon picture or the similar emoticon package of the emoticon picture, the method further includes steps described below.

A video image including a target part of a target object is extracted from a video. Recognition of at least one of a speaking or an action execution amplitude is performed on the extracted video image. The emoticon picture is determined from the video image according to a recognition result.

The emoticon picture is accurately determined on the basis of the technical feature that recognition of the at least one of the speaking or the action execution amplitude is performed on the extracted video image and the emoticon picture is determined from the video image according to a recognition result in the embodiments of the present disclosure.

Further, the step of determining a position at which the target matching text is superimposed includes steps described below.

A background area in the emoticon picture is detected. A largest inscribed graphic region in the background area is determined. The largest inscribed graphic region is used as the position at which the target matching text is superimposed.

The position at which the target matching text is superimposed is determined on the basis of the technical feature that a background area in the emoticon picture is detected and the largest inscribed graphic region in the background area is used as the position at which the target matching text is superimposed in the embodiments of the present disclosure.

An emoticon package generation apparatus is further provided in the embodiments of the present disclosure. The apparatus includes an associated text determination module, a matching text determination module and an emoticon package generation module.

The associated text determination module is configured to determine at least one of associated text of an emoticon picture or a similar emoticon package of an emoticon picture, where the associated text of the emoticon picture includes at least one of main part information, scenario information, emotion information, action information or connotation information.

The matching text determination module is configured to determine target matching text from at least one of the associated text of the emoticon picture or associated text of the similar emoticon package.

The emoticon package generation module is configured to superimpose the target matching text on the emoticon picture to generate a new emoticon package.

Further, the associated text determination module includes an associated text determination unit.

The associated text determination unit is configured to determine the associated text of the emoticon picture according to the associated text of the similar emoticon package.

Further, the associated text determination unit is configured to determine target text from the associated text of the similar emoticon package based on a word use frequency and determine the associated text of the emoticon picture from the target text.

Further, the operation of determining the associated text of the emoticon picture from the target text includes steps described below.

A recognition result of the emoticon picture is matched with the target text. Repeated text is determined according to a matching result. The repeated text is filtered out from the recognition result of the emoticon picture and the target text to obtain the associated text of the emoticon picture, where the recognition result of the emoticon picture includes emotion information and main part information.

Further, the associated text determination module includes an emoticon picture matching unit and an emoticon package selection unit.

The emoticon picture matching unit is configured to match image information of the emoticon picture with image information of an existing emoticon package and match information about the associated text of the emoticon picture with information about associated text of the existing emoticon package.

The emoticon package selection unit is configured to: in response to an image matching degree or a text matching degree satisfying a set condition, use the existing emoticon package as the similar emoticon package.

Further, the image information includes emoticon package category information and object category information.

Further, the matching text determination module includes a matching text determination unit.

The matching text determination unit is configured to determine the target matching text from candidate matching text based on at least one of a word use frequency, a word length or word semantics, where the candidate matching text includes the at least one of the associated text of the emoticon picture or the associated text of the similar emoticon package.

Further, the matching text determination unit is specifically configured to perform an operation described below.

In response to a word length of the candidate matching text being within a set length range, the candidate matching text is determined as the target matching text.

Further, the matching text determination unit is specifically configured to perform operations described below.

It is determined that word semantics of the candidate matching text includes word information about at least one of an emotion word, a popular word or an entity word. The target matching text is determined from the candidate matching text according to the word information.

Further, the apparatus further includes a video image extraction module, an image recognition module and an emoticon picture determination module.

The video image extraction module is configured to extract a video image including a target part of a target object from a video before the at least one of the associated text of the emoticon picture or the similar emoticon package of the emoticon picture is determined.

The image recognition module is configured to perform recognition of at least one of a speaking or an action execution amplitude on the extracted video image.

The emoticon picture determination module is configured to determine the emoticon picture from the video image according to a recognition result.

Further, the apparatus further includes a background detection module, a region determination module and a position determination module.

The background detection module is configured to detect a background area in the emoticon picture.

The region determination module is configured to determine a largest inscribed graphic region in the background area.

The position determination module is configured to use the largest inscribed graphic region as the position at which the target matching text is superimposed.

An electronic device is further provided in the embodiments of the present disclosure.

The device includes at least one processor and a memory.

The memory is communicatively connected to the at least one processor.

The memory stores instructions executable by the at least one processor to cause the at least one processor to perform the method of any one of embodiments of the present disclosure.

The present disclosure provides a non-transitory computer-readable storage medium storing computer instructions for causing a computer to perform the method of any one of embodiments of the present disclosure.

