The present application claims the priority of Chinese Patent Application No. 2017103854093, filed on May 26, 2017, with the title of “Method of building a sorting model, and application method and apparatus based on the model”, the disclosure of which is incorporated herein by reference.

FIELD OF THE DISCLOSURE

The present disclosure relates to the technical field of computer application, and particularly to a method of building a sorting model, and an application method and apparatus based on the model.

BACKGROUND OF THE DISCLOSURE

As the Internet technologies develop rapidly, Chinese documents in the network increase abruptly, and various documents-sorting problems arise, for example, sorting search results in a search engine is a common type of document sorting. A query including a content word pair and a relationship word of the content word pair is searched more and more, for example, “Dehua Liu's wife Liqian Zhu”, “Baidu's CEO Yanhong Li” or the like. As far as a search engine is concerned, whether the sorting of search results reflects the user's search demands affects a computing load, search result quality, the user's information-obtaining efficiency, the user's experience and the like. For example, if the sorting of the search results fails to well reflect the user's search demands, for example, if the search result that the user wants to view is ranked at a position behind, the user needs to expend more time in performing operations such as pulling down the page or turning pages, and therefore needs to request more computing resources, which affects the user's information-obtaining efficiency.

SUMMARY OF THE DISCLOSURE

The present disclosure provides a method of building a sorting model, a method of sorting search results, a method of determining a content word pair relationship describing sentence, and their corresponding apparatuses and computer storage medium, so that the search results meet the user's search demands more.

Specific technical solutions are as follows:

The present disclosure provides a method of building a sorting model, the method comprising:

obtaining, from a search log, a query including a relationship triple and a clicked title of a search result corresponding to the query, wherein the relationship triple includes a content word pair and a relationship word of the content word pair;

obtaining training data using the obtained query, the clicked title corresponding to the query, and times of click of the clicked title;

using the training data to train a neural network-based sorting model, the sorting model being used to sort sentences according to the sentences' description of the relationship of the content word pair.

The present disclosure further provides a method of sorting search results, the method comprising:

obtaining a query including a relationship triple, wherein the relationship triple includes a content word pair and a relationship word of the content word pair;

obtaining search results corresponding to the query;

sorting the search results according to a sorting result of the sorting model for titles of the search results;

wherein the sorting model is pre-built using the aforesaid method of building the sorting model.

The present disclosure further provides a method of determining a content word pair relationship describing sentence, the method comprising:

obtaining a query including a relationship triple, wherein the relationship triple includes a content word pair and a relationship word of the content word pair;

obtaining titles of search results corresponding to the query;

using the sorting model to sort the titles, and selecting a title from the titles according to the sorting results as a sentence for describing the relationship of the content word pair;

wherein the sorting model is pre-built using the aforesaid method of building the sorting model.

The present disclosure further provides a method of determining a content word pair relationship describing sentence, the method comprising:

determining a relevant content word corresponding to the query including a content word, and a relationship word of the content word and the relevant content word;

querying the relationship database to determine a content word pair formed by the content word and the relevant content word, and a sentence describing a relationship corresponding to the relationship word;

displaying the relevant content word, content word and relationship describing sentence;

wherein the sorting model is pre-built using the aforesaid method of building the sorting model.

The present disclosure provides an apparatus for building a sorting model, the apparatus comprising:

a data collecting unit configured to obtain, from a search log, a query including a relationship triple and a clicked title of a search result corresponding to the query, wherein the relationship triple includes a content word pair and a relationship word of the content word pair;

a training data determining unit configured to obtain training data using the obtained query, the clicked title corresponding to the query, and times of click of the clicked title;

a model training unit configured to use the training data to train a neural network-based sorting model, the sorting model being used to sort sentences according to the sentences' description of the relationship of the content word pair.

The present disclosure further provides an apparatus for sorting search results, the apparatus comprising:

a query obtaining unit configured to obtain a query including a relationship triple, wherein the relationship triple includes a content word pair and a relationship word of the content word pair;

a search result obtaining unit configured to obtain search results corresponding to the query;

a search result sorting unit configured to sort the search results according to a sorting result of the sorting model for titles of the search results;

wherein the sorting model is pre-built using the aforesaid apparatus for building the sorting model.

The present disclosure further provides an apparatus for determining a content word pair relationship describing sentence, the apparatus comprising:

a query obtaining unit configured to obtain a query including a relationship triple, wherein the relationship triple includes a content word pair and a relationship word of the content word pair;

a title obtaining unit configured to obtain titles of search results corresponding to the query;

a sentence determining unit configured to use the sorting model to sort the titles, and select a title from the titles according to the sorting results as a sentence for describing a relationship of the content word pair;

wherein the sorting model is pre-built using the aforesaid apparatus for building the sorting model.

The present disclosure further provides an apparatus for determining a content word pair relationship describing sentence, the apparatus comprising:

a determining unit configured to determine a relevant content word corresponding to a query including a content word, and a relationship word of the content word and the relevant content word;

a querying unit configured to query a relationship database to determine a content word pair formed by the content word and the relevant content word, and a sentence describing a relationship corresponding to the relationship word;

a displaying unit configured to display the relevant content word, content word and relationship describing sentence;

wherein the sorting model is pre-built using the aforesaid apparatus for building the sorting model.

The present disclosure further provides an apparatus, comprising

a memory comprising one or more programs;

one or more processors coupled to the memory and configured to execute said one or more programs to implement operations executed in the above methods.

The present disclosure further provides a computer storage medium, the computer storage medium being encoded with a computer program, one or more computers being enabled to implement operations executed in the above methods, when the program is executed by said one or more computers.

As can be seen from the above technical solutions, according to the present disclosure, the training data is obtained based on the query including the relationship triple (the content word pair and the relationship word of the content word pair) in the search log and times of click of titles of clicked search results corresponding to the query. The sorting model is built based on the training data, and the sorting model can be used to sort sentences according to the sentences' description of the relationship of the content word pair. The sorting of search results of the query including the relationship triple can be achieved through the sorting model, and the sorting result reflects situations of description of the content word pair relationship by the titles of search results and meets the user's search demands more.

In addition, the sorting model may be used to determine the sentence describing the relationship of the content word pair, and store it in the relationship database so that when search engine, upon displaying the relevant content word with respect to the query including the content word, can further display the sentence describing the relationship between the relevant content word and the searched content word, thereby enabling the user to understand the relationship of the content word pair more visually and clearly.

