CROSS-REFERENCE TO RELATED APPLICATION

This Application is related to the Application having U.S. application Ser. No. 15/435,816, filed on even date as the present Application.

BACKGROUND

The present invention relates to indexing and mining content of multiple data sources, and more specifically, to indexing using natural language processing.

Managing content and mining content effectively are becoming increasing difficult as the amount of documents and information available increases across different formats.

One example is different content websites that are becoming common methods for delivering and managing content. As examples of content websites, wikis provide collaborative content with no defined owner and blogs provide authored posts.

The ability to organize the data of such content websites such as wikis is a growing concern. It is a common issue where one user may create and manage a page with content but the wider group of users may not be able to find the content. Another common issue is that organizations may have multiple unique wikis that can cause employees or users of the data issues when trying to find the right wiki to search through. Many times, failing to find the right article ends up in duplication of the article with the consequent loss of productivity and the appearance of out of date pages. As the number of unique wikis grows, the ability to organize, track and maintain the wikis are reduced, essentially making them a less powerful tool for an organization.

A wiki is a website that provides collaborative modification of its content and structure directly from the web browser. In a typical wiki, text is written using a simplified markup language (known as “wiki markup”), and often edited with the help of a rich-text editor. A wiki is run using wiki software, otherwise known as a wiki engine. A wiki engine may permit control over different functions (levels of access); for example, editing rights may permit changing, adding or removing material. Others may permit access without enforcing access control. Other rules may also be imposed to organize content. A wiki engine is a type of content management system, but it differs from most other such systems, including blog software, in that the content is created without any defined owner or leader, and wikis have little implicit structure, allowing structure to emerge according to the needs of the users.

A blog (a truncation of the expression weblog) is a discussion or informational website published on the World Wide Web consisting of discrete, often informal diary-style text entries or posts. Posts are typically displayed in reverse chronological order, so that the most recent post appears first, at the top of the web page. Blogs may be the work of a single individual or may be written by large numbers of authors and sometimes professionally edited.

In addition to the problem of managing and mining content of websites such as wikis and blogs, managing and mining content of a diverse group of data sources also provides challenges.

SUMMARY

According to an embodiment of the present invention there is provided a computer-implemented method for indexing and mining content of multiple data sources, comprising: providing a database of learned content of multiple data sources learned using text analysis, the learned content identifying one or more concepts to which a data source relates, wherein the concepts are cognitively associated with the data source and include concepts not explicitly referenced in the data source; providing an index of the learned content including associations between concepts with mappings between concepts and the multiple data sources; receiving input of a query and using text analysis to analyze the query to determine one or more query concepts to which it relates; and mining the indexed concepts in response to the query concepts to return a list of referenced data sources.

According to another aspect of the present invention there is provided a system for indexing and mining content of multiple data sources, comprising: a processor and a memory configured to provide computer program instructions to the processor to execute the function of the components; a database of learned content of multiple data sources learned using text analysis, the learned content identifying one or more concepts to which a data source relates, wherein the concepts are cognitively associated with the data source and include concepts not explicitly referenced in the data source; an indexing component for providing an index of the learned content including associations between concepts with mappings between concepts and the multiple data sources; and a mining component for receiving input of a query and using text analysis to analyze the query to determine one or more query concepts to which it relates and for mining the indexed concepts in response to the query concepts to return a list of referenced data sources.

According to a further aspect of the present invention there is provided a computer program product for indexing and mining content of multiple data sources, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to: provide a database of learned content of multiple data sources learned using text analysis, the learned content identifying one or more concepts to which a data source relates, wherein the concepts are cognitively associated with the data source and include concepts not explicitly referenced in the data source; provide an index of the learned content including associations between concepts with mappings between concepts and the multiple data sources; receive input of a query and using text analysis to analyze the query to determine one or more query concepts to which it relates; and mine the indexed concepts in response to the query concepts to return a list of referenced data sources.

