TECHNICAL FIELD

The present invention relates to an information providing system and an information providing method for narrowing down a plurality of contents to output to a user terminal based on video information acquired from the user terminal.

BACKGROUND ART

In recent years, with the development of technologies such as image recognition technology, virtual reality (VR), augmented reality (AR), mixed reality (MR) and so forth, a method has been disclosed, whereby various pieces of information are presented for reference, in an overlapping manner, via a display unit that is mounted on the user's head, referred to as a “head-mounted video display device (HMD (Head-Mounted Display))”. For example, the wearable terminal display system of Patent Literature 1 has been proposed as a method for displaying a predicted harvest time of the crop that can be seen through the display panel of the wearable terminal, on the display panel, as augmented reality.

The wearable terminal display system of Patent Literature 1 takes an image of the crop that enters the wearable terminal's field of view with a camera, analyzes the image and identifies the type of the crop, selects a criterion that is suitable for the type of the crop, analyzes the image and determines the color and size based on the criterion, predicts the harvest time of the crop, and displays the predicted harvest time on the wearable terminal's display panel as augmented reality.

Furthermore, for example, the work support system of Patent Literature 2 has been proposed as a method for identifying the object to work upon, based on rules such as a work manual and displaying work-support information, as augmented reality, on the display panel of the worker's wearable terminal.

The work support system of Patent Literature 2 generates rules that describe the conditions for identifying the work object or the situation of work based on the elements of a manual that describe the procedures, contents, points of attention or other matters that are related to the work, learns rules that are optimized so that a model case gains the highest evaluation, recognizes the work object and the situation of work based on sensor information that is acquired by using a sensor, and outputs work-support information based on the rules generated and a recognition means' recognition results.

CITATION LIST

Patent Literature

Patent Literature 1: Japanese Patent No. 6267841

Patent Literature 2: Japanese Patent No. 6321879

SUMMARY OF INVENTION

Problem to be Solved by the Invention

Now, when, for example, an anomaly occurs with a device that is installed at the user's site or the like during work such as maintenance or repair of devices in the field (work site), it is then necessary to stop the device after the anomaly occurs, until measures are in place. This raises the concern that the operations and services at the user's site or the like are affected.

For example, devices that are installed on a production line in a factory may be installed on the line at varying times, and configured by combining a plurality of devices and modules. Consequently, identifying the location of an anomaly requires checking the operating status, the configurations of parts and so forth, of peripheral devices.

Also, for example, escalators and elevators installed at train stations and commercial facilities, or devices in outdoor parking lots have complex device structures, and, in addition, there are cases where parts and so forth are replaced after these devices are installed, and where these replacement parts have different shapes, part numbers and so forth. In some cases, an anomaly is found only after a device is disassembled, and, in certain cases, does not even match the contents described in the maintenance manual. Consequently, in addition to the information in the manual of the device, it is necessary to have an understanding of related parts, the procedures for replacement with alternative parts, and so forth.

However, in actual fields, the presence of such experienced expert engineers is decreasing year by year, and, in the future, less experienced and relatively young engineers will have to deal with these matters, so as to develop human resources. Alternatively, it is anticipated that foreign engineers or the like who have come to Japan from overseas and have completed training in device maintenance and repair will deal with these matters.

In this regard, according to the technology disclosed in Patent Literature 1, prediction results are displayed based on results of judging the appearance and the like of the crop. Consequently, it is difficult to narrow down the information to provide, in a sequential manner, based on various field environments, the conditions in which the device is installed, the configuration of the device, and so forth.

Furthermore, the technique disclosed in Patent Literature 2 simply supports work by generating a learning model based on rules set forth in a manual. Consequently, when the actual field or the configuration of the device changes and no longer matches the contents or the procedures described in the manual used for learning, it is difficult to make flexible reactions or judgment in the field. A learning model has to be generated every time dealing with a new situation, and this requires time and costs. For this reason, it is difficult to provide information that is suitable for the actual field and the work, or update the target information in an efficient way.

So, the present invention has been made in view of the above, and it is an object of the present invention to provide an information providing system and an information providing method to allow maintaining history information related to contents that have been output, and providing optimal contents.

Means for Solving the Problems

The information providing system according to the first invention is an information providing system for narrowing down a plurality of contents to output to a user terminal, based on target information, which includes first video information acquired from the user terminal, with reference to a database, and this information providing system has a content model database that stores past target information, which includes past first video information acquired in advance, reference IDs, which are linked with the past target information, and which correspond to the contents, and three or more levels of degrees of content association, which show the degrees of content association between the past target information and the reference IDs, a first acquiring means for acquiring the target information from the user terminal, a first evaluation means for looking up the content model database, and acquiring ID information, which includes first degrees of content association between the target information and the reference IDs, an output means for outputting the contents corresponding to the ID information, and an ID history means for storing the ID information, which is acquired in the first evaluation means, after the output from the output means.

Based on the first invention, the information providing system according to the second invention further has a first generation means for generating a reference ID list, which includes a plurality of pieces of ID information, based on an evaluation result in the first evaluation means, and a second acquiring means for acquiring a first reference ID, which is selected from the reference ID list, via the user terminal, and the output means outputs content, which corresponds to the first reference ID information acquired in the second acquiring means, and the ID history means stores the first reference ID, which is acquired in the second acquiring means, after the output from the output means.

Based on the second invention, the information providing system according to the third invention further has a second generation means for generating a reference summary list, which includes a plurality of summaries corresponding to the reference ID list generated, and a third acquiring means for acquiring a second reference ID, which is selected from the reference summary list via the user terminal, and the output means outputs content that corresponds to the second reference ID information acquired in the third acquiring means, and the ID history means stores the second reference ID, which is acquired in the third acquiring means, after the output from the output means.

Based any on one of the first invention to the third invention, the information providing system according to the fourth invention further has a judging means for judging the ID information acquired in the first evaluation means, and a content output means for outputting the content corresponding to the ID information, based on a result of judgement in the judging means, and the ID history means stores the ID information according to the result of judgment in the judging means, after the output from the output means.

Based any on one of the first invention to the fourth invention, the information providing system according to the fifth invention further has an updating means for identifying a relationship between the evaluation result and the ID information, the first reference ID or the second reference ID stored in the ID history means, and, when a new relationship is acquired, having the relationship reflected on the degree of content association.

Based any on one of the first invention, in the information providing system according to the sixth invention, the target information includes scene IDs linked with the past video information.

Based any on one of the first invention to the sixth invention, in the information providing system according to the seventh invention, the database has a scene model database that stores past second video information, which is acquired in advance, scene information, which includes the scene IDs linked with the past second video information, and three or more levels of degrees of scene association, which show the degrees of scene association between the past second video information and the scene information, and the information providing system has a fourth acquiring means for acquiring target information, which includes second video information, from the user terminal, a second evaluation means for looking up the scene model database, and acquiring a scene ID list, which includes first degrees of scene association between the second video information and the scene information, and a third generation means for generating a scene name list, which includes a plurality of scene names that correspond to the scene ID list.

Based on the seventh invention, the information providing system according to the eighth invention further has a scene ID generation unit, and the scene ID generation unit has a scene name acquiring means for acquiring scene names corresponding to the past second video information and the past first video information, which are acquired in advance, a scene ID generation means for generating scene IDs with smaller amounts of information than the scene names, for each of the scene names acquired, and a first learning means for generating the scene model database by way of machine learning using the scene information and the past second video information.

Based on the seventh invention or the eighth invention, the information providing system according to the ninth invention further has a content ID generation unit, and the content ID generation unit has a content acquiring means for acquiring the past second video information, which is acquired in advance, and contents corresponding to the past second video information, a content ID generation means for generating content IDs with smaller amounts of information than the contents, for each of the contents acquired, and a second learning means for generating the content model database by way of machine learning using reference information and the past target information.

Based any on the ninth invention, in the information providing system according to the tenth invention, the content IDs are associated with a plurality of pieces of meta information.

Based any on one of the seventh invention to the tenth invention, in the information providing system according to the eleventh invention, the user terminal further has a receiving means for receiving the scene ID list acquired in the second evaluation means, a judging means for judging whether or not a scene ID included in the received scene ID list is present in a cache area of the user terminal, based on a result of receiving the scene ID list, and an inquiring means for making an inquiry to a content information database holding contents, when, according to a result of the judgement, the scene ID is not present in the cache area of the user terminal.

Based on the second invention or the third invention, in the information providing system according to the twelfth invention, the user terminal further has a receiving means for receiving the reference ID list acquired in the first acquiring means, a judging means for judging whether or not a reference ID included in the received reference ID list is present in a cache area of the user terminal, based on a result of receiving the reference ID list, and an inquiring means for making an inquiry to a content information database holding contents, when, according to a result of the judgement, the reference ID is not present in the cache area of the user terminal.

Based any on one of the seventh invention to the twelfth invention, in the information providing system according to the thirteenth invention, the user terminal has a display unit that is mounted on a head or glasses and that displays information generated based on the first video information acquired from the user terminal, in a transparent state.

Based any on one of the seventh invention to the thirteenth invention, in the information providing system according to the fourteenth invention, the contents include information of at least part or all of text, illustration, video, and audio.

The information providing method according to the fifteenth invention is an information providing method for narrowing down a plurality of contents to output to a user terminal with reference to a database, based on first video information acquired from the user terminal, and this information providing method includes a storage step of storing, in a content model database, past target information, which includes past first video information acquired in advance, reference IDs, which are linked with the past target information, and which correspond to the contents, and three or more levels of degrees of content association, which show the degrees of content association between the past target information and the reference IDs, a first acquiring step of acquiring the target information from the user terminal, a first evaluation step of looking up the content model database, and acquiring ID information, which includes first degrees of content association between the target information and the reference IDs, an output step of outputting the contents corresponding to the ID information, and an ID history step of storing the ID information acquired in the first evaluation step, after the output from the output step.

Advantageous Effects of Invention

According to the first invention to the seventh invention, the output means outputs contents that correspond to ID information, and the ID history means stores the ID information after an output is produced from the output means. Consequently, the ID information acquired in the first evaluation means can be stored. By this means, it is possible to provide optimal contents.

In particular, according to the second invention, the output means outputs content that corresponds to the first reference ID information acquired in the second acquiring means, and the ID history means stores the first reference ID after the output from the output means. Consequently, after the output, the first reference ID acquired in the second acquiring means can be stored. By this means, it is possible to store the history of contents that have been output, and provide optimal contents.

In particular, according to the third invention, the output means outputs content that corresponds to the second reference ID information acquired in the third acquiring means, and the ID history means stores the second reference ID. Consequently, the second reference ID, acquired in the third acquiring means, can be stored. This makes it possible to acquire and provide appropriate information in an efficient manner.

In particular, according to the fourth invention, the judging means judges the ID information acquired in the first evaluation means. Consequently, it is possible to output contents that correspond to the ID information based on the result of judgement. This makes it possible to acquire and provide appropriate information depending on the result of judgment in an efficient manner.

In particular, according to the fifth invention, the updating means identifies the relationship between the evaluation result and the ID information, the first reference ID or the second reference ID stored in the ID history means. Consequently, when a new relationship is acquired, this relationship can be reflected upon the degree of content association or the degree of scene association. This makes it possible to acquire and provide appropriate information in an efficient manner.

In particular, according to the sixth invention, the target information includes scene IDs linked with the past video information. Consequently, it is possible to evaluate and record video information that corresponds to scenes. This makes it possible to acquire and provide appropriate information in an efficient manner.

In particular, according to the seventh invention, a scene model database is provided, and the fourth acquiring means acquires second video information from the user terminal. Consequently, it is possible to look up the scene model database, acquire a scene ID list that includes first degrees of scene association between the second video information and scene information, and acquire scene IDs from the scene name list. By this means, it is possible to generate a scene name list to include a plurality of scene names that correspond to the scene ID list, so that, after this, appropriate content information can be acquired and provided in an efficient manner.

According to the eighth invention, a scene ID generation unit is provided. The scene ID generation unit has a scene name acquiring means, a scene ID generation means, and a first learning means. Consequently, scene IDs with smaller amounts of information than scene names are generated per scene name that is acquired. This makes it possible to save the amount of communication to be exchanged, so that quick response is made possible. Furthermore, when updating one database, it is only necessary to correct the target IDs alone, and there is no need to update the other database.

Furthermore, according to the ninth invention, a content ID generation unit is provided. The content ID generation unit has a content acquiring means, a content ID generation means, and a second learning means. Consequently, first content IDs with smaller amounts of information than content information are generated from the acquired content information. This makes it possible to save the amount of communication to be exchanged, so that quick response is made possible. Furthermore, when updating one database, it is only necessary to correct the target IDs alone, and there is no need to update the other database.

Furthermore, according to the tenth invention, the content information includes meta information. Consequently, more detailed attributes can be added to the content information. By this means, accurate contents can be assigned or provided, and appropriate information can be acquired and provided in an efficient manner.

Also, according to the eleventh invention, the user terminal has a receiving means, a judging means, and an inquiring means. By this means, it is possible to judge whether or not the scene IDs included in the received scene ID list are present in the cache area. Therefore, only when there are no corresponding scene IDs in the user terminal, corresponding scene IDs are acquired from another scene model database. By this means, states can be narrowed down according to the conditions of the field, and, furthermore, appropriate information can be acquired and provided in an efficient manner.

Also, according to the twelfth invention, the user terminal has a receiving means, a judging means, and an inquiring means. Consequently, it is possible to judge whether or not the content IDs included in the received content ID list are present in the cache area. Therefore, only when there are no corresponding scene IDs in the user terminal, these corresponding scene IDs are acquired from another scene model database. By this means, states can be narrowed down according to the conditions of the field, and appropriate information can be acquired and provided in an efficient manner.

According to the thirteenth invention, the user terminal has a display unit that is mounted on the head or glasses, and that displays information generated based on the first video information acquired from the user terminal, in a transparent state. Consequently, hand-free operations can be performed when performing operations in the field. By this means, both hands can be used freely, and appropriate information can be acquired and provided in an efficient manner.

Furthermore, according to the fourteenth invention, the contents include information of at least part or all of text, illustrations, video, and audio. Consequently, a variety of contents can be provided. This makes it possible to acquire and provide appropriate information in an efficient manner.

According to the fifteenth invention, the output step outputs contents that correspond to ID information, and the ID history step stores ID information after an output is produced in the output step. Consequently, it is possible to store the ID information acquired in the first evaluation step. By this means, optimal contents can be provided.

