BACKGROUND

Technical Field

The present disclosure relates to a shelf label detection device, a shelf label detection method, and a shelf label detection program.

Description of the Related Art

In the retail industry, business has become more efficient by, for example, systematizing the management of a stock and/or sales of products. For the stock management, for example, a system that monitors a stock of products based on video of a product display area (e.g., a display shelf) obtained by a monitoring camera may be used.

LITERATURE LIST

Patent Literature

PTL 1Japanese Patent Application Laid-Open No. 2015-103153PTL 2Japanese Patent No. 6112436

SUMMARY

However, for example, when a shelf row (i.e., an area or region to be monitored) to be included in a monitoring target is not appropriately set for video including a display shelf, it may be difficult to accurately monitor the stock quantity of products (e.g., shortage or lacking of products) in some cases.

Thus, after all, a person may be required to visually inspect a stock of individual products. With visual inspection, in some cases, there may be a discrepancy between the number of individual products (physical stock quantity) actually displayed in a display area and, for example, the number of stock quantity of individual products (theoretical stock quantity) managed by a stock management system.

When there is a discrepancy between the physical stock quantity and the theoretical stock quantity, for example, a person may be required to manually correct stock management data, such as the theoretical stock quantity in accordance with the physical stock quantity confirmed by visual inspection, and the correction takes time.

Since it is burdensome for a stock manager to make such correction every day and/or every hour, for example, a specific product may remain lacking. When the product remains lacking, a product selling opportunity is lost, and as a result, customers may have a negative image in some cases.

Thus, a stock monitoring system that automatically monitors the stock quantity of products has been desired. However, in order to implement this system, it is necessary to accurately detect the position of a shelf label included in camera video.

One non-limiting and exemplary embodiment facilitates providing a shelf label detection device, a shelf label detection method, and a shelf label detection program available to detect a shelf label position accurately from camera video of a display shelf.

Solution

In one general aspect, the techniques disclosed here related to a shelf label detection device includes: an obtainer that obtains first camera video and second camera video including an image of a shelf label arranged in a display shelf; a corrector that corrects a first shelf label position set to generate a corrected shelf label position set by using a second shelf label position set, the first shelf label position set including a shelf label position that is set by a user in advance in the first camera video, the second shelf label position set including a shelf label position for the image of the shelf label detected from the second camera video through video recognition; and an determiner that determines the shelf label position in the second camera video by using the corrected shelf label position set.

In one general aspect, the techniques disclosed here related to a shelf label detection method according to one aspect of the present disclosure includes: obtaining first camera video and second camera video including an image of a shelf label arranged in a display shelf; correcting a first shelf label position set to generate a corrected shelf label position set by using a second shelf label position set, the first shelf label position set including a shelf label position that is set by a user in advance in the first camera video, the second shelf label position set including a shelf label position for the image of the shelf label detected from the second camera video through video recognition; and determining the shelf label position in the second camera video by using the corrected shelf label position set.

In one general aspect, the techniques disclosed here related to a shelf label detection program according to one aspect of the present disclosure causes a computer to execute a process including: obtaining first camera video and second camera video including an image of a shelf label arranged in a display shelf; correcting a first shelf label position set to generate a corrected shelf label position set by using a second shelf label position set, the first shelf label position set including a shelf label position that is set by a user in advance in the first camera video, the second shelf label position set including a shelf label position for the image of the shelf label detected from the second camera video through video recognition; and determining the shelf label position in the second camera video by using the corrected shelf label position set.

Additional benefits and advantages of the disclosed embodiments will become apparent from the specification and drawings. The benefits and/or advantages may be individually obtained by the various embodiments and features of the specification and drawings, which need not all be provided in order to obtain one or more of such benefits and/or advantages.

Advantageous Effects

In one general aspect, it is possible to accurately detect the position of a shelf label included in camera video.

Further advantages and benefits in an aspect of the present disclosure will become apparent from the specification and the drawings. Although the advantages and/or benefits are provided by some embodiments and features illustrated in the specification and the drawings, not all of the advantages and the benefits need to be provided to obtain one or more such features.

