This application is a 371 of international application PCT/IB2018/053237 filed on May 10, 2018 which is incorporated herein by reference.

TECHNICAL FIELD

One embodiment of the present invention relates to an image detection module and an information management system.

Note that one embodiment of the present invention is not limited to the above technical field. The technical field of one embodiment of the invention disclosed in this specification and the like relates to an object, a method, or a manufacturing method. In particular, one embodiment of the present invention relates to a semiconductor device, a display device, a light-emitting device, a power storage device, a memory device, a driving method thereof, or a manufacturing method thereof.

In this specification and the like, a semiconductor device means an element, a circuit, a device, or the like that can function by utilizing semiconductor characteristics. As an example, a semiconductor element such as a transistor or a diode is a semiconductor device. As another example, a circuit including a semiconductor element is a semiconductor device. As another example, a device provided with a circuit including a semiconductor element is a semiconductor device.

BACKGROUND ART

With the development of information technology such as IoT (Internet of things) or AI (Artificial Intelligence), the amount of handled data has been showing an increasing tendency. In order that electronic devices utilize information technology such as IoT or AI, dispersive control of a large amount of data has been needed.

Management of quality and improvement in productivity by managing environmental information in a space have been examined. For example, a management device for managing cultivation and harvest of plants that uses a weather detection device is proposed in Patent Document 1.

REFERENCES

Patent Documents

[Patent Document 1] Japanese Published Patent Application No. 2012-175920

SUMMARY OF THE INVENTION

Problems to be Solved by the Invention

Environmental information in a space is managed with a sensor. The sensor can collect environmental information of a place where the sensor is installed, but there is a problem that an environmental situation in the space does not change uniformly due to the flow of air, an obstacle, a heat source existing inside or outside the space, or the like.

It is known that there is a close correlation between environmental information and a cultivation situation of plants in a plant factory or the like where plants are cultivated. For example, vegetables such as tomatoes and fruits such as grapes are provided with environmental information specific to target products and managed. As for tomatoes, for example, accumulated temperature is important management information for the cultivation of tomatoes. There is a problem that the maturity degrees of tomatoes are different between each other due to positions where each fruit is borne or obstacles such as leaves even in the same plant factory.

In order to ensure stability of quality, it is important to grasp environmental information over time, but there is a problem of the difficulty in grasping environmental information of a position where the sensor is not placed in its vicinity.

In view of the above problems, an object of one embodiment of the present invention is to provide an information management system with a novel structure.

Alternatively, an object of one embodiment of the present invention is to provide an information management system including a neural network. Alternatively, an object of one embodiment of the present invention is to provide an information management system that provides environmental information based on positional information. Alternatively, an object of one embodiment of the present invention is to provide an image detection module with a novel structure. Alternatively, an object of one embodiment of the present invention is to provide an image detection module including a neural network.

Note that the descriptions of these objects do not disturb the existence of other objects. One embodiment of the present invention does not need to achieve all the objects. Other objects will be apparent from the description of the specification, the drawings, the claims, and the like, and other objects can be derived from the description of the specification, the drawings, the claims, and the like.

Note that the objects of one embodiment of the present invention are not limited to the objects listed above. The objects listed above do not preclude the existence of other objects. The other objects are the objects that are not described in this section and will be described below. Objects that are not described in this section will be apparent from the description of the specification, the drawings, and the like and can be derived from the description by those skilled in the art. One embodiment of the present invention is to solve at least one object of the objects listed above and/or the other objects.

Means for Solving the Problems

One embodiment of the present invention is an image detection module including a first neural network, a first communication module, a first position sensor, a first processor, and a passive element. The first neural network includes an imaging device; the imaging device has a step of obtaining an image; the first position sensor has a step of detecting first positional information on where the image is obtained; the first neural network has a step of determining whether the image has learned features; the first processor has a step of transmitting the first positional information on where the image is obtained through the first communication module; the first processor has a step of receiving a detection result through the first communication module; and the first processor has a step of operating the passive element in accordance with the detection result.

One embodiment of the present invention is an information management system including a data server, a first environment monitor module, and a second environment monitor module, and the data server includes a second neural network, a second communication module, and a second processor. The first environment monitor module includes a first environment sensor module, a second position sensor, a third communication module, and a third processor. The second environment monitor module includes a second environment sensor module, a third position sensor, a fourth communication module, and a fourth processor. The first or second environment sensor module includes one or more of a temperature sensor, a humidity sensor, an illuminance sensor, and an air flow meter. The second position sensor has a step of detecting second positional information; the third position sensor has a step of detecting third positional information; the first environment sensor module has a step of detecting first environmental information; the second environment sensor module has a step of detecting second environmental information; the third processor has a step of transmitting the first environmental information and the second positional information to the data server through the third communication module; the fourth processor has a step of transmitting the second environmental information and the third positional information to the data server through the fourth communication module; the second processor has a step of recording the first environmental information and the second positional information received from the first environment monitor module through the second communication module; the second processor has a step of recording the second environmental information and the third positional information received from the second environment monitor module through the second communication module; and the second neural network has a step of calculating the environmental information of any one of positions in a space interposed between the first environment sensor module and the second environment sensor module.

One embodiment of the present invention is an information management system including an image detection module, environment monitor modules, and a data server.

The image detection module includes a first neural network, a first communication module, a first position sensor, a first processor, and a passive element. The first neural network includes an imaging device. The data server includes a second neural network, a second communication module, and a second processor. The environment monitor modules each include a plurality of environment sensor modules, a second position sensor, a third communication module, and a third processor. The environment sensor modules each include one or more of a temperature sensor, a humidity sensor, an illuminance sensor, and an air flow meter. The environment sensor modules have a step of detecting respective environmental information; the first position sensor has a step of detecting first positional information; the second position sensor has a step of detecting second positional information; the data server has a function of collecting and storing the environmental information and the second positional information through the second communication module; the second neural network has a function of calculating the environmental information of any one of positions in a space interposed between the environment sensor modules by using the environmental information and the second positional information detected by the environment sensor modules; the imaging device has a step of obtaining an image; the first position sensor has a step of detecting the first positional information on where the image is obtained; the first neural network has a step of determining whether the image has learned features; the first processor has a step of transmitting the first positional information on where the image is detected to the data server through the first communication module; the data server has a step of calculating an accumulated value of the environmental information from the first positional information by the second neural network; the second processor has a step of transmitting the accumulated value of the environmental information to the image detection module through the second communication module; the first processor has a step of determining the accumulated value of the environmental information received through the first communication module; and the first processor has a step of operating the passive element in accordance with a detection result.

In each of the above embodiments, the information management system in which the first neural network has a step of learning by an image for learning received through the first communication module is preferable.

In each of the above embodiments, the information management system in which the passive element is a light-emitting element is preferable.

In each of the above embodiments, the information management system in which the passive element is a vibrating element is preferable.

In each of the above embodiments, the information management system in which the environment sensor module is positioned in soil is preferable.

In each of the above embodiments, the information management system in which the environment sensor module is positioned in water is preferable.

In each of the above embodiments, the information management system determining a harvest time of a harvest target in a plant factory is preferable.

In each of the above embodiments, the information management system determining indoor environment is preferable.

One embodiment of the present invention is an image detection module including a first neural network, characterized in that the first neural network includes an imaging device; the imaging device includes a plurality of pixels, a first signal line (65), a second signal line (66), a third signal line (67), a fourth signal line (68), a fifth signal line (69), a first wiring (75), a second wiring (76), a third wiring (77), and a fourth wiring (21a); the pixel includes a first transistor (51), a second transistor (52), a third transistor (53), a fourth transistor (54), a fifth transistor (55), a first capacitor (33), a second capacitor (34), and a photodiode; a gate of the first transistor (51) is electrically connected to the first signal line (65); one of a source and a drain of the first transistor (51) is electrically connected to the first wiring (75); the other of the source and the drain of the first transistor (51) is electrically connected to one of a source and a drain of the second transistor (52) and one electrode of the photodiode; the other electrode of the photodiode is electrically connected to the second wiring (76); a gate of the second transistor (52) is electrically connected to the second signal line (66); the other of the source and the drain of the second transistor (52) is electrically connected to a gate of the third transistor (53) and one electrode of the first capacitor; one of a source and a drain of the third transistor (53) is electrically connected to the first wiring (75); the other of the source and the drain of the third transistor (53) is electrically connected to one of a source and a drain of the fourth transistor (54); a gate of the fourth transistor (54) is electrically connected to the third signal line (67); the other of the source and the drain of the fourth transistor (54) is electrically connected to the fourth wiring (21a); the other electrode of the first capacitor is electrically connected to one electrode of the second capacitor and one of a source and a drain of the fifth transistor (55); a gate of the fifth transistor (55) is electrically connected to the fourth signal line (68); the other of the source and the drain of the fifth transistor (55) is electrically connected to the fifth signal line (69); the other electrode of the second capacitor is electrically connected to the third wiring (77); a first node is formed by connecting the other of the source and the drain of the second transistor (52), the gate of the third transistor (53), and the one electrode of the first capacitor; and a second node is formed by connecting the other electrode of the first capacitor, the one electrode of the second capacitor, and the one of the source and the drain of the fifth transistor (55).

In each of the above embodiments, the image detection module characterized in that the imaging device further includes a gate driver (22), a plurality of adder circuits (23), a plurality of analog/digital converter circuits (13b), a sixth signal line (61), a seventh signal line (62), a fifth wiring (71), a sixth wiring (72), a seventh wiring (73), and an eighth wiring (74); the adder circuit (23) includes a sixth transistor (56), a seventh transistor (57), an eighth transistor (58), a third capacitor (31), and a fourth capacitor (32); the gate driver is electrically connected to the plurality of pixels (21) through the third signal line (67); the adder circuit (23) is electrically connected to the plurality of pixels through the fourth wiring (21a); the fourth wiring (21a) is electrically connected to the analog/digital converter circuit (13b) through the adder circuit (23); the fourth wiring (21a) is electrically connected to one electrode of the third capacitor, one of a source and a drain of the sixth transistor (56), and one of a source and a drain of the eighth transistor (58); a gate of the sixth transistor (56) is electrically connected to the sixth signal line (61); the other of the source and the drain of the sixth transistor (56) is electrically connected to the fifth wiring (71); the other electrode of the third capacitor is electrically connected to one electrode of the fourth capacitor and one of a source and a drain of the seventh transistor (57); a gate of the seventh transistor (57) is electrically connected to the seventh signal line (62); the other of the source and the drain of the seventh transistor (57) is electrically connected to the sixth wiring (72); the other electrode of the fourth capacitor is electrically connected to the eighth wiring (74); a gate of the eighth transistor (58) is electrically connected to the other of the source and the drain of the eighth transistor (58) and the seventh wiring (73); a third node is formed by connecting the one electrode of the third capacitor, the one of the source and the drain of the sixth transistor (56), the one of the source and the drain of the eighth transistor (58), the analog/digital converter circuit, and the fourth wiring (21a); and a fourth node is formed by connecting the other electrode of the third capacitor, the one electrode of the fourth capacitor, and the one of the source and the drain of the seventh transistor (57) is preferable.

In each of the above embodiments, the image detection module in which a first voltage is supplied from the fifth signal line (69) to the one electrode of the second capacitor through the fifth transistor (55); the first voltage is supplied from the third wiring (77) to the other electrode of the second capacitor; the second capacitor has a function of an electrode having the first voltage; the first voltage is supplied from the sixth wiring (72) to the one electrode of the fourth capacitor through the seventh transistor (57); the first voltage is supplied from the eighth wiring (74) to the other electrode of the fourth capacitor; the fourth capacitor has a function of an electrode having the first voltage; a signal supplied to the first signal line (65) turns on the first transistor (51); a signal supplied to the second signal line (66) turns on the second transistor (52); the first node is updated by a reset voltage supplied to the first wiring (75); a signal supplied to the first signal line (65) turns off the first transistor (51); at the first node, imaging data is updated by a photocurrent flowing through the photodiode; a signal supplied to the second signal line (66) turns off the second transistor (52); the imaging data retained in the first capacitor is retained in the first node; the imaging data is supplied to the gate of the third transistor (53); the gate driver (22) has a function of supplying a scan signal to the third signal line (67); the scan signal controls the fourth transistor (54); the imaging data is converted into a first current by the third transistor; the first current is supplied to the fourth wiring (21a) through the fourth transistor; the first current is supplied to the third capacitor of the adder circuit (23) through the fourth wiring (21a); the third capacitor converts the first current into a first output voltage and changes a potential of the third node; and the first output voltage is supplied to the analog/digital converter circuit, whereby the image detection module functions as an imaging element is preferable.

In each of the above embodiments, the image detection module in which an offset potential is supplied from the fifth wiring (71) to the third node through the sixth transistor (56); the offset potential is supplied from the sixth wiring (72) to the fourth node through the seventh transistor (57); the first voltage is supplied from the eighth wiring (74) to the other electrode of the fourth capacitor; a signal supplied to the first signal line (65) turns on the first transistor (51); a signal supplied to the second signal line (66) turns on the second transistor (52); the first node is updated by a reset voltage supplied to the first wiring (75) through the first transistor (51); the second node is updated by the first voltage supplied to the fifth signal line (69) through the fifth transistor (55); a second voltage is supplied from the third wiring (77) to the other electrode of the second capacitor as a weight coefficient; a signal supplied to the first signal line (65) turns off the first transistor (51); a signal supplied to the fourth signal line (68) turns off the fifth transistor (55); at the first node, the imaging data is updated by the photocurrent flowing through the photodiode; a signal supplied to the second signal line (66) turns off the second transistor (52); the imaging data retained in the first capacitor is retained in the first node; the third wiring (77) is updated from the second voltage to the first voltage; the first node generates a third voltage obtained by adding the second voltage to the imaging data by capacitive coupling between the first capacitor and the second capacitor; the third voltage has a multiplication function corresponding to a difference from the second voltage when supplied to the gate of the third transistor (53); the gate driver (22) has a function of supplying scan signals to a plurality of the third signal lines (67); the scan signals control the fourth transistors (54) of the plurality of pixels; the imaging data of each of the pixels is converted into the first current by the third transistor; the first current is supplied to the fourth wiring (21a) through the fourth transistor; the fourth wiring (21a) generates a second current obtained by adding the first currents output from the pixels; the second current is supplied to the third capacitor of the adder circuit (23) through the fourth wiring (21a); the third capacitor converts the second current into a second output voltage using the offset potential as a reference and changes a potential of the third node; and the second output voltage is supplied to the analog/digital converter circuit, whereby the imaging device functions as a neuron having a product-sum operation function is preferable.

In each of the above embodiments, the image detection module in which the eighth transistor (58) has a function of a diode; the second output voltage has a function of being output while a potential higher than or equal to a determination voltage supplied to the seventh wiring (73) is clipped; the analog/digital converter circuit has a function of setting the determination voltage supplied to the seventh wiring (73) to a maximum value of an analog input voltage; when the second output voltage is the same as the determination voltage, the analog/digital converter circuit detects the maximum value; and when the analog/digital converter circuit detects the maximum value, the neuron of the first neural network has a function of determining ignition is preferable.

In each of the above embodiments, the image detection module in which a pixel data potential for learning is supplied from the fifth signal line (69) to the second node through the fifth transistor (55); the second voltage is supplied from the third wiring (77) to the other electrode of the second capacitor as a weight coefficient; a signal supplied to the first signal line (65) turns off the first transistor (51); a signal supplied to the second signal line (66) turns off the second transistor (52); a signal supplied to the fourth signal line (68) turns off the fifth transistor (55); the first node retains the reset voltage; the third wiring (77) is updated from the second voltage to the pixel data potential for learning; and the first node has a function of generating a fourth voltage obtained by adding the reset voltage, the pixel data potential for learning, and the second voltage by capacitive coupling, whereby the first neural network has a learning function is preferable.

In each of the above embodiments, the image detection module including a transistor in which the transistor includes a metal oxide in a semiconductor layer is preferable.

In each of the above embodiments, the image detection module characterized in that the transistor including a metal oxide in a semiconductor layer includes a back gate is preferable.

Effect of the Invention

One embodiment of the present invention can provide an information management system with a novel structure. Alternatively, one embodiment of the present invention can provide an information management system including a neural network. Alternatively, one embodiment of the present invention can provide an information management system that provides environmental information based on positional information. Alternatively, one embodiment of the present invention can provide an image detection module with a novel structure. Alternatively, one embodiment of the present invention can provide an image detection module including a neural network.

Note that the effects of one embodiment of the present invention are not limited to the effects listed above. The effects listed above do not preclude the existence of other effects. The other effects are the effects that are not described in this section and will be described below. Effects that are not described in this section will be apparent from the description of the specification, the drawings, and the like and can be derived from the description by those skilled in the art. One embodiment of the present invention is to solve at least one effect of the effects listed above and/or the other effects. Therefore, one embodiment of the present invention does not have the effects listed above in some cases.

