US9420240B2 - Intelligent security light and associated methods - Google Patents
Intelligent security light and associated methods Download PDF
video frame
Eric Holland
Julia Sharon Irvin
Eric Thosteson
Benjamin Charles Burns
Lighting Science Group Corp
2012-05-04 Application filed by Lighting Science Group Corp filed Critical Lighting Science Group Corp
2012-07-02 Assigned to LIGHTING SCIENCE GROUP CORPORATION reassignment LIGHTING SCIENCE GROUP CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: BECK, JOHN, BURNS, BENJAMIN CHARLES, HOLLAND, ERIC, IRVIN, JULIA SHARON, THOSTESON, ERIC
2014-04-28 Assigned to FCC, LLC D/B/A FIRST CAPITAL, AS AGENT reassignment FCC, LLC D/B/A FIRST CAPITAL, AS AGENT SECURITY INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: BIOLOGICAL ILLUMINATION, LLC, LIGHTING SCIENCE GROUP CORPORATION
2014-06-02 Assigned to MEDLEY CAPTIAL CORPORATION, AS AGENT reassignment MEDLEY CAPTIAL CORPORATION, AS AGENT SECURITY INTEREST Assignors: BIOLOGICAL ILLUMINATION, LLC, LIGHTING SCIENCE GROUP CORPORATION
2015-05-26 Assigned to ACF FINCO I LP reassignment ACF FINCO I LP ASSIGNMENT AND ASSUMPTION OF SECURITY INTERESTS IN PATENTS Assignors: FCC, LLC D/B/A FIRST CAPITAL
2017-04-26 Assigned to LIGHTING SCIENCE GROUP CORPORATION, A DELAWARE CORPORATION, BIOLOGICAL ILLUMINATION, LLC, A DELAWARE LIMITED LIABILITY COMPANY reassignment LIGHTING SCIENCE GROUP CORPORATION, A DELAWARE CORPORATION RELEASE BY SECURED PARTY (SEE DOCUMENT FOR DETAILS). Assignors: ACF FINCO I LP, A DELAWARE LIMITED PARTNERSHIP
2018-08-14 Assigned to BIOLOGICAL ILLUMINATION, LLC, A DELAWARE LIMITED LIABILITY COMPANY, LIGHTING SCIENCE GROUP CORPORATION, A DELAWARE CORPORATION reassignment BIOLOGICAL ILLUMINATION, LLC, A DELAWARE LIMITED LIABILITY COMPANY RELEASE BY SECURED PARTY (SEE DOCUMENT FOR DETAILS). Assignors: MEDLEY CAPITAL CORPORATION
H04N7/18—Closed circuit television systems, i.e. systems in which the signal is not broadcast
H04N7/188—Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position
G06T7/2053—
G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
G06T7/00—Image analysis
G06T7/20—Analysis of motion
G06T7/254—Analysis of motion involving subtraction of images
G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
G08B13/00—Burglar, theft or intruder alarms
G08B13/18—Actuation by interference with heat, light or radiation of shorter wavelength; Actuation by intruding sources of heat, light or radiation of shorter wavelength
G08B13/189—Actuation by interference with heat, light or radiation of shorter wavelength; Actuation by intruding sources of heat, light or radiation of shorter wavelength using passive radiation detection systems
G08B13/194—Actuation by interference with heat, light or radiation of shorter wavelength; Actuation by intruding sources of heat, light or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
G08B13/196—Actuation by interference with heat, light or radiation of shorter wavelength; Actuation by intruding sources of heat, light or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
G08B13/19602—Image analysis to detect motion of the intruder, e.g. by frame subtraction
G06T2207/00—Indexing scheme for image analysis or image enhancement
G06T2207/10—Image acquisition modality
G06T2207/10016—Video; Image sequence
G06T2207/20—Special algorithmic details
G06T2207/20212—Image combination
G06T2207/20224—Image subtraction
G06T2207/30—Subject of image; Context of image processing
G06T2207/30232—Surveillance
H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
H04N2013/0074—Stereoscopic image analysis
H04N2013/0081—Depth or disparity estimation from stereoscopic image signals
A lighting device capable of detecting a condition in an environment includes a sensor to capture a video frame from a location in the environment. The lighting device may include a microcontroller, a processor and memory. The sensor may be electrically connected to the microcontroller, and the video frame may be transmitted to the microcontroller as data. The lighting device may also include a light source electrically connected to and controlled by the microcontroller and a rules engine stored in the memory. The processor may compare the data to rules contained in the rules engine to produce an output. The lighting device may further include an interface through which the output is accessible. After an analysis is conducted, an output may be generated responsive to detection of an anomaly.
This application is related to U.S. patent application Ser. No. 13/464,345 filed simultaneously herewith and titled Occupancy Sensor and Associated Methods, the entire contents of which are incorporated herein by reference. This application is also related to U.S. patent application Ser. No. 13/403,531 filed Feb. 23, 2012 and titled CONFIGURABLE ENVIRONMENTAL CONDITION SENSING LUMINAIRE, SYSTEM AND ASSOCIATED METHODS, the entire contents of which are incorporated herein by reference. This application also claims the benefit of U.S. Provisional Patent Application Ser. No. 61/486,316 filed on May 15, 2011 and titled Motion Detecting Security Light and Associated Methods, the entire contents of which are incorporated herein by reference.
The present invention relates to the field of lighting systems and, more specifically, to lighting systems that can detect changes in the environment, and associated methods.
Security lighting systems are widely used for prevention of crime and vandalism in many communities, as well as to act as deterrents. These security systems are commonly used to monitor residential and business properties, particularly the areas encompassing entrances to buildings, during nighttime hours. Representative examples of these security lighting systems are disclosed in U.S. Pat. No. 4,551,654 to Barnum, U.S. Pat. No. 4,942,384 to Yamauchi at al., and U.S. Pat. Nos. 4,970,436 and 4,992,701, both to Sacchetti.
Conventional security lighting systems may employ a light capable of illuminating a given area, and a motion detector capable of operating the light. The motion detector typically utilizes ultrasound, infrared or some other suitable form of energy, and may sense and be activated by motion into the given protected area which is being monitored. Activation of the motion detector, in turn, operates the light in an on position to illuminate the protected area for a given period of time. However, one drawback of such systems is a failure to differentiate between an innocent moving object and a potentially harmful intruder, e.g., the passing of an animal through the protected area, as opposed to an intruder. Known lighting systems simply activate the light upon detection of motion.
Consequently, a need remains for the improvement in the design of a security lighting system.
With the above deficiencies in mind, the present invention advantageously provides a lighting system and associated methods that perform an action based on an analysis of the environment. The present invention also advantageously allows for customization of a security system based on defined parameters that may be stored on a rules engine. The present invention further advantageously provides the capability to produce an output based on detection of an anomaly. The present invention still further advantageously provides the capability for such an output to be readily stored in a memory.
These and other features and advantages according to the present invention are provided by a lighting system and associated methods for detecting a condition in the environment. The lighting system may include a sensor to capture sequential images from the environment. These images may be processed by a microcontroller, which may apply a set of rules to the images. An analysis may be performed which includes comparing images to determine if a subsequent image has changed relative to the current image. The system may advantageously differentiate a minor change in the images, such as wind blowing tree leaves, a darkening image due to cloud cover, a brightening image from the rising sun, or the like from a major change such as the appearance of an object or the disappearance of an object.
Furthermore, the system may be able to further differentiate changes by specifically identifying the detected object, or by correlating the change in the image to the current time. For example, the system may be able to recognize the appearance of a particular car in the image. The appearance of the car may, for example, be expected and, as such, the rules engine may not make a determination that the detection of the car is an anomaly. On the other hand, the appearance of a car that is not known, i.e., a car that may be stored in the memory, or that may not be defined within the rules engine, or, also for example, the appearance of a car that may only be expected after a certain time of day, may result in an anomaly being detected if, again, for example, the car appears before that time. As a result of the analysis of the images, as sensed using the sensor, the processor may produce an output to indicate whether or not an anomaly was detected. This output may be a control signal for an audible alert, a visual alert, or the like.
A lighting device according to an embodiment of the present invention may be capable of detecting a condition in an environment and may include a sensor to capture an image, such as a video frame, for example, from a location in the environment. The lighting device may further include a microcontroller which may, in turn, further include a processor and memory. The sensor may be electrically connected to the microcontroller and the video frame may be transmitted to the microcontroller as data.
The lighting device may also include a light source that is electrically connected to and controlled by the microcontroller. A rules engine may be stored in the memory, and the processor may compare the data to rules contained in the rules engine to produce an output. An interface through which the output is accessible may also be provided. At least part of the rules engine may define an analysis of the data. This analysis may include the steps of capturing a subsequent video frame, capturing a current video frame, comparing the subsequent video frame and the current video frame to a known object that may be stored in the memory, and generating the output of the analysis with respect to a determination of whether the known object is detected in the subsequent video frame.
At least part of the rules defining detecting the known object in the subsequent video frame may include the steps of defining a subsequent background in the subsequent video frame and a current background in the current video frame by detecting an unchanging image. The rules may further include detecting an anomaly between the subsequent background and the current background indicating that the known object appears in either the subsequent video frame or the current video frame. The rules may also include generating the output responsive to detection of the anomaly. The output may be storable in the memory.
The analysis of the data defined by at least part of the rules engine may also include the step of generating the output of the analysis respective to whether the known object is detected at a specific location in the subsequent video frame. The analysis of the data defined by at least part of the rules engine may alternately include the step of generating the output of the analysis respective to whether the known object is detected at a plurality of locations in the subsequent video frame.
The microcontroller may be electrically connected to a network, and the sensor may comprise a plurality of sensors that are electrically connected to the network. The network may be electrically connected to a centralized computing device that may analyze the data transmitted by the plurality of sensors. Each of the plurality of sensors may be positioned at locations throughout the environment in a uniform manner. The video frames may be captured by each of the plurality of sensors in the locations throughout the environment in an approximately uniform manner, and the video frames may be concatenated to create an overview that includes substantially all of the locations throughout the environment substantially seamlessly. The locations throughout the environment may be configured relating to an approximately grid based pattern.
The plurality of sensors may be positioned to capture the video frames using similar viewing angles relative to the environment, and the plurality of sensors may intercommunicate though the network using mesh networking. The sensor may include a camera.
An event may be definable in the rules to relate to the known object being detected in the environment. The event may be associable with an action, which may subsequent to detecting the event. The action may include generating an alert, and the light source may be operated between an on position and an off position responsive to the alert. The video frame may be compressible by the microcontroller. After the video frame has been compressed, it may be transmitted through the network. The sensor may capture a plurality of video frames which may, in turn, be concatenated to create a video feed. The video feed may be accessible using the interface. The results of the analysis performed by the rules engine may be included in the video feed.
Supplemental data may be viewable using the interface. Further, the known object may be detectable by at least two of the plurality of sensors to create a stereoscopic perspective. A parallax among the video frames in the stereoscopic perspective may be used to calculate depth in a three-dimensional space. The light source may be provided, for example, by an LED, and the light source may be operable responsive to the output.
A method aspect of the present invention is for detecting a condition in an environment. The method may include capturing a video frame from a location in the environment and transmitting the video frame to a microcontroller as data. The method may also include conducting an analysis of the data by comparing the data to rules contained on a rules engine stored in the memory to produce an output. The method may further include making the output accessible through an interface.
The step of conducting the analysis may include capturing a subsequent video frame, capturing a current video frame, comparing the subsequent video frame and the current video frame to a known object that may be stored in the memory, and generating the output of the analysis with respect to a determination of whether the known object is detected in the subsequent video frame.
At least part of the rules defining detecting the known object in the subsequent video frame includes defining a subsequent background in the subsequent video frame and a current background in the current video frame by detecting an unchanging image, detecting an anomaly between the subsequent background and current background, and generating the output that is storable in the memory responsive to detection of the anomaly. An event may also be defined in the rules to relate to the known object being detected in the environment, and the event may be associated with an action. The action may be executed upon detecting an occurrence of the event.
FIG. 1 is a schematic diagram of the lighting device according to an embodiment of the present invention.
FIG. 1a is a partial environmental view of the lighting device according to an embodiment of the present invention.
FIGS. 2-5 are flowcharts illustrating operation of the lighting device according to an embodiment of the present invention.
FIG. 6 is an environmental schematic view of a lighting device according to an embodiment of the present invention positioned within a structure.
FIG. 7 is a schematic depiction of a grid configuration of sensors of a lighting device according to an embodiment of the present invention.
FIG. 8 is a depiction of an alternate configuration of sensors of a lighting device according to an embodiment of the present invention.
FIG. 9 is a depiction of a mesh network as used in connection with a lighting device according to an embodiment of the present invention.
The present invention will now be described more fully hereinafter with reference to the accompanying drawings, in which preferred embodiments of the invention are shown. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. Those of ordinary skill in the art realize that the following descriptions of the embodiments of the present invention are illustrative and are not intended to be limiting in any way. Other embodiments of the present invention will readily suggest themselves to such skilled persons having the benefit of this disclosure. Like numbers refer to like elements throughout.
In this detailed description of the present invention, a person skilled in the art should note that directional terms, such as "above," "below," "upper," "lower," and other like terms are used for the convenience of the reader in reference to the drawings. Also, a person skilled in the art should notice this description may contain other terminology to convey position, orientation, and direction without departing from the principles of the present invention.
Referring now to FIGS. 1-9, details of the lighting device 100 and associated methods according to an embodiment of the present invention are now described in greater detail. The terms lighting device and device are used interchangeably throughout this disclosure and one skilled in the art will realize that references to the device can be understood as references to the lighting device. Likewise, references to the lighting device can be understood as references to the device. The lighting device 100 according to an embodiment of the present invention is illustrated in FIG. 1. The lighting device may be capable of detecting a condition in an environment. In the embodiment shown in FIG. 1, the lighting device 100 may comprise a sensor 101. The sensor 101 may be anything capable of capturing information regarding characteristics of a location in the environment. Skilled artisans will appreciate possible embodiments of a sensor 101 include, for example, and without limitation, still cameras, video cameras, thermal imaging devices, motion detectors, ultrasound detectors, infrared light detectors, light emitting semiconductor devices or the like. Those of skill in the art will realize that these specific examples are discussed in the interest of clarity, and are not intended to limit the present invention to those examples.
The sensor 101 may capture information regarding characteristics of a location in the environment 102 at specified intervals of time. Characteristics of a location in the environment 102 that may be captured by the sensor 101 include, but are not limited to, the visual appearance of the environment, the heat distribution of the environment, relative location of objects in the environment, the motion of objects in the environment, the presence of an object occupying at least part of the environment, or the like. The sensor 101 may capture this information periodical or intermittently. Although the embodiment illustrated in FIG. 1 shows that the lighting device 100 includes one sensor 101, those skilled in the art will appreciate that any number of sensors may be provided to carry out the various features and advantages of the embodiments of the present invention. The device 100 may have a plurality of sensors 101 and these sensors 101 may be of different types. As an example, but not as a limitation, the device may include a plurality of video cameras and/or a plurality of infrared light detectors.
The information captured by the sensor 101 at each sampling interval may be referred to as an image or as images. Those skilled in the art will appreciate that the image or images that are captured by the sensor 101 may, for example, be a video frame, or video frames. The terms video frame and video frames may be used interchangeably throughout this disclosure. Those skilled in the art will further appreciate that the present invention contemplates that the sensor 101 may capture any type of image. In one embodiment, the sensor 101 may comprise a camera and the video frame may comprise the image captured by the camera at the sampling time. In another embodiment of the lighting device 100, the sensor 101 may comprise an infrared light detector and the video frame may comprise the output of the infrared light detector at the sampling time. The use of the term video frame is not intended to limit the sensor 101 to a device that collects visual data. Likewise, the use of the term video frame is not intended to limit the information gathered by the sensor 101 to visual data. Instead, it is to be understood by those skilled in the art that the information and data captured by the sensor 101 can be any type of information or data that is suitable for analysis.
The sensor 101 may capture characteristics of a location in the environment 102. The location in the environment 102 may be outside or inside. The location in the environment 102 may be any place of which the sensor 101 is capable of obtaining characteristics. The sensor 101 may remain immobile and capture characteristics of a location in the environment 102. Additionally, the sensor 101 may be mobile and capture characteristics of a location in the environment 102 where the environment detected by the sensor may change from video frame to video frame. The sensor 101 may move by way of joints that provide one or more degrees of freedom to the sensor 101. By utilizing movement in one or more direction, the sensor 101 may capture characteristics of different locations in the environment. By way of example, and not as a limitation, the sensor 101 may be connected to an apparatus that allows the sensor 101 to move in the horizontal axis and capture characteristics of a location in the environment 102. In this exemplary embodiment, each video frame captured by the sensor 101 may contain characteristics of a different location in the environment 102. One skilled in the art will appreciate that movement of the sensor 101 is not limited to movement in the horizontal axis. The sensor 101 may move in the vertical access, may adjust its yaw, may adjust its pitch, or the like. The lighting device may include a microcontroller 103. The microcontroller 103 may be any device that can send, receive, and analyze data and electronic signals. Those of skill in the art will realize that the microcontroller 103 may be a controller, gate array, system-on-a-chip, general purpose processing element, or collections of electronic components capable of processing data. Preferably, but without limitation, the microcontroller 103 may further include a processor (CPU) 104, memory 105, network interface that may be connected to a network, and/or an input/output (I/O) interface. Skilled artisans will appreciate that one or more of the aforementioned elements of the microcontroller 103 may be located outside of the microcontroller, or omitted from the microcontroller, as the embodiments of the present invention may vary. The sensor 101 may be electrically connected to the microcontroller 103. The video frame may be transmitted to the microcontroller 103 as data. The data may include information about the characteristics of a location in the environment 102. The data may include information about the visual appearance of a location in the environment 102, the heat distribution of a location in the environment 102, or the like. The data may be digital or analog information that can be processed and displayed as still or moving images. The processor 104 may analyze the data. The data may be analyzed by hardware, software, or a combination of both.
The microcontroller 103 may also include memory 105. The memory 105 may include volatile and/or non-volatile memory modules. Volatile memory modules may include random access memory, which may temporarily store data and code being accessed by the processor 104. The memory 105 may also store data captured by one or more of the sensors 101.
Additionally, the memory 105 may contain the computerized code used by the processor 104 to analyze the data. In an embodiment of the present invention, the memory 105 may include an operating system, which may additionally include applications to be run from within the operating system, as will be appreciated by a person of skill in the art.
The memory 105 may include information to be analyzed by the processor 104. This information may include data received from the sensors 101, modes of operation, and rules to govern the analysis of the aforementioned. The non-volatile memory may include flash based memory, which may store a computerized program to be executed by the processor 104. The memory 105 may store a rules engine 106 that is executed by the processor 104 to analyze the data. The rules engine 106 may be contained in hardware or software. In a preferred embodiment, the rules engine 106 may be a set of software instructions that are executed by the processor 104. A plurality of rules 107 may be contained in the rules engine 106. The rules engine 106 may compare the rules 107 with the data or may utilize the rules 107 to analyze the data. The processor 104 may compare the data to rules 107 contained in the rules engine 106 to produce an output 108. The rules 107 may be applied to the video frame, or to a plurality of video frames, to determine the output 108 of the microcontroller 103. At least part of the rules engine 106 may define the analysis of the data. Comparing the data to the rules 107 using the rules engine 106 may produce a result to indicate a condition of a location in the environment 102. The device 100 may indicate conditions of a location in the environment 102 such as, but not limited to, the presence of objects, the absence of objects, the motion of objects, the lack of motion of objects, and the like. The rules 107 may be included in memory 105 to define an operation to be performed on data, a comparison between various pieces of data, or otherwise define the operation of the various embodiments of the present invention. Preexisting rules 107 may be programmed into the memory 105. Additionally, rules 107 may be defined or modified by a user. The rules 107 may be defined or modified, for example, and without limitation, through an interface 132. The memory 105 may also store additional data used by a rules engine 106 to detect known objects 110, events, alerts, or the like.
The rules 107 stored on the rules engine 106 may, for example, be directed to any set of directions or requirements necessary for a particular operation to be carried out. More particularly, in order to carry out a particular operation using the lighting device 100, a particular condition of a location in the environment 102, or data, that is sensed by the sensor 101 may be compared against the rules 107. An operation of the lighting device 100 may be carried out depending on whether or not the particular condition of a location in the environment 102 or data is in compliance with the rules 107 on the rules engine 106.
The rules 107 may also be applied to the data transmitted by the sensor 101 to analyze the video frames and detect conditions in locations in the environment 102. More specifically, the rules 107 may be utilized to analyze the data and detect changes from on video frame to another. Additionally, the rules 107 may be applied to the video frames to determine whether detected changes are significant enough to warrant action by the device 100. As an example, but not as a limitation, the rules 107 may be utilized to determine if changes between two or more video frames indicate a material change to a condition in the location in the environment 102, such as, by way of example, and not as a limitation, the appearance of a person or the disappearance of a car. Likewise, the rules 107 may be utilized to determine if changes between two or more video frames indicate an immaterial change to a condition in the location in the environment 102, such as, by way of example, and not as a limitation, the movement of trees caused by the wind or the appearance of a small animal.
The rules 107 may be definable by a user, and may be added to or removed from the rules engine 106 by the user, and may also be modified by the user. In an embodiment of the device, the rules 107 may be definable using an interface 132. The user may access the interface 132 to directly input rules 107 regarding how the device 100 should respond to the detection of differing conditions of locations in the environment 102. The user may create, modify, or delete rules pertaining to what conditions should be considered material, how the device 100 should respond to the detection of different conditions, what objects should be classified as known objects 110, at what times alerts should be generated, what actions should be associated with events, what events should be associated with which objects, and the like. The sensor 101 may be utilized to capture video frames when defining the rules 107. As an example, but not as a limitation, an object may be placed in a location in the environment 102 from which the sensor 101 may capture video frames. The rules engine 106 may operate to detect or recognize the object placed in the location in the environment 102. The interface 132 may be utilized to create, modify, or delete a rule 107 related to the object placed in the location in the environment 102.
The lighting device may also include a light source 109. The light source 109 may be any device capable of emitting illumination. Examples of possible light sources 109 include incandescent light bulbs, fluorescent light bulbs, light emitting semiconductor devices, such as light emitting diodes (LEDs), or the like. The light source 109 may be operable responsive to the output of the microcontroller. The light source 109 may be electrically connected to and controlled by the microcontroller 103. The light source 109 may be actuated when certain objects or events are detected. The actuation of the light source 109 may be an action that is associated with an event. As an example, but not as a limitation, the rules engine 106 may analyze data received from the sensor 101 and detect a specific car that has been defined in the rules 107 as a known object 110. That known object 110 may be defined in the rules 107 to relate to an event. The event may be associated with the action of actuating the light source 109. The light source 109 may be actuated after the event is detected.
Known objects 110 may be identifiable by the lighting device. By way of example, but not as a means of limitation, a known object 110 may be identified in a video frame by applying a rule 107 to the data. When a known object 110 is identified, the rules engine 106 may take an action. The action taken by the rules engine 106 may include triggering an event, not triggering an event, or the like. Additionally, the rules engine 106 may take an action only if the known object 110 occurs at a specific time or during a specific time range. Conversely, the rules engine 106 may take an action only if the known object 110 occurs outside of a specific time or outside of a specific time range. Known objects 110 may be added or modified by the user. The known objects 110 may be defined in the rules 107 or may be stored in memory 105. Known objects 110 may be identified based upon a user's response to a previous output. Known objects 110 may be added to the device 100 by using the interface 132 or the sensor 101 or any combination of the two. As an example, but not as a limitation, an object may be placed in a location in the environment 102. The sensor 101 may capture a video frame that includes data related to the object. The rules engine 106 may operate on the data and a rule 107 may be created, modified, or deleted to define the object as a known object 110. Additionally, the device may be preprogrammed with a set of known objects 110. A known object 110 may be anything that may be detected by the device. Examples of known objects 110 may, for example, include cars, people, animals, or the like. Those skilled in the art will appreciate that the known object 110 may be defined to be any desired object, and is not meant to be limited to the examples provided above.
The rules 107 may define an action to be taken by the processor 104 in response to input data. In one embodiment, the rules 107 may be applied to the data received from the sensor 101 to determine an output 108 of the microcontroller 103. The rules 107 may perform an analysis of the data to detect such events as the appearance of objects, the disappearance of objects, the presence of a specific object, changes in lighting, expected events, the presence of known objects 110, or the like.
In one embodiment of the lighting device 100 according to the present invention, the output 108 may control or be displayed by an interface 132. The output 108 may be accessible through the interface 132. The results of the analysis performed by the rules engine may be accessed using the interface 132. The interface 132 may be a device that can be either on or off. In these embodiments, the interface 132 may be turned on when an event is detected and may be turned off when no event is detected. Similarly, the interface may also be turned off after an amount of time from when the event is detected, or may be operated between an on and an off state depending on the event that is detected. Examples of such interfaces 132 include light sources, audible alarms, or the like. In alternate embodiments of the device 100, the interface 132 may be a device that is capable of conveying detailed information to a user or receiving information from the user. Examples of such an interface 132 include a monitor, a computer, a cellular phone, a handheld device, a tablet, or the like. As an example, and not by way of limitation, the interface 132 may be a video monitor and an associated computer that display a visual representation of the data contained in the video frames and can collect input from the user.
The interface 132 may include a plurality of inputs, which may be manipulated by a user to define at least some of the rules. A person of skill in the art will appreciate that no inputs may be included in the interface 132 or as few as one input may be included in the interface 132 and be contemplated by the scope of this disclosure. Similarly, a skilled artisan will appreciate that the maximum number of inputs may be virtually limitless.
The interface 132 may also receive data Examples of, but not limitations on, possible implementations of an interface 132 include a computer, cellular phone, tablet, handheld device, Internet connection, or the like. The user may interact with a graphical user interface (GUI) that transmits user information to the interface 132 or the GUI may be part of the interface 132. The information supplied through the interface 132 may define, at least in part, the rules.
With relation to the embodiments of the present invention, an input may be defined as an element of the interface 132 through which the operation of the lighting device 100 may be modified. As will be discussed in greater detail herein, the input may be provided by any number of means such as, for example, a mechanical toggle, a capacitive sensor, a keyboard, a touchscreen, or any other system, device or apparatus suitable to cause the transmission of a signal to the microcontroller 103. In one embodiment, the input may be a mechanical toggle, which may be physically engaged and mechanically altered to change the state of the toggle. For example, the mechanical toggle inputs may be a switch that open or close an electrical circuit upon being manipulated.
In another example, an input may be a capacitive sensor. The state of a capacitive sensor input may be altered upon the detection of an object located in proximity of the capacitive sensor. Skilled artisans will appreciate that a capacitive sensor may detect the proximity of an object using position, displacement, humidity, fluid level, acceleration, or other measurable changes in capacitance. An example of an object may include the finger of a user, without limitation.
In another example, the input may be user data received through a human interface device. By way of example, but not as a limitation, a human interface device may be a mouse, a keyboard, a touchscreen, or the like. A person of skill in the art will appreciate that any number of components capable of altering a signal may be included as an input, and should not limit the input to the examples discussed above. Additional inputs will be appreciated by a person of skill in the art. Further examples for the operation of the inputs will be provided below.
The inputs may be located on a surface of the device 100. Alternatively, the inputs may be operatively connected to the device 100, such that the inputs may be in communication with the microcontroller 103. In further embodiments, the inputs may be remotely connected to the device 100. Skilled artisans will appreciate that the aforementioned examples of connective structures are provided in the interest of clarity, and should not limit the present invention to the preceding examples.
FIG. 2 illustrates rules that may be executed by the processor. The rules may define the analysis of the data. In the idle stage 211 the processor may scan the environment by analyzing video frames received from the sensor and apply rules to the video frames. The processor may then compare video frames to one another to determine if there has been a change in the environment 212. In the event that no change is detected, the processor may continue to scan the environment by analyzing video frames and applying rules to the video frames.
However, if there has been a change detected in the environment at 212, the processor may determine if a known object caused the change that is detected, and whether the change to the environment is the appearance or disappearance of a known object 213. If the change in the environment is not related to a known object, the processor may initiate an event 214. The event 214 may be enabling an output, disabling an output, executing a subroutine, or the like. After the event is initiated at 214, the device may continue to scan the environment at 211.
If the change in the environment is related to a known object, the processor may then determine whether this change has occurred at an expected time 215. If the change has not occurred at an expected time, the processor may initiate a second event 216. The second event 216 may be enabling an output, disabling an output, executing a subroutine, or the like. Those skilled in the art will appreciate that the second event 216 may be a different event than the first event 214, or may be the same event. Those skilled in the art will also appreciate that after the second event is initiated at 216, the device may continue to scan the environment at 211, or may end the process, or may take any number of other actions. If the change in the environment did occur at a known time, the processor may execute a third event (not shown) or, alternatively, may return to the idle stage 211. While not depicted in FIG. 2, those skilled in the art will recognize that in addition to determining whether the known object appeared or disappeared at an expected time, the processor is also capable of determining whether an unknown object appeared or disappeared, whether any object changed its position, whether any object is located in an expected position, or the like. These examples are not given as limitations, but merely meant to depict just some of the several advantages of the various embodiments of the present invention.
FIG. 3 depicts a possible set of rules for detecting a change in the environment. The rules engine may define an analysis of the data. In this embodiment of the invention, the data may be analyzed by comparing a current video frame to a subsequent video frame. Changes may also be detected by comparing a precedent video frame to a subsequent video frame. The terms precedent video frame and current video frame may be used interchangeable within this disclosure. The current video frame may be detected or captured by the sensor at time (t-0) at 317. The subsequent video frame may be detected or captured by the sensor at time (t-1) at 318. The rules may define comparing the current video frame and the subsequent video frame to detect a likelihood of disparity between the two video frames. The likelihood of disparity may be determined by analyzing the changes between the t-0 and t-1 video frames. The nature and quantity of the changes may determine the likelihood of disparity. For example, but not as a limitation, a subsequent video frame that is uniformly darker than the precedent video frame may be indicative of a low likelihood of disparity. The rules may detect the uniform darkening and attribute it to a change in lighting condition or some like environmental condition that does not create a high likelihood of disparity. Alternatively, analysis of the subsequent video frame may determine that a new object has appeared in the subsequent video frame. The rules may determine the likelihood of disparity in the instance based on the size, speed, color, shape, or other characteristic of the newly appeared object. One skilled in the art will appreciate that analysis of the video frames to determine the appearance of an object is given for exemplary purposes only and is not limiting. The analysis of the video frames may conclude that an object has disappeared, moved, remained stationary for an extended duration, or the like. The rules may define a result to be generated based on the analysis of the likelihood of disparity. The result of this analysis may be storable in memory. The result of the analysis may include setting a variable in software, actuating an indicator, performing a process, detecting an event, performing an action, or the like.
The rules may define comparing the current video frame and the subsequent video frame to a known object wherein the known object is stored in memory. The rules may further define generating the output with respect to a determination of whether the known object is detected in the subsequent video frame.
The results of the analysis of the precedent video frame and the subsequent video frame may be generated respective to the location in the environment. That is, the rules may take the specific location in the environment into account when determining the results of the analysis. As an example, and not as a limitation, the rules may determine a likelihood of disparity between the two video frames. The rules may then generate a result of the analysis that is dependent on the location in the environment from which the video frames were obtained. That is, identical analysis may produce differing results if the video frames are obtained from different locations in the environment. Additionally, the rules may consider time as a factor when generating the result. Identical analyses may produce different results if they are performed at different times.
As yet another example, but not by way of limitation, analysis of the two frames may indicate that there is a dramatic change in light levels with the subsequent frame being darker than the precedent frame. In an indoor location, this may create a result indicating that there is a high likelihood of disparity between the two frames because the lighting should remain constant. In an outdoor location, this may create a result indicating that there is a low likelihood of disparity between the two frames because decreases in lighting are expected outside as the sunsets. However, the rules may also account for the time of day at which the analysis is occurring. If the change in lighting occurs indoors at the end of the work day, the results may indicate that there is a low likelihood of disparity because it is expected that lights are turned off at this time. Similarly, if the change in lighting occurs outdoors at noon, the results may indicate that there is a high likelihood of disparity because it is unexpected that lighting will change dramatically when outside in the middle of the day.
Detecting changes in lighting levels is presented for exemplary purposes only and is not intended as a limitation. Those skilled in the art will recognize that an analysis of the two frames may result in a determination that an object has appeared, disappeared, moved, or the like. The likelihood of disparity may depend, in whole or in part, upon the object that is identified, the size of the object, the color of the object, the shape of the object, the time of day the object is detected, the elapsed time since the object was last identified, or the like.
The device may be utilized to determine occupancy of a location. A high likelihood of disparity detected in a location may be indicative of occupancy of the location. A low likelihood of disparity in the location may be indicative of no occupancy of the location.
One way in which the change between the current and subsequent video frame may be determined is by analyzing the current video frame and the subsequent video frame to detect what data is represented identically in both video frames at 319. The unchanging image may then be removed from the video frame to leave only the object at 320. The object may then be analyzed to determine whether it is a known object at 321. If the object is a known object, the rules may continue to execute. If the object is not a known object an event may occur at 322. The event may be associated with an action. For example, and not as a limitation, the sensor may continuously capture video frames from a location in the environment. If no condition in the location in the environment has changed, the device may simple continue to capture video frames from a location in the environment. If a condition in the location in the environment has changed, the changes may be analyzed by the rules to determine the response to the change. The rules may detect that the change identified in the video frames in the appearance of a known object. The appearance of that known object may be associated with an event that causes the device to simply continue collected video frames. In another embodiment, the appearance of that known object may be associated with an event that initiates an action. In one embodiment, that action may be actuating the light source. In another embodiment, that action may be actuating an audible alarm.
FIG. 4 depicts a possible embodiment of the rules applied to the data to detect an unchanging image. At least part of the rules may define detecting a known object in the subsequent video frame as described herein. A subsequent video frame may be captured and a current video frame may be captured. The current video frame and the subsequent video frame may be compared and data that is not identical between the two of them may be characterized as background data at 423. A subsequent background in the subsequent video frame and a current background in the current video frame may be defined by detecting an unchanging image. Unchanging data in the current video frame may be termed the current background. Unchanging data in the subsequent video frame may be termed subsequent background. Data that differs between the subsequent video frame and the current video frame may represent a changing image. However, not all data contained in the changing image may represent an anomaly to which it is desirable for the lighting device to respond. A rule may be applied to the changing image to determine if that change represents an anomaly. An anomaly may be detected between the subsequent background and the current background indicating that the known object appears in either the subsequent video frame of the current video frame. The rules may generate an output responsive to the detection of the anomaly. The output may be storable in memory.
As an example, and not as a limitation, a rule may be applied to the changing image to determine if the differences between the two frames are due to changes in lighting at 424. If the changes are due to variations in lighting, the data that was classified as part of the changing image due to the lighting variations may be removed from classification as the changing image at 425. As another example, and not as a limitation, a rule may be applied to determine if data has changed as a result of transient effects of the weather or other environmental factors, for example, but not as a means of limitation, rain, wind, or the like. Changes of this nature may not represent an anomaly to which it is desirable for the lighting device to respond. As another example, and not as a limitation, a rule may be applied to the changing image to determine if the differences between the two frames are due to changes in environmental factors at 426. If the changes are due to environmental factors, the data that was classified as part of the changing image due to the environmental factors may be removed from classification as the changing image at 427. The rules may utilize data that remains classified as the changing image to define or identify the object detected by the lighting device.
Data that is the same between the current video frame and the subsequent video frame may be called the unchanging image. It can be understood by one skilled in the art that more than two video frames may be used to determine the unchanging image. That is, the data from two or more video frames may be analyzed to determine what information stays constant from frame to frame. To determine what data is the same or what data should be considered the unchanging image, the video frames may be analyzed to determine what changes are significant, and may give rise to the occurrence of an event, and what changes are of a nature that should not be considered the occurrence of an event. The unchanging image may encompass more data than the unchanging data. The unchanging image may also include data that has changed, but the change is not remarkable or significant enough to cause the device to detect an event.
FIG. 5 depicts a rule regarding how the lighting device may respond when a known object is detected. The rule may operate to cause the device to continuously or repeatedly analyze frames until a known object is detected at 528. The detection of the known object may result in a detection of an event at 529. An event may be defined in the rules to relate to the condition being detected in the environment. The event may be associated with an action. The action may occur subsequent to detecting the event at 530. The device may analyze frames until a known object is detected by the rules. The detection of this known object may result in an event being recognized. The event may be associated with an action, for example actuation of a light source. Therefore, upon detection of a known object, the device may actuate the light source. In another embodiment, the rules may detect that a known object has disappeared from the video frame, or is no longer detectable. The disappearance of a known object may result in an event being recognized. The event may be associated with an action, for example, extinguishing the light source. Therefore, upon detection of the absence of a known object, the device may extinguish the light source. One skilled in the art will recognize that the aforementioned examples are presented for clarification and are not limiting.
The action that is associated with an event may include generating an alert. The alert may include actuating a light source that is operable between an on position and an off position (also referred to as an on state and an off state). The skilled artisan will appreciate that the light source may be operated between the on state and the off state, i.e., dimming the light source. When the alert is generated, the lighting device may be actuated, when the alert is not generated, the lighting device may not be actuated. Conversely, the lighting device may be actuated when an alert is not generated. The alert or action may include actuating an audible alarm, actuating a light source that is operable between variable luminosities, or the like. In embodiments that include variable light sources, different events may be associated with controlling the light source to emit different luminosity levels. One skilled in the an will recognize that the aforementioned examples are presented for clarification and are not limitations.
In one embodiment of the invention, the output of the rules engine may indicate whether or not an event occurred. The output of the analysis may be displayed by the interface. In an alternate embodiment of the invention, there may be a plurality of outputs from the rules engine. The plurality of outputs may indicate the occurrence of separate, specific events. The plurality of outputs may be displayed, presented, or accessible to the user through the interface.
In one embodiment of the invention, a rule may be defined so that an event occurs if the subsequent video frame differs from the current video frame by more than a threshold level. In an embodiment of the present invention in which the video frame is a still image captured by a video camera, the rule may recognize the occurrence of an event if more than a certain number or a certain percentage of pixels change from one video frame to another.
In a preferred embodiment of the invention, an anomaly may be detected when a known object appears in a video frame. The detection of this anomaly may generate an output of the microcontroller. This output may be stored in a memory. Anomalies may also be detected when a known object disappears from a video frame, when a known object fails to appear in a video frame at a given time, when a known object remains in the video frame longer than expected, when any object is detected by the device, when any object disappears from the video frame, or the like.
In a preferred embodiment of the invention, the rules engine may generate an output indicating the presence of the known object only when the known object is located as a specific location in the environment. That is, the rules engine may identify the known object, but the output of the rules engine will depend upon the location at which the known object was detected. In one embodiment, the output of the rules engine may depend upon detection of the known object at a plurality of locations. That is, the known object may trigger the output to be activated only when the known object is in one of a plurality of locations. Additionally, a plurality of known objects may trigger the output to be activated only when the plurality of known objects are located at a plurality of locations in the environment. The known object may trigger the output to be activated only when the known object is not in one of a plurality of locations.
The lighting device according to an embodiment of the present invention may be connected to a network. The network may be a closed network in which only elements of the lighting device are in communication with the network. An example, but not a limitation, of a closed network is a device with a plurality of sensors transmitting data over the network to a single microcontroller. Alternatively, the network may allow the lighting device to connect to components external to the device itself. Examples of external components that may connect to the device through a network include, but are not limited to, remote computers, cellular phones, handheld devices, and the like. The device may utilize a network to connect to the Internet. In embodiments in which the device is connected to the Internet or to other components that may allow users to interact with the device, users may use these components to access device data through the network. Additionally, users may access the results of the analysis through the network. Different elements of the device may be connected to the network. Elements that may be connected to the network include the plurality of sensors 101, the microcontroller 103, the processor 104, the memory 105, the light source 109, the rules engine 106, the interface 132, the centralized computing device, and any other element of the lighting device 100.
In one embodiment, the interface 132 may be connected to the network to allow remote viewing of the overview. In another embodiment of the device, the plurality of sensors 101 may be connected to the network to allow remote viewing of the data. In yet another embodiment of the device, the microcontroller 103 may be connected to the network to allow modification of the rules. One skilled in the art will recognize that the preceding are merely exemplary network configurations. The examples listed are not exhaustive and are not provided as a limitation on possible network configurations.
In an embodiment of the device 100 according to the present invention in which the device is in communication with a network, a network interface may be employed to interface with the network. A person of skill in the art will appreciate that the network interface may be included within the microcontroller 103 discussed above. Alternately, a skilled artisan will appreciate that the network interface may be operatively connected to the microcontroller 103, wherein it may operate as an interface device between the microcontroller 103 and a connected network, such as for example, a home network, corporate network, or the Internet.
The network interface may provide a channel for the electronic communication of data between the lighting device 100 and a connected component connected through the network. Provided without the intent to be limiting, examples of network connected components may include additional lighting devices 100, personal computers, tablets, smartphones, personal data assistants, a data center, remote, key fob, a light switch, or other electronic devices capable of connecting to a network.
The network interface may connect to a network using a proprietary or standard connection protocol. With respect to embodiments of the present invention that include a proprietary network connection, the network interface may perform handshake operations and exchange data with network connected devices, as may be defined within the proprietary protocol. Alternately, the network interface may connect to a network using a standardized protocol. Examples of standardized protocols, provided without the intent to be limiting, may include 802.3 Ethernet, 802.11 Wi-Fi, 802.15.1 Bluetooth, 802.15.4 low rate personal area network 62 (PAN) environments, packet switching wide area networks (WAN), cellular relay WANs, or additional standardized data transmission protocols.
The lighting device 100 according to an embodiment of the present invention may include a plurality of sensors 101. These sensors 101 may be connected to a network. The plurality of sensors 101 may be located in a plurality of locations in the environment 102. Each of the plurality of sensors 101 may intercommunicate with the microcontroller 103 through the network. The plurality of sensors 101 may each have a network interface through which it accesses the network. The plurality of sensors 101 may all share a network through which they intercommunicate with the microcontroller 103. Alternatively, each of the plurality of sensors 101 may intercommunicate with the microcontroller 103 through a network to which fewer than all of the plurality of sensors 101 may be in communication.
The plurality of sensors 101 of the lighting device 100 according to an embodiment of the present invention may be connected to a network and a centralized computing device may also be connected to the network. The centralized computing device may include the microcontroller 103. The data from the sensors 101 may be transmitted electronically over the network to the centralized computing device.
Alternatively, in embodiments of the present invention wherein a centralized computing device is utilized, the plurality of sensors 101 may be coupled to the microcontroller 103 and the data from the plurality of sensors 101 may be transmitted to the microcontroller 103. The microcontroller 103 may be in communication with the centralized computing device through the network. The microcontroller 103, the centralized computing device, or any combination of the two may analyze the data received from the plurality of sensors 101. The microcontroller 103 may be referred to as a central processor in embodiments of the present invention wherein the microcontroller is located in the centralized computing device. The memory 105 may be referred to as central memory in embodiments of the present invention wherein the memory is located in the centralized computing device. The centralized computing device may receive data from a plurality of sensors 101. The sensors 101 may be in communication with the network, which communicates with the centralized computing device through a central network interface. Additionally, the centralized computing device may operate or contain at least part of the rules engine 106. The results of the analysis performed by the centralized computing device may be accessible using the interface 132.
In embodiments of the present invention wherein a centralized computing device is utilized, the centralized computing device may undergo an initialization operation. The initialization operation may be performed when the device is initially powered on or when the device is configured. Additionally, the initialization operation may be performed periodically or intermittently during the operation of the device 100. The initialization operation may detect each of the plurality of sensors 101 at each of the plurality of locations in the environment 102. The initialization operation may be performed automatically or manually. The initialization operation may be used to define at least part of the rules 107 relative to the location in the environment 102 that includes the sensor 101. FIG. 6 depicts an embodiment in which there may be a plurality of sensors 601. The plurality of sensors 601 may be positioned at a plurality of locations in the environment. The plurality of sensors 601 may be located remotely from the other elements of the device. Each of the plurality of sensors may transmit data to a plurality of microprocessors. The plurality of microprocessors may concatenate the data to produce a single overview containing data from each of the plurality of sensors 601. In embodiments of the present invention in which the data is moving images, the data may be concatenated to produce a single image that includes data received from each of the plurality of sensors. The results of the analysis performed by the rules engine may be included in the overview.
FIG. 6 depicts one scenario in which concatenation of images into an overview may be utilized. Each of the plurality of sensors 601 shown in FIG. 6 may capture an image of a location in the environment. The location in the environment may be different for each of the plurality of sensors. Each of the plurality of sensors 601 may transmit data to the microcontroller. The microcontroller may use the data along with information that may be stored in memory to indicate the position of each of the plurality of sensors in order to concatenate the data into a single image containing information from more than one of the plurality of sensors. The single image may be an overview. The result may be that a user can utilize the overview to gain information about conditions in the environment. In the absence of an overview, a user may have multiple images to review on the interface 132. When an overview is used, the user may be able to refer to a single overview that incorporates the multiple data feeds into a single unified view of the environment. The overview may display the video frames captured from the plurality of locations substantially seamlessly with respect to the location in which the sensor is positioned. The overview may be viewed using the interface 132. The use of video data to create an overview is exemplary and not limiting. Those skilled in the art will appreciate that many different kinds of data from a plurality of sensors may be concatenated to create an overview.
The concatenated data used to create an overview may be dissimilar data. That is, the plurality of sensors may transmit different types of data to the microcontroller. As an example, and not as a limitation, a device may have a sensor that captures video data and another sensor that captures infrared data. The overview may contain both the video data and the overlaid infrared data in a single view. One of the advantages of creating an overview of dissimilar data may be that a single device can provide the interface 132 with data that is useful under many different environmental conditions.
The overview may be output to the interface. The interface may be physically located remotely from the other elements of the device 100. Each sensor 601 may capture video frames from a plurality of locations in the environment. In the embodiment depicted in FIG. 6, each sensor 601 may transmit the data collected by the individual sensor 601 to a shared interface 632 that collects data from each of the sensors 601. This shared interface 632 may display data received from each sensor 601. The data may be accessible through the interface 632.
In an embodiment in which a plurality of locations are included in the environment, the rules may analyze the data and generate results based on the location in which the sensor capturing the video frame is located. Events detected by a sensor in location A may create different results than event detected by a sensor in location B. For example, but not by way of limitation, analysis of video frames transmitted by a sensor 601 at location A in the environment may indicate the presence of an object at location A. Analysis of video frames transmitted by a sensor 601 at location B in the environment may indicate the presence of the same object at location B. The rules may generate a different result for the detection of the object at location A than they generate for the detection of the object at location B.
In an embodiment of the present invention in which a plurality of sensors are positioned in a plurality of locations in the environment, the plurality of sensors may be position at locations throughout the environment in an approximately uniform manner. Positioning the plurality of sensors in an approximately uniform manner may include positioning each of the plurality of sensors approximately the same distance apart from one another, positioning each of the plurality of sensors at approximately the same height from the ground, positioning each of the plurality of sensors with approximately the same viewing angle with respect to the horizon, or the like. Video frames may be captured by a plurality of sensors in a plurality of locations in an approximately uniform manner. Capturing video frames in an approximately uniform manner may include capturing video frames at approximately the same intervals, capturing video frames at approximately the same time, capturing video frames at approximately the same frequency, or the like. The video frames may be concatenated to create an overview that includes substantially all of the location in the environment substantially seamlessly. The uniform distribution of sensors and the uniform capture of video frames may assist in creating a substantially seamless overview of the locations in the environment that are captured by the sensors.
In an embodiment o the present invention in which a plurality of sensors are positioned at approximately uniform locations, the locations throughout the environment may be configured relating to an approximately grid based pattern. The plurality of sensors may be positioned at the approximately grid-based locations to capture video frames relative to the approximately grid based pattern. FIG. 7 depicts possible grid patterns.
FIG. 8 depicts one embodiment of the present invention with a plurality of sensors 801. In embodiments of the present invention in which a plurality of sensors 801 are positioned at uniform locations, the plurality of sensors 801 may be positioned to capture video frames from the environment using similar viewing angles relative to the environment. FIG. 8 depicts a plurality of sensors 801 with similar viewing angles relative to the environment.
In an embodiment of the lighting device according to the present invention wherein there are a plurality of sensors, the plurality of sensors may intercommunicate through the network using mesh networking. FIG. 9 depicts as an example, but not as a limitation, one possible configuration of sensors 901 in a mesh network. As shown in FIG. 9, not each of the plurality of sensors 901 must be directly connected to the network 931. A plurality of the plurality of sensors 901 may serve as a relay for another sensor, or other sensors, that are not directly connected to the network 931. A person of skill in the art will appreciate that the configuration of nodes illustrated in FIG. 9 has been chosen in the interest of clarity, as the nodes may be configured in a plethora of additional locations relative to one another.
In one embodiment of the lighting device, compressible video frame data may be received by the microcontroller. The microcontroller may perform a compression algorithm on the video frame data resulting in a compressed video frame that has a reduced data size. The compressed video frame may then be transmitted through the network.
In one embodiment of the invention, the sensor may capture a plurality of video frames. These video frames may be concatenated together to form a video feed. The video feed may be transmitted to and accessible using the interface 132. In this embodiment, the interface 132 may be a monitor or the like. The results of the analysis performed by the rules engine may also be included in the video feed and accessible using the interface 132.
In embodiments of the present invention that utilize a plurality of sensors in a plurality of locations, a video feed may be received from the plurality of locations. The video feed received from each of the plurality of locations may be concatenated to create a video overview. The video overview may be accessible using the interface 132. Additionally, the results of the analysis performed by the rules engine may be included in the concatenated video overview. The results may also be accessible using the interface 132.
In embodiments of the present invention in which there are a plurality of sensors and the data from each sensor is concatenated, the rules may be applied to the data received from each of the plurality of sensors before or after it is concatenated with data received from others of the plurality of sensors.
In embodiments wherein the overview is viewable using the interface 132, a portion of the overview may be viewable as a field of view. A wide field of view may include substantially all locations captured by the plurality of sensors. A narrow field of view may include the location captured by a single sensor or some location less than all locations captured by the plurality of sensors. The field of view viewable using the interface 132 may be scalable between the wide field of view and the narrow field of view.
In one embodiment of the invention, supplemental data may be viewable using the interface 132. By way of example, but not as a limitation, supplemental data may include information regarding whether an event was detected or what known objects have been identified. Additionally, supplemental data may include information regarding the time an object was detected or the location in which an object was detected. Supplemental data may be information regarding what events have occurred within a given amount of time, what events trigger actions, what known objects are recognized by the lighting device, or the like. In embodiments utilizing a network, supplemental data may be accessible through the network. The supplemental data may be included with the overview substantially seamlessly. Additionally, the supplemental data may be included with the video overview substantially seamlessly.
In one embodiment of the lighting device according to the present invention, at least a part of the plurality of sensors may be positioned to detect objects from different angles. By combining the video frames captured from these at least a part of the plurality of sensors, a stereoscopic perspective of the object may be created. The parallax between the video frames obtained from at least a part of the plurality of sensors may be used to calculate depth in a three-dimensional space and determine the position of the object detected by the sensors. In one embodiment of the device according to the present invention, the sensor, microcontroller, and interface 132 may be included in a luminaire.
In one embodiment of the inventive method according to the present invention, the occupancy of an environment may be detected. The occupancy of an environment may indicate whether or not humans, or other objects occupy the environment. Additionally, the occupancy of an environment may indicate whether or not the environment is occupied by moving objects, known objects, unknown objects, or the like. The method of detecting occupancy may include capturing video frames from a location in the environment. The video frames may be transmittable as data. The data contained in the video frames may be compared to rules using a rules engine that is operable by the microcontroller. Comparing the data to rules may produce results indicative of a condition of the environment. The data may be analyzed by detecting a precedent video frame, detecting a subsequent video frame, and comparing the precedent video frame with the subsequent video frame to detect a likelihood of disparity between the video frames. The results of the analysis may be generated respective to the likelihood of disparity between the video frames and these results may be stored in memory. The video frames may be captured from a plurality of locations and the video frames at each of the plurality of locations may be concatenated to create an overview. The video frames captured from the plurality of locations may be displayed substantially seamlessly with respect to the location in which the sensor capturing the video frame is positioned. The overview may be viewable using an interface 132. Access to the results of the analysis may be provided using the interface 132 and the results of the analysis may be included in the overview.
The data transmitted by the plurality of sensors may be received on a centralized computing device. The centralized computing device may be initialized to detect one of the pluralities of sensors at each of the plurality of location in the environment. The centralized computing device may be initialized to define at least part of the rules relative to the locations in the environment that includes the sensor.
Each of the plurality of sensors may be positioned at locations throughout the environment in an approximately uniform manner. The video frames may be captured in the locations in an approximately uniform manner. The video frames may be concatenated to create the overview that includes substantially all of the locations in the environment substantially seamlessly.
The locations in the environment may be configured relating to an approximately grid based pattern. The sensors may be positioned at the locations in the environment to capture the video frames relative to the approximately grid based pater. The sensors may be positioned to capture the video frames from the environment using similar viewing angles relative to the environment.
A person of skill in the art will appreciate that one or more of the above provided embodiments may be included in the operation of the lighting device of the present invention. Additionally, a person of skill in the art will appreciate additional embodiments that would be included within the scope and spirit of the present invention, after having the benefit of this disclosure. Furthermore, a skilled artisan will appreciate that the operations described above, along with additional operations that would be apparent to those in the art, may be performed exclusively, incrementally, sequentially, simultaneously, or any other operative configuration.
Many modifications and other embodiments of the invention will come to the mind of one skilled in the art having the benefit of the teachings presented in the foregoing descriptions and the associated drawings. Therefore, it is understood that the invention is not to be limited to the specific embodiments disclosed, and that modifications and embodiments are intended to be included within the scope of the appended claims.
1. A lighting device capable of detecting a condition in an environment comprising:
a video camera to capture an image from a location in the environment;
a microcontroller, further comprising a processor and memory, wherein the sensor is electrically connected to the microcontroller and wherein the image is received by the microcontroller as data;
a light source electrically connected to and controlled by the microcontroller;
a rules engine stored in the memory, wherein the processor compares the data to rules contained in the rules engine to produce an output; and
an interface through which the output is accessible;
wherein at least part of the rules engine defines an analysis of the data including the steps of:
capturing a current image;
capturing a subsequent image;
recording the time of day of the subsequently captured image;
comparing the subsequent image and the current image to a known object relative to the time of day wherein the known object is stored in the memory; and
generating the output of the analysis with respect to a determination of whether the known object is detected in the subsequent image;
wherein at least part of the rules defining detecting the known object in the subsequent image include the steps of:
defining a subsequent background in the subsequent image and a current background in the current image by detecting an unchanging image;
detecting an irregularity between the subsequent background and current background indicating that the known object appears in either the subsequent image or the current image;
comparing the time of day to the detected irregularity so as to disregard expected behavior based on the time of day in which the detected irregularity occurred; and
generating the output responsive to detection of the irregularity;
wherein the output is storable in the memory.
2. A lighting device according to claim 1 wherein the analysis of the data defined by at least part of the rules engine further includes the step of generating the output of the analysis respective to whether the known object is detected at a specific location in the subsequent image.
3. A lighting device according to claim 1 wherein the analysis of the data defined by at least part of the rules engine further includes the step of generating the output of the analysis respective to whether the known object is detected at a plurality of locations in the subsequent image.
4. A lighting device according to claim 1 wherein the microcontroller is electrically connected to a network.
5. A lighting device according to claim 4 wherein the lighting device comprises a plurality of video cameras that are electrically connected to the network.
6. A lighting device according to claim 5 wherein the network is electrically connected to a centralized computing device; and wherein the centralized computing device analyzes the data transmitted by the plurality of video cameras.
7. A lighting device according to claim 6 wherein each of the plurality of video cameras are positioned at locations throughout the environment in a uniform manner; wherein the images are captured by each of the plurality of video cameras in the locations throughout the environment in an approximately uniform manner; and wherein the images are concatenated to create an overview that includes substantially all of the locations throughout the environment substantially seamlessly.
8. A lighting device according to claim 7 wherein the locations throughout the environment are configured relating to an approximately grid based pattern.
9. A lighting device according to claim 5 wherein the plurality of video cameras are positioned to capture the images using similar viewing angles relative to the environment.
10. A lighting device according to claim 5 wherein the plurality of video cameras intercommunicate though the network using mesh networking.
11. A lighting device according to claim 1 wherein the image is a video frame captured by the camera.
12. A lighting device according to claim 1 wherein an event is definable in the rules to relate to the known object being detected in the environment; wherein the event is associable with an action; and wherein the action may occur subsequent to detecting the event.
13. A lighting device according to claim 12 wherein the action includes generating an alert.
14. A lighting device according to claim 13 wherein the light source is operated between an on position and an off position responsive to the alert.
15. A lighting device according to claim 4 wherein the image is compressible by the microcontroller; and wherein the image that is compressed is transmitted through the network.
16. A lighting device according to claim 1 wherein the video camera captures a plurality of images; wherein the plurality of images are concatenated to create a video feed; and wherein the video feed is accessible using the interface.
17. A lighting device according to claim 16 wherein the results of the analysis performed by the rules engine are included in the video feed.
18. A lighting device according to claim 1 wherein supplemental data is viewable using the interface.
19. A lighting device according to claim 5 wherein the known object is detectable by at least two of the plurality of video cameras to create a stereoscopic perspective; and wherein a parallax among the images in the stereoscopic perspective is used to calculate depth in a three-dimensional space.
20. A lighting device according to claim 1 wherein the light source comprises an LED.
21. A lighting device according to claim 1 wherein the light source is operable responsive to the output.
22. A lighting device capable of detecting a condition in the environment comprising:
a camera to capture a video frame from a location in the environment;
a microcontroller including a processor and memory that is electrically connected to the camera by a network and wherein the video frame is transmitted to the microcontroller through the network as data;
a rules engine stored in the memory, wherein the processor compares the data to rules contained in the rules engine to produce an output, and wherein the output controls the light source; and
capturing a current video frame;
recording the brightness level of the video frame;
capturing a subsequent video frame;
recording the time of day of the subsequently captured video frame;
recording the brightness level of the subsequently captured video frame;
comparing the subsequent video frame and the current video frame to a known object relative to the time of day and brightness wherein the known object is stored in the memory; and
generating the output of the analysis respective to whether the known object is detected at a specific location in the subsequent video frame; and
wherein at least part of the rules defining detecting a known object in the subsequent video frame include the steps:
defining a subsequent background in the subsequent video frame and a current background in the current video frame by detecting an unchanging image;
detecting an irregularity from the subsequent background and the current background indicating that the known object appears in either the subsequent video frame or the current video frame;
comparing the time of day and brightness level to the detected irregularity so as to disregard expected light behavior based on the time of day in which the detected irregularity occurred;
generating the output that is storable in the memory;
wherein an event is definable in the rules to relate to the known object being detected in the environment;
wherein the event is associable with an action;
wherein the action may occur subsequent to detecting the event;
wherein the action includes generating an alert; and
wherein the light source is operable responsive to the alert.
23. A lighting device according to claim 22 wherein the analysis of the data defined by at least part of the rules engine further includes the step of generating the output of the analysis respective to whether the known object is detected at a plurality of locations in the subsequent video frame.
24. A lighting device according to claim 22 wherein the network is electrically connected to a centralized computing device; and wherein the centralized computing device analyzes the data transmitted by the camera.
25. A lighting device according to claim 22 wherein the lighting device comprises a plurality of cameras that are positioned at locations throughout the environment in a uniform manner; wherein the plurality of cameras capture a plurality of video frames in an approximately uniform manner at the locations; and wherein the plurality of video frames are concatenated to create an overview that includes substantially all of the locations throughout the environment substantially seamlessly.
26. A lighting device according to claim 23 wherein the plurality of locations are configured relating to an approximately grid based pattern.
27. A lighting device according to claim 23 wherein the plurality of cameras are positioned to capture the video frames using similar viewing angles relative to the environment.
28. A lighting device according to claim 22 wherein the camera includes a plurality of cameras that intercommunicate though the network using mesh networking.
29. A lighting device according to claim 22 wherein the video frame is compressible by the microcontroller, and wherein the video frame that is compressed is transmitted through the network.
30. A lighting device according to claim 22 wherein the video frame comprises a plurality of video frames that are concatenated to create a video feed; and wherein the video feed is accessible using the interface.
31. A lighting device according to claim 30 wherein the results of the analysis performed by the rules engine is included in the video feed.
32. A lighting device according to claim 22 wherein supplemental data is viewable using the interface.
33. A lighting device according to claim 23 wherein the camera includes a plurality of cameras; wherein the known object is detectable by at least two of the plurality of cameras to create a stereoscopic perspective; and wherein a parallax among the video frames in the stereoscopic perspective is used to calculate depth in a three-dimensional space.
34. A method of detecting a condition in an environment comprising:
capturing a video frame from a location in the environment;
transmitting the video frame to a microcontroller as data, wherein the microcontroller comprises a processor and memory;
conducting an analysis of the data by comparing the data to rules contained on a rules engine stored in the memory to produce an output; and
making the output accessible through an interface;
wherein conducting the analysis includes the steps of:
recording the brightness level of the current video frame;
recording weather conditions of the current video frame;
recording weather conditions of the subsequently captured video frame;
comparing the subsequent video frame and the current video frame to a known object relative to the time of day wherein the known object is stored in the memory; and
generating the output of the analysis with respect to a determination of whether the known object is detected in the subsequent video frame;
wherein at least part of the rules defining detecting the known object in the subsequent video frame include the steps of:
detecting an irregularity between the subsequent background and current background indicating that the known object appears in either the subsequent video frame or the current video frame;
comparing the time of day, brightness, and weather conditions to the detected irregularity so as to disregard expected behavior and naturally occurring conditions;
generating the output that is storable in the memory responsive to detection of the irregularity;
defining an event in the rules to relate to the known object being detected in the environment;
associating the event with an action; and
executing the action upon detecting an occurrence of the event.
35. A method according to claim 34 wherein conducting the analysis of the data further includes the step of generating the output of the analysis respective to whether the known object is detected at a specific location in the subsequent video frame.
36. A method according to claim 34 wherein conducting the analysis further includes the step of generating the output of the analysis respective to whether the known object is detected at a plurality of locations in the subsequent video frame.
37. A method according to claim 34 wherein a plurality of sensors that are electrically connected to the network are used to capture the video frame; wherein the network is electrically connected to a centralized computing device; and further comprising analyzing the data using the centralized computing device.
38. A method according to claim 35 further comprising positioning each of the plurality of sensors at locations throughout the environment in a uniform manner; capturing the video frame in an approximately uniform manner; and concatenating the video frames to create an overview that includes substantially all of the locations throughout the environment substantially seamlessly.
39. A method according to claim 36 wherein the locations throughout the environment are configured relating to an approximately grid based pattern.
40. A method according to claim 37 wherein the plurality of sensors each comprise a camera.
41. A method according to claim 34 wherein executing the action further comprises generating an alert.
42. A method according to claim 41 further comprising operating a light source responsive to the alert being generated.
43. A method according to claim 34 further comprising compressing the video frame using the microcontroller; and transmitting the video frame that is compressed through the network.
44. A method according to claim 34 wherein the video frame includes a plurality of video frames; and further comprising concatenating the plurality of video frames to create a video feed; and wherein the video feed is accessible using the interface.
45. A method according to claim 34 wherein the known object is detectable by at least two sensors to create a stereoscopic perspective; and wherein a parallax among the video frames in the stereoscopic perspective is used to calculate depth in a three-dimensional space.
US13/464,292 2011-05-15 2012-05-04 Intelligent security light and associated methods Active 2035-05-04 US9420240B2 (en)
US13/464,292 US9420240B2 (en) 2011-05-15 2012-05-04 Intelligent security light and associated methods
US13/464,292 Active 2035-05-04 US9420240B2 (en) 2011-05-15 2012-05-04 Intelligent security light and associated methods
US13/464,345 Active 2034-07-18 US9681108B2 (en) 2011-05-15 2012-05-04 Occupancy sensor and associated methods
US9648284B2 (en) 2011-05-15 2017-05-09 Lighting Science Group Corporation Occupancy sensor and associated methods
US9597420B2 (en) * 2012-05-04 2017-03-21 Biological Illumination, Llc Radiated energy sterilization device and associated method
US9420240B2 (en) 2011-05-15 2016-08-16 Lighting Science Group Corporation Intelligent security light and associated methods
US9472163B2 (en) * 2012-02-17 2016-10-18 Monotype Imaging Inc. Adjusting content rendering for environmental conditions
US20130278620A1 (en) * 2012-04-20 2013-10-24 Aptos Technology Inc. Method of storing videos and portable device
US9006987B2 (en) 2012-05-07 2015-04-14 Lighting Science Group, Inc. Wall-mountable luminaire and associated systems and methods
US9402294B2 (en) 2012-05-08 2016-07-26 Lighting Science Group Corporation Self-calibrating multi-directional security luminaire and associated methods
US9303825B2 (en) 2013-03-05 2016-04-05 Lighting Science Group, Corporation High bay luminaire
US10057508B2 (en) 2013-06-20 2018-08-21 Excelitas Technologies Corp. Illumination device with integrated thermal imaging sensor
US9405974B2 (en) * 2013-11-13 2016-08-02 Xerox Corporation System and method for using apparent size and orientation of an object to improve video-based tracking in regularized environments
US9412253B2 (en) 2014-02-06 2016-08-09 Biological Illumination, Llc System for detecting and analyzing motion for pattern prediction and associated methods
US9830724B2 (en) 2014-11-21 2017-11-28 Mastercard International Incorporated Detecting real estate vacancies using satellite imagery
CN104615481B (en) * 2015-02-10 2019-02-01 西安理工大学 A kind of wind based on cluster cluster has leaf tree to flicker analogy method
US9990832B2 (en) 2016-04-13 2018-06-05 Vivint, Inc. Occupancy detection by social media
US4551654A (en) 1981-06-05 1985-11-05 Kesser Electronics International, Inc. Lighting control system and method
US4942384A (en) 1988-04-08 1990-07-17 Matsushita Electric Works, Ltd. Composite type crime preventive sensor
US5319301A (en) 1984-08-15 1994-06-07 Michael Callahan Inductorless controlled transition and other light dimmers
US5523878A (en) 1994-06-30 1996-06-04 Texas Instruments Incorporated Self-assembled monolayer coating for micro-mechanical devices
US5563422A (en) 1993-04-28 1996-10-08 Nichia Chemical Industries, Ltd. Gallium nitride-based III-V group compound semiconductor device and method of producing the same
US5747976A (en) 1996-03-26 1998-05-05 Raytheon Company Constant on-time architecture for switching regulators
US5936599A (en) 1995-01-27 1999-08-10 Reymond; Welles AC powered light emitting diode array circuits for use in traffic signal displays
US5997150A (en) 1995-10-25 1999-12-07 Texas Instruments Incorporated Multiple emitter illuminator engine
US6140646A (en) 1998-12-17 2000-10-31 Sarnoff Corporation Direct view infrared MEMS structure
US6211626B1 (en) 1997-08-26 2001-04-03 Color Kinetics, Incorporated Illumination components
US6272154B1 (en) 1998-10-30 2001-08-07 Tellium Inc. Reconfigurable multiwavelength network elements
US6341876B1 (en) 1997-02-19 2002-01-29 Digital Projection Limited Illumination system
WO2002016824A1 (en) 2000-08-23 2002-02-28 Ot Light Aps Method and system for controlling the direction, and preferably also the intensity, of light at a site and use of such system
US6356700B1 (en) 1998-06-08 2002-03-12 Karlheinz Strobl Efficient light engine systems, components and methods of manufacture
US6561656B1 (en) 2001-09-17 2003-05-13 Mitsubishi Denki Kabushiki Kaisha Illumination optical system with reflecting light valve
US6594090B2 (en) 2001-08-27 2003-07-15 Eastman Kodak Company Laser projection display system
US20030209893A1 (en) * 1992-05-05 2003-11-13 Breed David S. Occupant sensing system
US20040052076A1 (en) 1997-08-26 2004-03-18 Mueller George G. Controlled lighting methods and apparatus
US6733135B2 (en) 2002-04-02 2004-05-11 Samsung Electronics Co., Ltd. Image projection apparatus
US6767111B1 (en) 2003-02-26 2004-07-27 Kuo-Yen Lai Projection light source from light emitting diodes
US6787756B2 (en) 2001-04-12 2004-09-07 Honeywell International Inc. Semiconductor laser-based area scanner
US6817735B2 (en) 2001-05-24 2004-11-16 Matsushita Electric Industrial Co., Ltd. Illumination light source
US6825761B2 (en) 2001-10-01 2004-11-30 Siemens Ag System for automatically monitoring persons in a domestic environment
US6853150B2 (en) 2001-12-28 2005-02-08 Koninklijke Philips Electronics N.V. Light emitting diode driver
US6870523B1 (en) 2000-06-07 2005-03-22 Genoa Color Technologies Device, system and method for electronic true color display
US6871982B2 (en) 2003-01-24 2005-03-29 Digital Optics International Corporation High-density illumination system
US6876007B2 (en) 2001-11-22 2005-04-05 Semiconductor Energy Laboratory Co., Ltd. Light emitting device driving by alternating current in which light emission is always obtained
US6967761B2 (en) 2000-10-31 2005-11-22 Microsoft Corporation Microelectrical mechanical structure (MEMS) optical modulator and optical display system
US6974713B2 (en) 2000-08-11 2005-12-13 Reflectivity, Inc. Micromirrors with mechanisms for enhancing coupling of the micromirrors with electrostatic fields
US20060002108A1 (en) 2004-06-30 2006-01-05 Ouderkirk Andrew J Phosphor based illumination system having a short pass reflector and method of making same
US20060002110A1 (en) 2004-03-15 2006-01-05 Color Kinetics Incorporated Methods and systems for providing lighting systems
US7042623B1 (en) 2004-10-19 2006-05-09 Reflectivity, Inc Light blocking layers in MEMS packages
US7066628B2 (en) 2001-03-29 2006-06-27 Fiber Optic Designs, Inc. Jacketed LED assemblies and light strings containing same
US7072096B2 (en) 2001-12-14 2006-07-04 Digital Optics International, Corporation Uniform illumination system
US7070281B2 (en) 2002-12-04 2006-07-04 Nec Viewtechnology, Ltd. Light source device and projection display
US7075707B1 (en) 1998-11-25 2006-07-11 Research Foundation Of The University Of Central Florida, Incorporated Substrate design for optimized performance of up-conversion phosphors utilizing proper thermal management
US20060164607A1 (en) 2005-01-25 2006-07-27 Morejon Israel J Light-emitting diode (LED) illumination system for a digital micro-mirror device (DMD) and method of providing same
US20060164005A1 (en) 2005-01-25 2006-07-27 Chuan-Sheng Sun Illumination apparatus having adjustable color temperature and method for adjusting the color temperature
US7083304B2 (en) 2003-08-01 2006-08-01 Illumination Management Solutions, Inc. Apparatus and method of using light sources of differing wavelengths in an unitized beam
WO2006095315A1 (en) 2005-03-11 2006-09-14 Koninklijke Philips Electronics N.V. Wall finding for wireless lighting assignment
US20060232992A1 (en) 2003-08-12 2006-10-19 Koninklijke Philips Electronics N.V. Circuit arrangement for ac driving of organic diodes
US7138770B2 (en) 2004-12-27 2006-11-21 Top Union Globaltek Inc. LED driving circuit
US20060285193A1 (en) 2005-06-03 2006-12-21 Fuji Photo Film Co., Ltd. Optical modulation element array
US20070013871A1 (en) 2005-07-15 2007-01-18 Marshall Stephen W Light-emitting diode (LED) illumination in display systems using spatial light modulators (SLM)
US7178941B2 (en) 2003-05-05 2007-02-20 Color Kinetics Incorporated Lighting methods and systems
US7184201B2 (en) 2004-11-02 2007-02-27 Texas Instruments Incorporated Digital micro-mirror device having improved contrast and method for the same
US20070159492A1 (en) 2006-01-11 2007-07-12 Wintek Corporation Image processing method and pixel arrangement used in the same
US7246923B2 (en) 2004-02-11 2007-07-24 3M Innovative Properties Company Reshaping light source modules and illumination systems using the same
US7255469B2 (en) 2004-06-30 2007-08-14 3M Innovative Properties Company Phosphor based illumination system having a light guide and an interference reflector
US20070188847A1 (en) 2006-02-14 2007-08-16 Texas Instruments Incorporated MEMS device and method
US7261453B2 (en) 2005-01-25 2007-08-28 Morejon Israel J LED polarizing optics for color illumination system and method of using same
US20070241340A1 (en) 2006-04-17 2007-10-18 Pan Shaoher X Micro-mirror based display device having an improved light source
US7289090B2 (en) 2003-12-10 2007-10-30 Texas Instruments Incorporated Pulsed LED scan-ring array for boosting display system lumens
US7300177B2 (en) 2004-02-11 2007-11-27 3M Innovative Properties Illumination system having a plurality of light source modules disposed in an array with a non-radially symmetrical aperture
US7303291B2 (en) 2004-03-31 2007-12-04 Sanyo Electric Co., Ltd. Illumination apparatus and video projection display system
WO2007125477A3 (en) 2006-05-03 2008-01-10 Koninkl Philips Electronics Nv Illumination copy and paste operation using light-wave identification
US7342658B2 (en) 2005-12-28 2008-03-11 Eastman Kodak Company Programmable spectral imaging system
US7344279B2 (en) 2003-12-11 2008-03-18 Philips Solid-State Lighting Solutions, Inc. Thermal management methods and apparatus for lighting devices
US7349095B2 (en) 2005-05-19 2008-03-25 Casio Computer Co., Ltd. Light source apparatus and projection apparatus
US20080143973A1 (en) 2006-10-12 2008-06-19 Jing Miau Wu Light source device of laser LED and projector having the same device
US20080198572A1 (en) 2007-02-21 2008-08-21 Medendorp Nicholas W LED lighting systems including luminescent layers on remote reflectors
US7427146B2 (en) 2004-02-11 2008-09-23 3M Innovative Properties Company Light-collecting illumination system
US20080232084A1 (en) 2007-03-19 2008-09-25 Nec Lighting, Ltd White light source device
US7429983B2 (en) 2005-11-01 2008-09-30 Cheetah Omni, Llc Packet-based digital display system
US7434946B2 (en) 2005-06-17 2008-10-14 Texas Instruments Incorporated Illumination system with integrated heat dissipation device for use in display systems employing spatial light modulators
US7438443B2 (en) 2003-09-19 2008-10-21 Ricoh Company, Limited Lighting device, image-reading device, color-document reading apparatus, image-forming apparatus, projection apparatus
US20080258643A1 (en) 2007-04-21 2008-10-23 Zippy Technology Corp. Method for driving alternate current of light emitting diode and operating voltage thereof
US20090009102A1 (en) 2006-02-14 2009-01-08 Koninklijke Philips Electronics N.V. Lighting device with controllable light intensity
US7476016B2 (en) 2005-06-28 2009-01-13 Seiko Instruments Inc. Illuminating device and display device including the same
US7489086B2 (en) 2004-02-25 2009-02-10 Lynk Labs, Inc. AC light emitting diode and AC LED drive methods and apparatus
US20090059585A1 (en) 2007-08-29 2009-03-05 Young Optics Inc. Illumination system
US20090059099A1 (en) 2007-09-05 2009-03-05 Samsung Electronics Co., Ltd. Illumination device and projection system having the same
US7530708B2 (en) 2004-10-04 2009-05-12 Lg Electronics Inc. Surface emitting light source and projection display device using the same
US20090128781A1 (en) 2006-06-13 2009-05-21 Kenneth Li LED multiplexer and recycler and micro-projector incorporating the Same
US7537347B2 (en) 2005-11-29 2009-05-26 Texas Instruments Incorporated Method of combining dispersed light sources for projection display
US7540616B2 (en) 2005-12-23 2009-06-02 3M Innovative Properties Company Polarized, multicolor LED-based illumination source
US20090160370A1 (en) 2007-12-19 2009-06-25 Industrial Technology Research Institute Alternating current light emitting device
US20090175041A1 (en) 2007-01-07 2009-07-09 Pui Hang Yuen High efficiency low cost safety light emitting diode illumination device
US7567040B2 (en) 2001-12-14 2009-07-28 The University Of Hong Kong High efficiency driver for color light emitting diodes (LED)
US20090200952A1 (en) 2008-02-08 2009-08-13 Purespectrum, Inc. Methods and apparatus for dimming light sources
US7598686B2 (en) 1997-12-17 2009-10-06 Philips Solid-State Lighting Solutions, Inc. Organic light emitting diode methods and apparatus
US7598682B2 (en) 2006-05-26 2009-10-06 Nexxus Lighting, Inc. Current regulator apparatus and methods
US7604378B2 (en) 2003-07-02 2009-10-20 S.C. Johnson & Son, Inc. Color changing outdoor lights with active ingredient and sound emission
US7605971B2 (en) 2003-11-01 2009-10-20 Silicon Quest Kabushiki-Kaisha Plurality of hidden hinges for mircromirror device
US20090262516A1 (en) 2008-01-17 2009-10-22 Intematix Corporation Light emitting device with phosphor wavelength conversion
US20090261748A1 (en) 2008-04-15 2009-10-22 Mckinney Steven Modified dimming LED driver
US7607798B2 (en) 2006-09-25 2009-10-27 Avago Technologies General Ip (Singapore) Pte. Ltd. LED lighting unit
US7626755B2 (en) 2007-01-31 2009-12-01 Panasonic Corporation Wavelength converter and two-dimensional image display device
US20100006762A1 (en) 2007-03-27 2010-01-14 Kabushiki Kaisha Toshiba Scintillator panel and radiation detector
US20100051976A1 (en) 2006-11-15 2010-03-04 Lemnis Lighting Patent Holding B.V. Led lighting assembly
US20100061078A1 (en) 2008-09-10 2010-03-11 Samsung Electronics Co., Ltd. Light emitting device and system providing white light with various color temperatures
WO2010027459A2 (en) 2008-09-05 2010-03-11 Firefly Green Technologies Inc. Optical communication device, method and system
US20100060181A1 (en) 2008-09-05 2010-03-11 Seoul Semiconductor Co., Ltd. Ac led dimmer and dimming method thereby
US20100061068A1 (en) 2006-06-16 2010-03-11 Alexander Geissler Method for fixing an electrical or an electronic component, particularly a printed-circuit board, in a housing and fixing element therefor
US7677736B2 (en) 2004-02-27 2010-03-16 Panasonic Corporation Illumination light source and two-dimensional image display using same
US7684007B2 (en) 2004-08-23 2010-03-23 The Boeing Company Adaptive and interactive scene illumination
US20100072494A1 (en) 2006-09-30 2010-03-25 Seoul Opto Device Co., Ltd. Light emitting diode having light emitting cell with different size and light emitting device thereof
US7703943B2 (en) 2007-05-07 2010-04-27 Intematix Corporation Color tunable light source
US20100103389A1 (en) 2008-10-28 2010-04-29 Mcvea Kenneth Brian Multi-MEMS Single Package MEMS Device
US7709811B2 (en) 2007-07-03 2010-05-04 Conner Arlie R Light emitting diode illumination system
US7708452B2 (en) 2006-06-08 2010-05-04 Lighting Science Group Corporation Lighting apparatus including flexible power supply
US7719766B2 (en) 2007-06-20 2010-05-18 Texas Instruments Incorporated Illumination source and method therefor
US7728846B2 (en) 2003-10-21 2010-06-01 Samsung Electronics Co., Ltd. Method and apparatus for converting from source color space to RGBW target color space
US7732825B2 (en) 2007-03-13 2010-06-08 Seoul Opto Device Co., Ltd. AC light emitting diode
US7766490B2 (en) 2006-12-13 2010-08-03 Philips Lumileds Lighting Company, Llc Multi-color primary light generation in a projection system using LEDs
US20100202129A1 (en) 2009-01-21 2010-08-12 Abu-Ageel Nayef M Illumination system utilizing wavelength conversion materials and light recycling
US20100213859A1 (en) 2006-01-20 2010-08-26 Exclara Inc. Adaptive Current Regulation for Solid State Lighting
WO2010098811A2 (en) 2009-01-27 2010-09-02 Firefly Green Technologies Inc. Fault tolerant network utilizing bi-directional point-to-point communications links between nodes
US20100231136A1 (en) 2009-03-13 2010-09-16 Led Specialists Inc. Line voltage dimmable constant current led driver
US20100231863A1 (en) 2007-10-08 2010-09-16 Koninklijke Philips Electronics N.V. Lighting device, array of lighting devices and optical projection device
US20100244700A1 (en) 2007-12-24 2010-09-30 Patrick Chong System for Representing Colors Including an Integrating Light Capsule
US20100244724A1 (en) 2007-06-05 2010-09-30 Koninklijke Philips Electronics N.V. Lighting system for horticultural applications
US7819556B2 (en) 2006-12-22 2010-10-26 Nuventix, Inc. Thermal management system for LED array
US20100270942A1 (en) 2009-04-24 2010-10-28 City University Of Hong Kong Apparatus and methods of operation of passive led lighting equipment
US20100277067A1 (en) 2009-04-30 2010-11-04 Lighting Science Group Corporation Dimmable led luminaire
US20100277084A1 (en) 2005-06-28 2010-11-04 Seoul Opto Device Co., Ltd. Light emitting device for ac power operation
US7828465B2 (en) 2007-05-04 2010-11-09 Koninlijke Philips Electronis N.V. LED-based fixtures and related methods for thermal management
US7828453B2 (en) 2009-03-10 2010-11-09 Nepes Led Corporation Light emitting device and lamp-cover structure containing luminescent material
US7832878B2 (en) 2006-03-06 2010-11-16 Innovations In Optics, Inc. Light emitting diode projection system
US7835056B2 (en) 2005-05-13 2010-11-16 Her Majesty the Queen in Right of Canada, as represented by Institut National d'Optique Image projector with flexible reflective analog modulator
US7834867B2 (en) 2006-04-11 2010-11-16 Microvision, Inc. Integrated photonics module and devices using integrated photonics modules
US7841714B2 (en) 2008-02-07 2010-11-30 Quantum Modulation Scientific Inc. Retinal melatonin suppressor
US20100302464A1 (en) 2009-05-29 2010-12-02 Soraa, Inc. Laser Based Display Method and System
US20100308739A1 (en) 2009-06-04 2010-12-09 Exclara Inc. Apparatus, Method and System for Providing AC Line Power to Lighting Devices
US7852017B1 (en) 2007-03-12 2010-12-14 Cirrus Logic, Inc. Ballast for light emitting diode light sources
US20100315320A1 (en) 2007-12-07 2010-12-16 Sony Corporation Light source device and display device
US20100320927A1 (en) 2009-06-22 2010-12-23 Richard Landry Gray Power Reforming Methods and Associated Multiphase Lights
US20100321933A1 (en) 2005-05-10 2010-12-23 Iwasaki Electric Co., Ltd. Projector device, laminate type light-emitting diode device, and reflection type light-emitting diode unit
US20100321641A1 (en) 2008-02-08 2010-12-23 Koninklijke Philips Electronics N.V. Light module device
US20100320928A1 (en) 2008-02-13 2010-12-23 Canon Components, Inc. White light emitting apparatus and line illuminator using the same in image reading apparatus
US7871839B2 (en) 2004-06-30 2011-01-18 Seoul Opto Device Co., Ltd. Light emitting element with a plurality of cells bonded, method of manufacturing the same, and light emitting device using the same
US20110012137A1 (en) 2004-08-31 2011-01-20 Industrial Technology Research Institute Structure of ac light-emitting diode dies
WO2011008251A2 (en) 2009-07-12 2011-01-20 Firefly Green Technologies Inc. Intelligent illumination device
US7880400B2 (en) 2007-09-21 2011-02-01 Exclara, Inc. Digital driver apparatus, method and system for solid state lighting
WO2011016860A1 (en) 2009-08-05 2011-02-10 Firefly Green Technologies Inc. Display systems, illumination devices, light communication systems and related methods
US7889430B2 (en) 2006-05-09 2011-02-15 Ostendo Technologies, Inc. LED-based high efficiency illumination systems for use in projection systems
US7902769B2 (en) 2006-01-20 2011-03-08 Exclara, Inc. Current regulator for modulating brightness levels of solid state lighting
US7906789B2 (en) 2008-07-29 2011-03-15 Seoul Semiconductor Co., Ltd. Warm white light emitting apparatus and back light module comprising the same
US7928565B2 (en) 2004-06-15 2011-04-19 International Business Machines Corporation Semiconductor device with a high thermal dissipation efficiency
US7972030B2 (en) 2007-03-05 2011-07-05 Intematix Corporation Light emitting diode (LED) based lighting systems
US7976205B2 (en) 2005-08-31 2011-07-12 Osram Opto Semiconductors Gmbh Light-emitting module, particularly for use in an optical projection apparatus
US8016443B2 (en) 2008-05-02 2011-09-13 Light Prescriptions Innovators, Llc Remote-phosphor LED downlight
US8022634B2 (en) 2008-02-05 2011-09-20 Intersil Americas Inc. Method and system for dimming AC-powered light emitting diode (LED) lighting systems using conventional incandescent dimmers
US20110248640A1 (en) 2008-09-05 2011-10-13 Petrus Johannes Maria Welten Led based lighting application
US8040070B2 (en) 2008-01-23 2011-10-18 Cree, Inc. Frequency converted dimming signal generation
US8049763B2 (en) 2007-08-13 2011-11-01 Samsung Electronics Co., Ltd. RGB to RGBW color decomposition method and system
US8047660B2 (en) 2005-09-13 2011-11-01 Texas Instruments Incorporated Projection system and method including spatial light modulator and compact diffractive optics
US8061857B2 (en) 2008-11-21 2011-11-22 Hong Kong Applied Science And Technology Research Institute Co. Ltd. LED light shaping device and illumination system
US8076680B2 (en) 2005-03-11 2011-12-13 Seoul Semiconductor Co., Ltd. LED package having an array of light emitting cells coupled in series
US8096668B2 (en) 2008-01-16 2012-01-17 Abu-Ageel Nayef M Illumination systems utilizing wavelength conversion materials
US8214084B2 (en) 2008-10-24 2012-07-03 Ilumisys, Inc. Integration of LED lighting with building controls
US8212494B2 (en) 2008-04-04 2012-07-03 Lemnis Lighting Patents Holding B.V. Dimmer triggering circuit, dimmer system and dimmable device
US8232745B2 (en) 2008-04-14 2012-07-31 Digital Lumens Incorporated Modular lighting systems
US9240111B2 (en) 2010-10-06 2016-01-19 Microsoft Technology Licensing, Llc Inferring building metadata from distributed sensors
US7436887B2 (en) * 2002-02-06 2008-10-14 Playtex Products, Inc. Method and apparatus for video frame sequence-based object tracking
US9094615B2 (en) * 2004-04-16 2015-07-28 Intheplay, Inc. Automatic event videoing, tracking and content generation
EP1766581A4 (en) * 2004-06-14 2010-11-03 Agency Science Tech & Res Method for detecting desired objects in a highly dynamic environment by a monitoring system
US7466244B2 (en) 2005-04-21 2008-12-16 Microsoft Corporation Virtual earth rooftop overlay and bounding
TW200745996A (en) * 2006-05-24 2007-12-16 Objectvideo Inc Intelligent imagery-based sensor
JP4349412B2 (en) * 2006-12-12 2009-10-21 ソニー株式会社 Monitoring device and monitoring method
US9584710B2 (en) * 2008-02-28 2017-02-28 Avigilon Analytics Corporation Intelligent high resolution video system
US9215781B2 (en) * 2008-04-16 2015-12-15 Avo Usa Holding 2 Corporation Energy savings and improved security through intelligent lighting systems
WO2009144707A1 (en) 2008-04-17 2009-12-03 Shilat Optronics Ltd Intrusion warning system
US20110191158A1 (en) 2008-08-20 2011-08-04 Kateraas Espen D Physical activity tracking and rewards allocation system
US8675066B2 (en) 2009-10-02 2014-03-18 Alarm.Com Incorporated Image surveillance and reporting technology
US20140192238A1 (en) * 2010-10-24 2014-07-10 Linx Computational Imaging Ltd. System and Method for Imaging and Image Processing
US8401231B2 (en) 2010-11-09 2013-03-19 Biological Illumination, Llc Sustainable outdoor lighting system for use in environmentally photo-sensitive area
US9137463B2 (en) 2011-05-12 2015-09-15 Microsoft Technology Licensing, Llc Adaptive high dynamic range camera
US8674608B2 (en) 2011-05-15 2014-03-18 Lighting Science Group Corporation Configurable environmental condition sensing luminaire, system and associated methods
US9648284B2 (en) * 2011-05-15 2017-05-09 Lighting Science Group Corporation Occupancy sensor and associated methods
US8515289B2 (en) 2011-11-21 2013-08-20 Environmental Light Technologies Corp. Wavelength sensing lighting system and associated methods for national security application
US9024536B2 (en) 2011-12-05 2015-05-05 Biological Illumination, Llc Tunable LED lamp for producing biologically-adjusted light and associated methods
US8686641B2 (en) 2011-12-05 2014-04-01 Biological Illumination, Llc Tunable LED lamp for producing biologically-adjusted light
US20140015438A1 (en) 2012-05-06 2014-01-16 Lighting Science Group Corporation Tunable light system and associated methods
US8680457B2 (en) 2012-05-07 2014-03-25 Lighting Science Group Corporation Motion detection system and associated methods having at least one LED of second set of LEDs to vary its voltage
US20140296943A1 (en) 2013-03-14 2014-10-02 Biological Illumination, Llc Method for controlling blood glucose levels and digestion cycles
US7845823B2 (en) 1997-08-26 2010-12-07 Philips Solid-State Lighting Solutions, Inc. Controlled lighting methods and apparatus
US7400439B2 (en) 2001-12-14 2008-07-15 Digital Optics International Corporation Uniform illumination system
US7325956B2 (en) 2005-01-25 2008-02-05 Jabil Circuit, Inc. Light-emitting diode (LED) illumination system for a digital micro-mirror device (DMD) and method of providing same
US8070302B2 (en) 2005-05-10 2011-12-06 Iwasaki Electric Co., Ltd. Laminate type light-emitting diode device, and reflection type light-emitting diode unit
US8188687B2 (en) 2005-06-28 2012-05-29 Seoul Opto Device Co., Ltd. Light emitting device for AC power operation
US8115419B2 (en) 2008-01-23 2012-02-14 Cree, Inc. Lighting control device for controlling dimming, lighting device including a control device, and method of controlling lighting
Non-Patent Citations (11)
Digital Image Processing, 3 pages, 2002, Prentice Hall, New Jersey, US.
Intelligent occupancy sensor, pp. 2, Lyrtech Inc., Canada.
International Search Report and Written Opinion for PCT/US2013/027226 dated Nov. 18, 2013.
Motion-based Obstacle Detection and Tracking for Car Driving Assistance, 4 pages, Aug. 2002, IAPR Int. Conf. on Pattern Recognition, Canada.
Tannith Cattermole, "Smart Energy Glass controls light on demand", Gizmag.com, Apr. 18, 2010, accessed Nov. 1, 2011.
U.S. Appl. No. 13/464,292, filed May 4, 2012, Holland et al.
US 4,970,436, Nov. 30, 1990, Sacchetti. (withdrawn).
US 4,992,701, Feb. 12, 1991, Sacchetti. (withdrawn).
USPTO, Notice of Allowance for U.S. Appl. No. 14/615,082, filed Apr. 27, 2016, Application Title-System for Detecting and Analyzing Motion for Pattern Prediction and Associated Methods. (12 Pages).
Video and Vision Guide, 81 pages, 2009, Texas Instruments, Texas, US.
AU2012355879B2 (en) 2016-04-14 Cloud-based video surveillance management system
AU2012340862B2 (en) 2016-12-22 Geographic map based control
CN100504942C (en) 2009-06-24 Module set of intelligent video monitoring device, system and monitoring method
KR101738013B1 (en) 2017-05-19 Particle detection
US20170236293A1 (en) 2017-08-17 Enhanced Contrast for Object Detection and Characterization By Optical Imaging Based on Differences Between Images
US8674608B2 (en) 2014-03-18 Configurable environmental condition sensing luminaire, system and associated methods
US20120044350A1 (en) 2012-02-23 Outdoor lighting fixture and camera systems
US9386281B2 (en) 2016-07-05 Image surveillance and reporting technology
US10304319B2 (en) 2019-05-28 Monitoring and security devices comprising multiple sensors
JP2007507764A (en) 2007-03-29 Image monitoring system and image monitoring method
US9665778B1 (en) 2017-05-30 Virtual sensors
US20090315722A1 (en) 2009-12-24 Multi-wavelength video image fire detecting system
Bangali et al. 2013 Design and Implementation of Security Systems for Smart Home based on GSM technology
CA2851259C (en) 2018-06-12 Smart surveillance camera systems and methods
US9672707B2 (en) 2017-06-06 Virtual enhancement of security monitoring
GB2453902A (en) 2009-04-22 A sensor with selectable sensing orientation used for controlling an electrical device
WO2009099511A1 (en) 2009-08-13 Video sensor and alarm system and method with object and event classification
US7155029B2 (en) 2006-12-26 Method and apparatus of detecting fire by flame imaging
CN101577033A (en) 2009-11-11 Multiband infrared image-type fire detecting system and fire alarm system thereof
US20120092502A1 (en) 2012-04-19 Systems and methods for monitoring presence and movement
CN102621956A (en) 2012-08-01 Intelligent household control system
EP2678841A1 (en) 2014-01-01 Infrared sensor systems and methods
US20060232673A1 (en) 2006-10-19 Video-based human verification system and method
CN103325209A (en) 2013-09-25 Intelligent security alarm system based on wireless
Owner name: LIGHTING SCIENCE GROUP CORPORATION, FLORIDA
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:HOLLAND, ERIC;IRVIN, JULIA SHARON;THOSTESON, ERIC;AND OTHERS;REEL/FRAME:028476/0461
Owner name: FCC, LLC D/B/A FIRST CAPITAL, AS AGENT, GEORGIA
Free format text: SECURITY INTEREST;ASSIGNORS:LIGHTING SCIENCE GROUP CORPORATION;BIOLOGICAL ILLUMINATION, LLC;REEL/FRAME:032765/0910
Owner name: MEDLEY CAPTIAL CORPORATION, AS AGENT, NEW YORK
Owner name: ACF FINCO I LP, NEW YORK
Free format text: ASSIGNMENT AND ASSUMPTION OF SECURITY INTERESTS IN PATENTS;ASSIGNOR:FCC, LLC D/B/A FIRST CAPITAL;REEL/FRAME:035774/0632
Owner name: BIOLOGICAL ILLUMINATION, LLC, A DELAWARE LIMITED L
Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:ACF FINCO I LP, A DELAWARE LIMITED PARTNERSHIP;REEL/FRAME:042340/0471
Owner name: LIGHTING SCIENCE GROUP CORPORATION, A DELAWARE COR
Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:MEDLEY CAPITAL CORPORATION;REEL/FRAME:048018/0515