Monitoring small objects against cluttered moving backgrounds is a huge challenge to future robotic vision systems. As a source of inspiration, insects are quite apt at searching for mates and tracking prey, which always appear as small dim speckles in the visual field. The exquisite sensitivity of insects for small target motion, as revealed recently, is coming from a class of specific neurons called small target motion detectors (STMDs). Although a few STMD-based models have been proposed, these existing models only use motion information for small target detection and cannot discriminate small targets from small-target-like background features (named fake features). To address this problem, this paper proposes a novel visual system model (STMD+) for small target motion detection, which is composed of four subsystems--ommatidia, motion pathway, contrast pathway, and mushroom body. Compared with the existing STMD-based models, the additional contrast pathway extracts directional contrast from luminance signals to eliminate false positive background motion. The directional contrast and the extracted motion information by the motion pathway are integrated into the mushroom body for small target discrimination. Extensive experiments showed the significant and consistent improvements of the proposed visual system model over the existing STMD-based models against fake features.
Small target motion detectors (STMDs) @cite_4 @cite_5 @cite_2 and lobula plate tangential cells (LPTCs) @cite_51 @cite_37 are widely investigated motion-sensitive neurons, where the former shows exquisite sensitivity to small target motion while the latter responds strongly to wide-field motion. Wiederman @cite_29 presented a mathematical model called ESTMD to simulate STMD neurons. It can detect the presence of small moving targets, but is unable to estimate motion direction. To address this issue, directional selectivity has been introduced into the ESTMD @cite_10 @cite_33 @cite_30 . However, these models cannot discriminate small targets from fake features, as they only make use of motion information. The first LPTC model called elementary motion detector (EMD) @cite_52 , is originally inferred from the insects' behavior. Following that, several studies have been done to further improve the EMD, such as @cite_3 @cite_23 @cite_19 . These models can detect all objects' motion, nevertheless they are unable to distinguish small moving objects from large ones.
@cite_30 @cite_37 @cite_4 @cite_33 @cite_10 @cite_29 @cite_52 @cite_3 @cite_19 @cite_23 @cite_2 @cite_5 @cite_51
2964275094 2963474154 1999508425 1975147998
A class of specialized neurons, called lobula plate tangential cells (LPTCs) has been shown to respond strongly to wide-field motion. The classic model, elementary motion detector (EMD) and its improved model, two-quadrant detector (TQD) have been proposed to simulate LPTCs. Although EMD and TQD can percept background motion, their outputs are so cluttered that it is difficult to discriminate actual motion direction of the background. In this paper, we propose a max operation mechanism to model a newly-found transmedullary neuron Tm9 whose physiological properties do not map onto EMD and TQD. This proposed max operation mechanism is able to improve the detection performance of TQD in cluttered background by filtering out irrelevant motion signals. We will demonstrate the functionality of this proposed mechanism in wide-field motion perception. Discriminating targets moving against a cluttered background is a huge challenge, let alone detecting a target as small as one or a few pixels and tracking it in flight. In the insect's visual system, a class of specific neurons, called small target motion detectors (STMDs), have been identified as showing exquisite selectivity for small target motion. Some of the STMDs have also demonstrated direction selectivity which means these STMDs respond strongly only to their preferred motion direction. Direction selectivity is an important property of these STMD neurons which could contribute to tracking small targets such as mates in flight. However, little has been done on systematically modeling these directionally selective STMD neurons. In this paper, we propose a directionally selective STMD-based neural network for small target detection in a cluttered background. In the proposed neural network, a new correlation mechanism is introduced for direction selectivity via correlating signals relayed from two pixels. Then, a lateral inhibition mechanism is implemented on the spatial field for size selectivity of the STMD neurons. Finally, a population vector algorithm is used to encode motion direction of small targets. Extensive experiments showed that the proposed neural network not only is in accord with current biological findings, i.e., showing directional preferences but also worked reliably in detecting the small targets against cluttered backgrounds. We present a computational model for target discrimination based on intracellular recordings from neurons in the fly visual system. Determining how insects detect and track small moving features, often against cluttered moving backgrounds, is an intriguing challenge, both from a physiological and a computational perspective. Previous research has characterized higher-order neurons within the fly brain, known as ‘small target motion detectors’ (STMD), that respond robustly to moving features, even when the velocity of the target is matched to the background (i.e. with no relative motion cues). We recorded from intermediate-order neurons in the fly visual system that are well suited as a component along the target detection pathway. This full-wave rectifying, transient cell (RTC) reveals independent adaptation to luminance changes of opposite signs (suggesting separate ON and OFF channels) and fast adaptive temporal mechanisms, similar to other cell types previously described. From this physiological data we have created a numerical model for target discrimination. This model includes nonlinear filtering based on the fly optics, the photoreceptors, the 1st order interneurons (Large Monopolar Cells), and the newly derived parameters for the RTC. We show that our RTC-based target detection model is well matched to properties described for the STMDs, such as contrast sensitivity, height tuning and velocity tuning. The model output shows that the spatiotemporal profile of small targets is sufficiently rare within natural scene imagery to allow our highly nonlinear ‘matched filter’ to successfully detect most targets from the background. Importantly, this model can explain this type of feature discrimination without the need for relative motion cues. The lobula giant movement detector (LGMD) neuron of locusts has been shown to preferentially respond to objects approaching the eye of a locust on a direct collision course. Computer simulations of the neuron have been developed and have demonstrated the ability of mobile robots, interfaced with a simulated LGMD model, to avoid collisions. In this study, a model of the LGMD neuron is presented and the functional parameters of the model identified. Models with different parameters were presented with a range of automotive video sequences, including collisions with cars. The parameters were optimised to respond correctly to the video sequences using a range of genetic algorithms (GAs). The model evolved most rapidly using GAs with high clone rates into a form suitable for detecting collisions with cars and not producing false collision alerts to most non-collision scenes.