Autonomous crop monitoring at high spatial and temporal resolution is a critical problem in precision agriculture. While Structure from Motion and Multi-View Stereo algorithms can finely reconstruct the 3D structure of a field with low-cost image sensors, these algorithms fail to capture the dynamic nature of continuously growing crops. In this paper we propose a 4D reconstruction approach to crop monitoring, which employs a spatio-temporal model of dynamic scenes that is useful for precision agriculture applications. Additionally, we provide a robust data association algorithm to address the problem of large appearance changes due to scenes being viewed from different angles at different points in time, which is critical to achieving 4D reconstruction. Finally, we collected a high quality dataset with ground truth statistics to evaluate the performance of our method. We demonstrate that our 4D reconstruction approach provides models that are qualitatively correct with respect to visual appearance and quantitatively accurate when measured against the ground truth geometric properties of the monitored crops.
Automated crop monitoring is a key problem in precision agriculture, used to maximize crop yield while minimizing cost and environmental impact. Traditional crop monitoring techniques are based on measurements by human operators, which is both expensive and labor intensive. Early work on automated crop monitoring mainly relies on satellite imagery @cite_45 , which is expensive and lacks sufficient resolution in both space and time. Recently, crop monitoring with Unmanned Aerial Vehicles (UAVs) @cite_27 @cite_42 @cite_16 @cite_37 @cite_40 and ground vehicles @cite_24 @cite_14 @cite_48 @cite_33 has garnered interest from both agricultural and robotics communities due to the abilities of these systems to gather large quantities of data with high spatial and temporal resolution.
@cite_37 @cite_14 @cite_33 @cite_48 @cite_42 @cite_24 @cite_27 @cite_45 @cite_40 @cite_16
2615516218 2586545389 2754006806 1659349535
Abstract Precision agriculture (PA) utilizes tools and technologies to identify in-field soil and crop variability for improving farming practices and optimizing agronomic inputs. Traditionally, optical remote sensing (RS) that utilizes visible light and infrared regions of the electromagnetic spectrum has been used as an integral part of PA for crop and soil monitoring. Optical RS, however, is slow in differentiating stress levels in crops until visual symptoms become noticeable. Surface temperature is considered to be a rapid response variable that can indicate crop stresses prior to their visual symptoms. By measuring estimates of surface temperature, thermal RS has been found to be a promising tool for PA. Compared to optical RS, applications of thermal RS for PA have been limited. Until recently (i.e., before the advancement of low cost RS platforms such as unmanned aerial systems (UAVs)), the availability of high resolution thermal images was limited due to high acquisition costs. Given recent developments in UAVs, thermal images with high spatial and temporal resolutions have become available at a low cost, which has increased opportunities to understand in-field variability of crop and soil conditions useful for various agronomic decision-making. Before thermal RS is adopted as a routine tool for crop and environmental monitoring, there is a need to understand its current and potential applications as well as issues and concerns. This review focuses on current and potential applications of thermal RS in PA as well as some concerns relating to its application. The application areas of thermal RS in agriculture discussed here include irrigation scheduling, drought monitoring, crop disease detection, and mapping of soil properties, residues and tillage, field tiles, and crop maturity and yield. Some of the issues related to its application include spatial and temporal resolution, atmospheric conditions, and crop growth stages. In this paper we present a perception system for agriculture robotics that enables an unmanned ground vehicle (UGV) equipped with a multi spectral camera to automatically perform the crop weed detection and classification tasks in real-time. Our approach exploits a pipeline that includes two different convolutional neural networks (CNNs) applied to the input RGB+near infra-red (NIR) images. A lightweight CNN is used to perform a fast and robust, pixel-wise, binary image segmentation, in order to extract the pixels that represent projections of 3D points that belong to green vegetation. A deeper CNN is then used to classify the extracted pixels between the crop and weed classes. A further important contribution of this work is a novel unsupervised dataset summarization algorithm that automatically selects from a large dataset the most informative subsets that better describe the original one. This enables to streamline and speed-up the manual dataset labeling process, otherwise extremely time consuming, while preserving good classification performance. Experiments performed on different datasets taken from a real farm robot confirm the effectiveness of our approach. Agricultural robots are expected to increase yields in a sustainable way and automate precision tasks, such as weeding and plant monitoring. At the same time, they move in a continuously changing, semi-structured field environment, in which features can hardly be found and reproduced at a later time. Challenges for Lidar and visual detection systems stem from the fact that plants can be very small, overlapping and have a steadily changing appearance. Therefore, a popular way to localize vehicles with high accuracy is based on ex- pensive global navigation satellite systems and not on natural landmarks. The contribution of this work is a novel image- based plant localization technique that uses the time-invariant stem emerging point as a reference. Our approach is based on a fully convolutional neural network that learns landmark localization from RGB and NIR image input in an end-to-end manner. The network performs pose regression to generate a plant location likelihood map. Our approach allows us to cope with visual variances of plants both for different species and different growth stages. We achieve high localization accuracies as shown in detailed evaluations of a sugar beet cultivation phase. In experiments with our BoniRob we demonstrate that detections can be robustly reproduced with centimeter accuracy. Addressing the challenges of feeding the burgeoning world population with limited resources requires innovation in sustainable, efficient farming. The practice of precision agriculture offers many benefits towards addressing these challenges, such as improved yield and efficient use of such resources as water, fertilizer and pesticides. We describe the design and development of a light-weight, multi-spectral 3D imaging device that can be used for automated monitoring in precision agriculture. The sensor suite consists of a laser range scanner, multi-spectral cameras, a thermal imaging camera, and navigational sensors. We present techniques to extract four key data products — plant morphology, canopy volume, leaf area index, and fruit counts — using the sensor suite. We demonstrate its use with two systems: multi-rotor micro aerial vehicles and on a human-carried, shoulder-mounted harness. We show results of field experiments conducted in collaboration with growers and agronomists in vineyards, apple orchards and orange groves.