Object-Based Image Analysis in Wetland Research: A Review <s> The Challenge of Segmentation Parameter Selection <s> This article deals with the development and application of a cartographic database for a synoptic Geographic Information System (GIS). Its purpose is the storage and evaluation of the heterogeneous datasets of the interdisciplinary scientific research program MADAM (Mangrove Dynamics and Management), which aims to develop recommendations for a tailored integrated coastal management scheme for the mangrove ecosystem at Braganca (North Brazil). The article describes the integration of remote sensing data, aerial photographs, as well as point data provided by fieldwork from different scientific fields. Using various innovative processing techniques and different scale-resolution levels, an assessment of temporal–spatial changes of the mangrove peninsula and the adjacent rural socioeconomic impact area, the type of mangrove structure, as well as a land-use cover analyses was undertaken. The definition of the spatial level of detail was found to be a major issue in the development of the GIS, as well as during the processing and analysis procedures. A division between strong and weak patterns in the mangrove ecosystem could be made, which implies different management measures and sets of specific interdisciplinary studies and monitoring at hierarchical scales. <s> BIB001 </s> Object-Based Image Analysis in Wetland Research: A Review <s> The Challenge of Segmentation Parameter Selection <s> (Studies on greenhouse gases (GHG) emitted by hydroelectric reservoirs have shown until now that the fate of carbon, following impoundment, seems to reach the fate of carbon in natural aquatic ecosystems after a decade or so. To adequately assess this assumption and then obtain the net GHG emissions from the Eastmain-1 hydroelectric reservoir, the carbon stock and GHG emissions from peatlands and different succession stages of forested areas need to be characterized prior to the reservoir impoundment. It is therefore important to characterize the carbon flow process (surface fluxes and sequestrated carbon) from these terrestrial systems prior to impoundment. The Canadian Wildlife Service of Environment Canada, Quebec region, has developed an approach for mapping wetlands using Landsat/RADARSAT-1 satellite images. The method is based on image segmentation using the Definiens Professional software. The top-down object-based classification is based on the Canadian Wetland Classification System and quickly an... <s> BIB002 </s> Object-Based Image Analysis in Wetland Research: A Review <s> The Challenge of Segmentation Parameter Selection <s> The spatial resolution of imaging sensors has increased dramatically in recent years, and so too have the challenges associated with extracting meaningful information from their data products. Object-based image analysis (OBIA) is gaining rapid popularity in remote sensing science as a means of bridging very high spatial resolution (VHSR) imagery and GIS. Multiscalar image segmentation is a fundamental step in OBIA, yet there is currently no tool available to objectively guide the selection of appropriate scales for segmentation. We present a technique for estimating the scale parameter in image segmentation of remotely sensed data with Definiens Developer®. The degree of heterogeneity within an image-object is controlled by a subjective measure called the 'scale parameter', as implemented in the mentioned software. We propose a tool, called estimation of scale parameter (ESP), that builds on the idea of local variance (LV) of object heterogeneity within a scene. The ESP tool iteratively generates image-objects at multiple scale levels in a bottom-up approach and calculates the LV for each scale. Variation in heterogeneity is explored by evaluating LV plotted against the corresponding scale. The thresholds in rates of change of LV (ROC-LV) indicate the scale levels at which the image can be segmented in the most appropriate manner, relative to the data properties at the scene level. Our tests on different types of imagery indicated fast processing times and accurate results. The simple yet robust ESP tool enables fast and objective parametrization when performing image segmentation and holds great potential for OBIA applications. <s> BIB003 </s> Object-Based Image Analysis in Wetland Research: A Review <s> The Challenge of Segmentation Parameter Selection <s> Abstract Landslide inventory mapping is an indispensable prerequisite for reliable hazard and risk analysis, and with the increasing availability of very high resolution (VHR) remote sensing imagery the creation and updating of such inventories on regular bases and directly after major events is becoming possible. The diversity of landslide processes and spectral similarities of affected areas with other landscape elements pose major challenges for automated image processing, and time-consuming manual image interpretation and field surveys are still the most commonly applied mapping techniques. Taking advantage of recent advances in object-oriented image analysis (OOA) and machine learning algorithms, a supervised workflow is proposed in this study to reduce manual labor and objectify the choice of significant object features and classification thresholds. A sequence of image segmentation, feature selection, object classification and error balancing was developed and tested on a variety of sample datasets (Quickbird, IKONOS, Geoeye-1, aerial photographs) of four sites in the northern hemisphere recently affected by landslides (Haiti, Italy, China, France). Besides object metrics, such as band ratios and slope, newly introduced topographically-guided texture measures were found to enhance significantly the classification, and also feature selection revealed positive influence on the overall performance. With an iterative procedure to examine the class-imbalance within the training sample it was furthermore possible to compensate spurious effects of class-imbalance and class-overlap on the balance of the error rates. Employing approximately 20% of the data for training, the proposed workflow resulted in accuracies between 73% and 87% for the affected areas, and approximately balanced commission and omission errors. <s> BIB004 </s> Object-Based Image Analysis in Wetland Research: A Review <s> The Challenge of Segmentation Parameter Selection <s> Image segmentation is a preliminary and critical step in object-based image classification. Its proper evaluation ensures that the best segmentation is used in image classification. In this article, image segmentations with nine different parameter settings were carried out with a multi-spectral Landsat imagery and the segmentation results were evaluated with an objective function that aims at maximizing homogeneity within segments and separability between neighbouring segments. The segmented images were classified into eight land-cover classes and the classifications were evaluated with independent ground data comprising 600 randomly distributed points. The accuracy assessment results presented similar distribution as that of the objective function values, that is segmentations with the highest objective function values also resulted in the highest classification accuracies. This result shows that image segmentation has a direct effect on the classification accuracy; the objective function not only worked on a single band image as proved by (Espindola, G.M., Camara, G., Reis, I.A., Bins, L.S. and Monteiro, A.M., 2006, Parameter selection for region-growing image segmentation algorithms using spatial autocorrelation. International Journal of Remote Sensing, 27, pp. 3035-3040.) but also on multi-spectral imagery as tested in this, and is indeed an effective way to determine the optimal segmentation parameters. McNemar's test (z2 = 10.27) shows that with the optimal segmentation, object-based classification achieved accuracy significantly higher than that of the pixel-based classification, with 99% significance level. <s> BIB005 </s> Object-Based Image Analysis in Wetland Research: A Review <s> The Challenge of Segmentation Parameter Selection <s> This study used geographic object-based image analysis (GEOBIA) with very high spatial resolution (VHR) aerial imagery (0.3 m spatial resolution) to classify vegetation, channel and bare mud classes in a salt marsh. Three classification issues were investigated in the context of segmentation scale: (1) a comparison of single-and multi-scale GEOBIA using spectral bands, (2) the relative benefit of incorporating texture derived from the grey-level co-occurrence matrix (GLCM) in classifying the salt marsh features in single-and multi-scale GEOBIA and (3) the effect of quantization level of GLCM texture in the context of multi-scale GEOBIA. The single-scale GEOBIA experiments indicated that the optimal segmentation was both class and scale dependent. Therefore, the single-scale approach produced an only moderately accurate classification for all marsh classes. A multi-scale approach, however, facilitated the use of multiple scales that allowed the delineation of individual classes with increased between-class and reduced within-class spectral variation. With only spectral bands used, the multi-scale approach outperformed the single-scale GEOBIA with an overall accuracy of 82% vs. 76% (Kappa of 0.71 vs. 0.62). The study demonstrates the potential importance of ancillary data, GLCM texture, to compensate for limited between-class spectral discrimination. For example, gains in classification accuracies ranged from 3% to 12% when the GLCM mean texture was included in the multi-scale GEOBIA. The multi-scale classification overall accuracy varied with quantization level of the GLCM texture matrix. A quantization level of 2 reduced misclassifications of channel and bare mud and generated a statistically higher classification than higher quantization levels. Overall, the multi-scale GEOBIA produced the highest classification accuracy. The multi-scale GEOBIA is expected to be a useful methodology for creating a seamless spatial database of marsh landscape features to be used for further geographic information system (GIS) analyses. <s> BIB006 </s> Object-Based Image Analysis in Wetland Research: A Review <s> The Challenge of Segmentation Parameter Selection <s> To detect landslides by object-based image analysis using criteria based on shape, color, texture, and, in particular, contextual information and process knowledge, candidate segments must be delineated properly. This has proved challenging in the past, since segments are mainly created using spectral and size criteria that are not consistent for landslides. This paper presents an approach to select objectively parameters for a region growing segmentation technique to outline landslides as individual segments and also addresses the scale dependence of landslides and false positives occurring in a natural landscape. Multiple scale parameters were determined using a plateau objective function derived from the spatial autocorrelation and intrasegment variance analysis, allowing for differently sized features to be identified. While a high-resolution Resourcesat-1 Linear Imaging and Self Scanning Sensor IV (5.8 m) multispectral image was used to create segments for landslide recognition, terrain curvature derived from a digital terrain model based on Cartosat-1 (2.5 m) data was used to create segments for subsequent landslide classification. Here, optimal segments were used in a knowledge-based classification approach with the thresholds of diagnostic parameters derived from If-means cluster analysis, to detect landslides of five different types, with an overall recognition accuracy of 76.9%. The approach, when tested in a geomorphologically dissimilar area, recognized landslides with an overall accuracy of 77.7%, without modification to the methodology. The multiscale classification-based segment optimization procedure was also able to reduce the error of commission significantly in comparison to a single-optimal-scale approach. <s> BIB007 </s> Object-Based Image Analysis in Wetland Research: A Review <s> The Challenge of Segmentation Parameter Selection <s> Accurate and informative vegetation maps are in urgent demand to support the Kissimmee-Okeechobee-Everglades ecosystem restoration project in South Florida. In this study, we evaluated the applicability of fine spatial resolution hyperspectral data collected from the HyMap sensor for both community- and species-level vegetation mapping. Informative and accurate vegetation maps were produced by combining machine learning methods (Support Vector Machines (SVM) and Random Forest (RF)), object-based image analysis techniques, and Minimum Noise Fraction (MNF) data transformation. An overall accuracy of 90% was obtained in discriminating 14 vegetation communities. Classification of a large number of species is also promising. An overall accuracy of 85% was achieved in identifying 55 species using a SVM model. The results indicate that fine spatial resolution hyperspectral data classification using such automated procedure has great potential to replace the manual interpretation of aerial photos for vegetation mapping in heterogeneous wetland ecosystems. <s> BIB008 </s> Object-Based Image Analysis in Wetland Research: A Review <s> The Challenge of Segmentation Parameter Selection <s> Abstract Remote sensing-based analyses of vegetation function such as photosynthesis and productivity are challenging in wetlands with complex cover and difficult field access. Recent advances in object-based image analysis (OBIA) and machine-learning algorithms offer new image classification tools; however, few comparisons of different approaches have been discussed to date. We applied OBIA to delineate wetland plant functional types (PFTs) for Poyang Lake, the largest freshwater lake in China and Ramsar wetland conservation site, from a spring 2008 Landsat TM image. We targeted major PFTs that represent dominant vegetation groups along wetland inundation gradients and affect ecosystem biogeochemical cycles and ecological habitats. Classification results were compared among: a) several “small” object segmentation scales (with average object sizes 1350–9000 m 2 ); b) algorithms from six families of statistical machine-learning classifiers (Bayesian, Logistic, Neural Network, Decision Trees, K-Nearest Neighbors and Support Vector Machines) and c) two hierarchical levels of vegetation classification, a generalized 3-class set and a more specific 6-class set. We also examined the response of classification accuracy to four basic object-level texture metrics. The highest accuracies (> 85–90%) and best agreement among algorithms occurred at coarser object scales rather than close-to-pixel scales. No single machine-learning algorithm was consistently superior at all scales, although support vector machine, k-nearest neighbor and artificial neural network most frequently provided the highest overall and PFT-specific accuracies. Including texture metrics had both positive and negative low-magnitude effects on classification accuracy that were not consistent among scale values, algorithms or PFT classes. Individual PFTs differed in scales at which they were best discriminated from others, reflecting their unique landscape positions, ecology of dominant species and disturbance agents. There was a 29–35% disagreement between mapped areas of generalized PFTs and their respective subclasses, suggesting potential mismatches between the ecological classification scheme and PFT landscape patch structure, and raising concern on error propagation in multi-scale classifications. We conclude that OBIA with machine-learning classifiers is useful for landscape vegetation analyses, however, considerations of spatial scale and image segmentation outcomes are critical in mapping PFTs and should be more thoroughly investigated in future work. <s> BIB009 </s> Object-Based Image Analysis in Wetland Research: A Review <s> The Challenge of Segmentation Parameter Selection <s> article i nfo An informative and accurate vegetation map for the Greater Everglades of South Florida is in an urgent need to assist with the Comprehensive Everglades Restoration Plan (CERP), a $10.5-billion mission to restore the south Florida ecosystem in 30+ years. In this study, we examined the capability of fine spatial resolution hyperspectral imagery collected from Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) for vegeta- tion mapping in the Everglades. In order to obtain an efficient and accurate procedure for vegetation discrim- ination, we developed a neural network classifier first and then combined the object-based texture measures with the classifier to examine the contribution of the spatial information for vegetation mapping. The neural network is capable of modeling the characteristics of multiple spectral and spatial signatures within a class by an internally unsupervised engine and characterizing spectral and spatial differences between classes by an externally supervised system. The designed procedure was tested in a portion of the Everglades. An object- based vegetation map was generated with an overall classification accuracy averaged 94% and a kappa value averaged 0.94 in discriminating 15 classes. The results are significantly better than those obtained from conventional classifiers such as maximum likelihood and spectral angle mapper. The study illustrates that combining object-based texture measures in the neural network classifier can significantly improve the classification. It is concluded that fine spatial resolution hyperspectral data is an effective solution to ac- curate vegetation mapping in the Everglades which has a rich plant community with a high degree of spatial and spectral heterogeneity. <s> BIB010 </s> Object-Based Image Analysis in Wetland Research: A Review <s> The Challenge of Segmentation Parameter Selection <s> Mapping landscape features within wetlands using remote-sensing imagery is a persistent challenge due to the fine scale of wetland pattern variation and the low spectral contrast among plant species. Object-based image analysis OBIA is a promising approach for distinguishing wetland features, but systematic guidance for this use of OBIA is not presently available. A sensitivity analysis was tested using OBIA to distinguish vegetation zones, vegetation patches, and surface water channels in two intertidal salt marshes in southern San Francisco Bay. Optimal imagery sources and OBIA segmentation settings were determined from 348 sensitivity tests using the eCognition multiresolution segmentation algorithm. The optimal high-resolution ≤1 m imagery choices were colour infrared CIR imagery to distinguish vegetation zones, CIR or red, green, blue RGB imagery to distinguish vegetation patches depending on species and season, and RGB imagery to distinguish surface water channels. High-resolution 1 m lidar data did not help distinguish small surface water channels or other features. Optimal segmentation varied according to segmentation setting choices. Small vegetation patches and narrow channels were more recognizable using small scale parameter settings and coarse vegetation zones using larger scale parameter settings. The scale parameter served as a de facto lower bound to median segmented object size. Object smoothness/compactness weight settings had little effect. Wetland features were more recognizable using high colour/low shape weight settings. However, an experiment on a synthetic non-wetland image demonstrated that, colour information notwithstanding, segmentation results are still strongly affected by the selected image resolution, OBIA settings, and shape of the analysis region. Future wetland OBIA studies may benefit from strategically making imagery and segmentation setting choices based on these results; such systemization of future wetland OBIA approaches may also enhance study comparability. <s> BIB011 </s> Object-Based Image Analysis in Wetland Research: A Review <s> The Challenge of Segmentation Parameter Selection <s> We introduce a new automated approach to parameterising multi-scale image segmentation of multiple layers, and we implemented it as a generic tool for the eCognition® software. This approach relies on the potential of the local variance (LV) to detect scale transitions in geospatial data. The tool detects the number of layers added to a project and segments them iteratively with a multiresolution segmentation algorithm in a bottom-up approach, where the scale factor in the segmentation, namely, the scale parameter (SP), increases with a constant increment. The average LV value of the objects in all of the layers is computed and serves as a condition for stopping the iterations: when a scale level records an LV value that is equal to or lower than the previous value, the iteration ends, and the objects segmented in the previous level are retained. Three orders of magnitude of SP lags produce a corresponding number of scale levels. Tests on very high resolution imagery provided satisfactory results for generic applicability. The tool has a significant potential for enabling objectivity and automation of GEOBIA analysis. <s> BIB012
Segmentation is the key first step in many OBIA analyses, and its outcomes have strong implications on subsequent accuracy and interpretability of results. At present, there is no clear standard for pre-classification assessment of segmentation effects on the final outcomes in either wetlands or other heterogeneous landscapes. In fact, among the reviewed studies, relatively little justification was provided for the choice of segmentation metrics, with trial and error being a common approach, a concern previously discussed in BIB011 . Simultaneous testing all of the possible segmentation parameters (e.g., combinations of input bands and their weights, scale, compactness, shape, spectral thresholds or all of these) is a complicated task and, regrettably, still not a common practice in OBIA studies. Furthermore, different types of ground objects may be more effectively highlighted with different values of segmentation parameters BIB011  , which also complicates the decision about the "optimal" segmentation across multiple research objectives. A notable example of an objective supervised workflow was demonstrated in a non-wetland OBIA application to landslide mapping BIB004 , where multiple segmentation levels were first assessed in terms of their effects on class separability, and then a variable importance measure based on random forests machine-learning method was quantified to select the most informative object attributes for distinguishing landslides. Several wetland studies also explored specific quantitative and qualitative criteria to determine segmentation parameters while avoiding superfluous subjectivity. These strategies included metrics of within-object homogeneity and spectral contrast to neighbors to determine the scale of primitive objects  BIB002 , approaches based on local spatial autocorrelation measured by Moran's I of the spectral values BIB008 , also used to optimize segmentation in non-wetland analyses BIB005 , and a set of ranked visual criteria used in BIB011 to compare segmentations' ability to recover known wetland objects (such as patches, channels and tidal zones). Both these and other studies using trial and error often concluded that spectral information was more important in wetland object delineation than shape, and that smoothness and compactness criteria affected the outcome much less strongly than spectral properties. Segmentation parameters greatly varied among all studies. Although the peaks in classification accuracy at certain object scale were sometimes used to identify important spatial scales in wetlands BIB006 BIB009 , there is a growing consensus that diverse landscape classes may not be always adequately characterized at a single segmentation level BIB009 BIB011 BIB003 BIB012 . For instance, in the study of wetland plant functional types in BIB009 , more narrowly defined plant classes at lower hierarchical level differed in segmentation scales which maximized their individual accuracies. Similarly, in BIB006 class-specific accuracies of vegetation, water channels and mud reached maximum values at different segmentation scales, and those typically did not match the maximum scale of the overall accuracy. These results suggest that searching for a single "optimal" segmentation may not be a productive goal in complex landscapes, and instead call for new methods to determine and test hierarchical sets of ecologically relevant and spatially linked object levels BIB001 BIB010 . Examples of such methods that should be more rigorously explored in wetlands may include the abovementioned ESP tool for eCognition BIB003 BIB012 and the Plateau Objective Function (POF) in BIB007 based on spatial autocorrelation and within-object variance, which identified segmentation parameters suitable for capturing different-sized landscape features in a complex terrain.