Abstract The autoencoder is an artificial neural network that performs nonlinear dimension reduction and learns hidden representations of unlabeled data. With a linear transfer function it is similar to the principal component analysis (PCA). While both methods use weight vectors for linear transformations, the autoencoder does not come with any indication similar to the eigenvalues in PCA that are paired with eigenvectors. We propose a novel autoencoder node saliency method that examines whether the features constructed by autoencoders exhibit properties related to known class labels. The supervised node saliency ranks the nodes based on their capability of performing a learning task. It is coupled with the normalized entropy difference (NED). We establish a property for NED values to verify classifying behaviors among the top ranked nodes. By applying our methods to real datasets, we demonstrate their ability to provide indications on the performing nodes and explain the learned tasks in autoencoders.
The analysis of histograms on signals has been applied for finding useful (interesting) relationships that look far from random, describing the state of the system and then, possibly, detecting faulty operation. The consensus self-organizing models (COSMO) approach @cite_36 has been used for detecting faults on vehicle fleets. Comparing signals based on histograms displays a success in handling deviations in real data @cite_40 . Analyses of signal interestingness'' using histograms contribute to autonomous knowledge discovery for fault detection @cite_21 . These approaches are used in engineering problems and not yet applied to analyzing neural networks.
@cite_36 @cite_40 @cite_21
2069441514 2500146460 2750352083
Methods for equipment monitoring are traditionally constructed from specific sensors and or knowledge collected prior to implementation on the equipment. A different approach is presented here that builds up knowledge over time by exploratory search among the signals available on the internal field bus system and comparing the observed signal relationships among a group of equipment that perform similar tasks. The approach is developed for the purpose of increasing vehicle uptime, and is therefore demonstrated in the case of a city bus and a heavy duty truck. However, it also works fine for smaller mechatronic systems like computer hard-drives. The approach builds on an onboard self-organized search for models that capture relations among signal values on the vehicles' data buses, combined with a limited bandwidth telematics gateway and an off-line server application where the parameters of the self-organized models are compared. The presented approach represents a new look at error detection in commercial mechatronic systems, where the normal behavior of a system is actually found under real operating conditions, rather than the behavior observed in a number of laboratory tests or test-drives prior to production of the system. The approach has potential to be the basis for a self-discovering system for general purpose fault detection and diagnostics. Modern vehicles have increasing amounts of data streaming continuously on-board their controller area networks. These data are primarily used for controlling the vehicle and for feedback to the dri ... An approach for intelligent monitoring of mobile cyberphysical systems is described, based on consensus among distributed self-organised agents. Its usefulness is experimentally demonstrated over a long-time case study in an example domain: a fleet of city buses. The proposed solution combines several techniques, allowing for life-long learning under computational and communication constraints. The presented work is a step towards autonomous knowledge discovery in a domain where data volumes are increasing, the complexity of systems is growing, and dedicating human experts to build fault detection and diagnostic models for all possible faults is not economically viable. The embedded, self-organised agents operate on-board the cyberphysical systems, modelling their states and communicating them wirelessly to a back-office application. Those models are subsequently compared against each other to find systems which deviate from the consensus. In this way the group (e.g., a fleet of vehicles) is used to provide a standard, or to describe normal behaviour, together with its expected variability under particular operating conditions. The intention is to detect faults without the need for human experts to anticipate them beforehand. This can be used to build up a knowledge base that accumulates over the life-time of the systems. The approach is demonstrated using data collected during regular operation of a city bus fleet over the period of almost 4 years.