The work presented here applies deep learning to the task of automated cardiac auscultation, i.e. recognizing abnormalities in heart sounds. We describe an automated heart sound classification algorithm that combines the use of time-frequency heat map representations with a deep convolutional neural network (CNN). Given the cost-sensitive nature of misclassification, our CNN architecture is trained using a modified loss function that directly optimizes the trade-off between sensitivity and specificity. We evaluated our algorithm at the 2016 PhysioNet Computing in Cardiology challenge where the objective was to accurately classify normal and abnormal heart sounds from single, short, potentially noisy recordings. Our entry to the challenge achieved a final specificity of 0.95, sensitivity of 0.73 and overall score of 0.84. We achieved the greatest specificity score out of all challenge entries and, using just a single CNN, our algorithm differed in overall score by only 0.02 compared to the top place finisher, which used an ensemble approach.
Similar deep learning efforts that process physiologic time series have also been applied to the problems of epileptic seizure prediction @cite_15 and human activity recognition @cite_25 .
@cite_15 @cite_25
2138190513 2019664149 2809868225 2084174584 2735895797 2085413319 2129309861 1498932870 2490215499 2794501960 2555125760 2584043716 2549100242 2805290054 2952084263 2053744708 2288074780 1846473900 2192598490 2604594744
We present and evaluate a machine learning approach to constructing patient-specific classifiers that detect the onset of an epileptic seizure through analysis of the scalp EEG, a non-invasive measure of the brain's electrical activity. This problem is challenging because the brain's electrical activity is composed of numerous classes with overlapping characteristics. The key steps involved in realizing a high performance algorithm included shaping the problem into an appropriate machine learning framework, and identifying the features critical to separating seizure from other types of brain activity. When trained on 2 or more seizures per patient and tested on 916 hours of continuous EEG from 24 patients, our algorithm detected 96 of 173 test seizures with a median detection delay of 3 seconds and a median false detection rate of 2 false detections per 24 hour period. We also provide information about how to download the CHB-MIT database, which contains the data used in this study. Abstract This article addresses the problem of real-time seizure detection from intracranial EEG (IEEG). One difficulty in creating an approach that can be used for many patients is the heterogeneity of seizure IEEG patterns across different patients and even within a patient. In addition, simultaneously maximizing sensitivity and minimizing latency and false detection rates has been challenging as these are competing objectives. Automated machine learning systems provide a mechanism for dealing with these hurdles. Here we present and evaluate an algorithm for real-time seizure onset detection from IEEG using a machine-learning approach that permits a patient-specific solution. We extract temporal and spectral features across all intracranial EEG channels. A pattern recognition component is trained using these feature vectors and tested against unseen continuous data from the same patient. When tested on more than 875 hours of IEEG data from 10 patients, the algorithm detected 97 of 67 test seizures of several types with a median detection delay of 5 seconds and a median false alarm rate of 0.6 false alarms per 24-hour period. The sensitivity was 100 for 8 of 10 patients. These results indicate that a sensitive, specific, and relatively short-latency detection system based on machine learning can be employed for seizure detection from EEG using a full set of intracranial electrodes to individual patients. This article is part of a Supplemental Special Issue entitled The Future of Automated Seizure Detection and Prediction. Objective: Synchronization phenomena of epileptic electroencephalography (EEG) have long been studied. In this study, we aim at investigating the spatial-temporal synchronization pattern in epileptic human brains using the spectral graph theoretic features extracted from scalp EEG and developing an efficient multivariate approach for detecting seizure onsets in real time. Methods: A complex network model is used for representing the recurrence pattern of EEG signals, based on which the temporal synchronization patterns are quantified using the spectral graph theoretic features. Furthermore, a statistical control chart is applied to the extracted features overtime for monitoring the transits from normal to epileptic states in multivariate EEG systems. Results: Our method is tested on 23 patients from CHB-MIT Scalp EEG database. The results show that the graph theoretic feature yields a high sensitivity ( @math 98 ) and low latency ( @math 6 s) on average, and seizure onsets in 18 patients are 100 detected. Conclusion: Our approach validates the increased temporal synchronization in epileptic EEG and achieves a comparable detection performance to previous studies. Significance: We characterize the temporal synchronization patterns of epileptic EEG using spectral network metrics. In addition, we found significant changes in temporal synchronization in epileptic EEG, which enable a patient-specific approach for real-time seizure detection for personalized diagnosis and treatment. Recent research suggests that electrophysiological changes develop minutes to hours before the actual clinical onset in focal epileptic seizures. Seizure prediction is a major field of neurological research, enabled by statistical analysis methods applied to features derived from intracranial Electroencephalographic (EEG) recordings of brain activity. However, no reliable seizure prediction method is ready for clinical applications. In this study, we use modern machine learning techniques to predict seizures from a number of features proposed in the literature. We concentrate on aggregated features that encode the relationship between pairs of EEG channels, such as cross-correlation, nonlinear interdependence, difference of Lyapunov exponents and wavelet analysis-based synchrony such as phase locking. We compare L1-regularized logistic regression, convolutional networks, and support vector machines. Results are reported on the standard Freiburg EEG dataset which contains data from 21 patients suffering from medically intractable focal epilepsy. For each patient, at least one method predicts 100 of the seizures on average 60 minutes before the onset, with no false alarm. Possible future applications include implantable devices capable of warning the patient of an upcoming seizure as well as implanted drug-delivery devices. A novel financial time-series analysis method based on deep learning technique is proposed in this paper. In recent years, the explosive growth of deep learning researches have led to several successful applications in various artificial intelligence and multimedia fields, such as visual recognition, robot vision, and natural language processing. In this paper, we focus on the time-series data processing and prediction in financial markets. Traditional feature extraction approaches in intelligent trading decision support system are used to applying several technical indicators and expert rules to extract numerical features. The major contribution of this paper is to improve the algorithmic trading framework with the proposed planar feature representation methods and deep convolutional neural networks (CNN). The proposed system is implemented and benchmarked in the historical datasets of Taiwan Stock Index Futures. The experimental results show that the deep learning technique is effective in our trading simulation application, and may have greater potentialities to model the noisy financial data and complex social science problems. In the future, we expected that the proposed methods and deep learning framework could be applied to more innovative applications in the next financial technology (FinTech) generation. Abstract Objective A novel patient-specific seizure detection algorithm is presented. As the spatial distribution of the ictal pattern is characteristic for a patient’s seizures, this work incorporates such information into the data representation and provides a learning algorithm exploiting it. Methods The proposed training algorithm uses nuclear norm regularization to convey structural information of the channel-feature matrices extracted from the EEG. This method is compared to two existing approaches utilizing the same feature set, but integrating the multichannel information in a different manner. The performances of the detectors are demonstrated on a publicly available dataset containing 131 seizures recorded in 892 h of scalp EEG from 22 pediatric patients. Results The proposed algorithm performed significantly better compared to the reference approaches ( p = 0.0170 and p = 0.0002). It reaches a median performance of 100 sensitivity, 0.11 h −1 false detection rate and 7.8 s alarm delay, outperforming a method in the literature using the same dataset. Conclusion The strength of our method lies within conveying structural information from the multichannel EEG. Such formulation automatically includes crucial spatial information and improves detection performance. Significance Our solution facilitates accurate classification performance for small training sets, therefore, it potentially reduces the time needed to train the detector before starting monitoring. A novel wavelet-based algorithm for real-time detection of epileptic seizures using scalp EEG is proposed. In a moving-window analysis, the EEG from each channel is decomposed by wavelet packet transform. Using wavelet coefficients from seizure and nonseizure references, a patient-specific measure is developed to quantify the separation between seizure and nonseizure states for the frequency range of 1-30 Hz. Utilizing this measure, a frequency band representing the maximum separation between the two states is determined and employed to develop a normalized index, called combined seizure index (CSI). CSI is derived for each epoch of every EEG channel based on both rhythmicity and relative energy of that epoch as well as consistency among different channels. Increasing significantly during ictal states, CSI is inspected using one-sided cumulative sum test to generate proper channel alarms. Analyzing alarms from all channels, a seizure alarm is finally generated. The algorithm was tested on scalp EEG recordings from 14 patients, totaling 75.8 h with 63 seizures. Results revealed a high sensitivity of 90.5 , a false detection rate of 0.51 h-1 and a median detection delay of 7 s. The algorithm could also lateralize the focus side for patients with temporal lobe epilepsy. Ability of deep networks to extract high level features and of recurrent networks to perform time-series inference have been studied. In view of universality of one hidden layer network at approximating functions under weak constraints, the benefit of multiple layers is to enlarge the space of dynamical systems approximated or, given the space, reduce the number of units required for a certain error. Traditionally shallow networks with manually engineered features are used, back-propagation extent is limited to one and attempt to choose a large number of hidden units to satisfy the Markov condition is made. In case of Markov models, it has been shown that many systems need to be modeled as higher order. In the present work, we present deep recurrent networks with longer backpropagation through time extent as a solution to modeling systems that are high order and to predicting ahead. We study epileptic seizure suppression electro-stimulator. Extraction of manually engineered complex features and prediction employing them has not allowed small low-power implementations as, to avoid possibility of surgery, extraction of any features that may be required has to be included. In this solution, a recurrent neural network performs both feature extraction and prediction. We prove analytically that adding hidden layers or increasing backpropagation extent increases the rate of decrease of approximation error. A Dynamic Programming (DP) training procedure employing matrix operations is derived. DP and use of matrix operations makes the procedure efficient particularly when using data-parallel computing. The simulation studies show the geometry of the parameter space, that the network learns the temporal structure, that parameters converge while model output displays same dynamic behavior as the system and greater than .99 Average Detection Rate on all real seizure data tried. We present and evaluate the capacity of a deep neural network to learn robust features from EEG to automatically detect seizures. This is a challenging problem because seizure manifestations on EEG are extremely variable both inter- and intra-patient. By simultaneously capturing spectral, temporal and spatial information our recurrent convolutional neural network learns a general spatially invariant representation of a seizure. The proposed approach exceeds significantly previous results obtained on cross-patient classifiers both in terms of sensitivity and false positive rate. Furthermore, our model proves to be robust to missing channel and variable electrode montage. Epilepsy is the second most common brain disorder after migraine. Automatic detection of epileptic seizures can considerably improve the patients' quality of life. Current Electroencephalogram (EEG)-based seizure detection systems encounter many challenges in real-life situations. The EEGs are non-stationary signals and seizure patterns vary across patients and recording sessions. Moreover, EEG data are prone to numerous noise types that negatively affect the detection accuracy of epileptic seizures. To address these challenges, we introduce the use of a deep learning-based approach that automatically learns the discriminative EEG features of epileptic seizures. Specifically, to reveal the correlation between successive data samples, the time-series EEG data are first segmented into a sequence of non-overlapping epochs. Second, Long Short-Term Memory (LSTM) network is used to learn the high-level representations of the normal and the seizure EEG patterns. Third, these representations are fed into Softmax function for training and classification. The results on a well-known benchmark clinical dataset demonstrate the superiority of the proposed approach over the existing state-of-the-art methods. Furthermore, our approach is shown to be robust in noisy and real-life conditions. Compared to current methods that are quite sensitive to noise, the proposed method maintains its high detection performance in the presence of common EEG artifacts (muscle activities and eye-blinking) as well as white noise. In this paper we present the application of ensemble learning to epileptic seizure detection problem. We propose a robust learning framework to mitigate class imbalance in large CHB-MIT (982 hrs) scalp EEG dataset. The algorithm being used is RUSBoost which is a hybrid data sampling and boosting technique designed especially for skewed classes. The data that is being used in this study has severe class imbalance, with average representation of 0.38 of seizure class to that of 99.62 of non-seizure class. The proposed approach shows the power of RUSBoost in terms of robustness and generalization. We compared our method with the most successful Support Vector Machine (SVM) based approach and report competitive results of 97 seizure detection accuracy, mean detection delay of 2.7s and false detection rate of 0.08 seizure hr. We also report fast training times of just under three minutes on average for average training data of 21 hrs. Detecting seizure using brain neuroactivations recorded by intracranial electroencephalogram (iEEG) has been widely used for monitoring, diagnosing, and closed-loop therapy of epileptic patients, however, computational efficiency gains are needed if state-of-the-art methods are to be implemented in implanted devices. We present a novel method for automatic seizure detection based on iEEG data that outperforms current state-of-the-art seizure detection methods in terms of computational efficiency while maintaining the accuracy. The proposed algorithm incorporates an automatic channel selection (ACS) engine as a pre-processing stage to the seizure detection procedure. The ACS engine consists of supervised classifiers which aim to find iEEG channels which contribute the most to a seizure. Seizure detection stage involves feature extraction and classification. Feature extraction is performed in both frequency and time domains where spectral power and correlation between channel pairs are calculated. Random Forest is used in classification of interictal, ictal and early ictal periods of iEEG signals. Seizure detection in this paper is retrospective and patient-specific. iEEG data is accessed via Kaggle, provided by International Epilepsy Electro-physiology Portal. The dataset includes a training set of 6.5 h of interictal data and 41 min in ictal data and a test set of 9.14 h. Compared to the state-of-the-art on the same dataset, we achieve 2 times faster in run-time seizure detection. The proposed model is able to detect a seizure onset at 89.40 sensitivity and 89.24 specificity with a mean detection delay of 2.63 s for the test set. The area under the ROC curve (AUC) is 96.94 , that is comparable to the current state-of-the-art with AUC of 96.29 . EEG is one the most effective tools used in the diagnosis of epilepsy. However, proper diagnosis of epilepsy requires the detection and analysis of epileptic seizures for a long period of time. Manual monitoring of long term EEG is tedious and costly. Therefore, a reliable automated seizure detection system is desirable. Most current state-of-the-art methods use hand crafted feature extraction and simple classification techniques, which often leads to sub-par performance due to lack of generalizability across patient dataset. Consequently, this work introduces novel deep recurrent neural network (DRNN) architecture to perform automated patient specific seizure detection using scalp EEG. We further propose a unique mapping of seizure EEG signal for efficient processing with the DRNN. This mapping allows the proposed deep architecture to simultaneously learn both temporal and spatial features of raw seizure EEG respectively. The proposed DRNN architecture is tested with long term patient specific scalp EEG data of 5 subjects with approximately 34 hours of EEG extracted from a publically available dataset. Overall, the proposed network successfully detects 100 of total seizure events with an average detection delay of 7.0 sec. The results demonstrate superior performance to that of the current state-of-art seizure detection methods. The proposed DRNN architecture also obtains a runtime of approximately 30ms for 1 sec segment of 18 channel EEG. The low processing time with sparse use of computing resources and superior performance make the proposed architecture appropriate for real-time use. Outstanding seizure detection algorithms have been developed over past two decades. Despite this success, their implementations as part of implantable or wearable devices are still limited. These works are mainly based on heavily handcrafted feature extraction, which is computationally expensive and is shown to be data set specific. These issues greatly limit the applicability of such methods to hardware implementation, including in-silicon implementations such as application specific integrated circuits. In this paper, we propose an integer convolutional neural network (CNN) implementation, Integer-Net, as a memory-efficient unified hardware-friendly CNN framework. The performance of Integer-Net is evaluated with multiple time-series data sets consisting of intracranial and scalp electroencephalogram (EEG) signals. Integer-Net shows a consistent seizure detection performance across three data sets: Freiburg Hospital intracranial EEG data set, Children’s Hospital of Boston-MIT scalp EEG data set, and UPenn and Mayo Clinic’s seizure detection data set. Our experimental results show that a 4-bit Integer-Net leads to only 2 drop of accuracy compared with a 32-bit real-value resolution CNN model, while offering more than 7 times improvement in memory efficiency. We discuss the structure of the integer convolution to improve the computational gain and reduce the inference time that are crucial for real-time application. The success of deep learning in computer vision has greatly increased the need for annotated image datasets. We propose an EEG (Electroencephalogram)-based image annotation system. While humans can recognize objects in 20-200 milliseconds, the need to manually label images results in a low annotation throughput. Our system employs brain signals captured via a consumer EEG device to achieve an annotation rate of up to 10 images per second. We exploit the P300 event-related potential (ERP) signature to identify target images during a rapid serial visual presentation (RSVP) task. We further perform unsupervised outlier removal to achieve an F1-score of 0.88 on the test set. The proposed system does not depend on category-specific EEG signatures enabling the annotation of any new image category without any model pre-training. We compare dynamical properties of brain electrical activity from different recording regions and from different physiological and pathological brain states. Using the nonlinear prediction error and an estimate of an effective correlation dimension in combination with the method of iterative amplitude adjusted surrogate data, we analyze sets of electroencephalographic (EEG) time series: surface EEG recordings from healthy volunteers with eyes closed and eyes open, and intracranial EEG recordings from epilepsy patients during the seizure free interval from within and from outside the seizure generating area as well as intracranial EEG recordings of epileptic seizures. As a preanalysis step an inclusion criterion of weak stationarity was applied. Surface EEG recordings with eyes open were compatible with the surrogates' null hypothesis of a Gaussian linear stochastic process. Strongest indications of nonlinear deterministic dynamics were found for seizure activity. Results of the other sets were found to be inbetween these two extremes. This paper focuses on human activity recognition (HAR) problem, in which inputs are multichannel time series signals acquired from a set of bodyworn inertial sensors and outputs are predefined human activities. In this problem, extracting effective features for identifying activities is a critical but challenging task. Most existing work relies on heuristic hand-crafted feature design and shallow feature learning architectures, which cannot find those distinguishing features to accurately classify different activities. In this paper, we propose a systematic feature learning method for HAR problem. This method adopts a deep convolutional neural networks (CNN) to automate feature learning from the raw inputs in a systematic way. Through the deep architecture, the learned features are deemed as the higher level abstract representation of low level raw time series signals. By leveraging the labelled information via supervised learning, the learned features are endowed with more discriminative power. Unified in one model, feature learning and classification are mutually enhanced. All these unique advantages of the CNN make it outperform other HAR algorithms, as verified in the experiments on the Opportunity Activity Recognition Challenge and other benchmark datasets. In recent years, deep learning has not only permeated the computer vision and speech recognition research fields but also fields such as acoustic event detection (AED). One of the aims of AED is to detect and classify non-speech acoustic events occurring in conversation scenes including those produced by both humans and the objects that surround us. In AED, deep learning has enabled modeling of detail-rich features, and among these, high resolution spectrograms have shown a significant advantage over existing predefined features (e.g., Mel-filter bank) that compress and reduce detail. In this paper, we further asses the importance of feature extraction for deep learning-based acoustic event detection. AED, based on spectrogram-input deep neural networks, exploits the fact that sounds have “global” spectral patterns, but sounds also have “local” properties such as being more transient or smoother in the time-frequency domain. These can be exposed by adjusting the time-frequency resolution used to compute the spectrogram, or by using a model that exploits locality leading us to explore two different feature extraction strategies in the context of deep learning: (1) using multiple resolution spectrograms simultaneously and analyzing the overall and event-wise influence to combine the results, and (2) introducing the use of convolutional neural networks (CNN), a state of the art 2D feature extraction model that exploits local structures, with log power spectrogram input for AED. An experimental evaluation shows that the approaches we describe outperform our state-of-the-art deep learning baseline with a noticeable gain in the CNN case and provides insights regarding CNN-based spectrogram characterization for AED. Understanding human activity is very challenging even with the recently developed 3D depth sensors. To solve this problem, this work investigates a novel deep structured model, which adaptively decomposes an activity instance into temporal parts using the convolutional neural networks. Our model advances the traditional deep learning approaches in two aspects. First, we incorporate latent temporal structure into the deep model, accounting for large temporal variations of diverse human activities. In particular, we utilize the latent variables to decompose the input activity into a number of temporally segmented sub-activities, and accordingly feed them into the parts (i.e. sub-networks) of the deep architecture. Second, we incorporate a radius---margin bound as a regularization term into our deep model, which effectively improves the generalization performance for classification. For model training, we propose a principled learning algorithm that iteratively (i) discovers the optimal latent variables (i.e. the ways of activity decomposition) for all training instances, (ii) updates the classifiers based on the generated features, and (iii) updates the parameters of multi-layer neural networks. In the experiments, our approach is validated on several complex scenarios for human activity recognition and demonstrates superior performances over other state-of-the-art approaches. Real-time learning needs algorithms operating in a fast speed comparable to human or animal, however this is a huge challenge in processing visual inputs. Research shows a biological brain can process complicated real-life recognition scenarios at milliseconds scale. Inspired by biological system, in this paper, we proposed a novel real-time learning method by combing the spike timing-based feed-forward spiking neural network (SNN) and the fast unsupervised spike timing dependent plasticity learning method with dynamic post-synaptic thresholds. Fast cross-validated experiments using MNIST database showed the high efficiency of the proposed method at an acceptable accuracy.