Predicting protein properties such as solvent accessibility and secondary structure from its primary amino acid sequence is an important task in bioinformatics. Recently, a few deep learning models have surpassed the traditional window based multilayer perceptron. Taking inspiration from the image classification domain we propose a deep convolutional neural network architecture, MUST-CNN, to predict protein properties. This architecture uses a novel multilayer shift-and-stitch (MUST) technique to generate fully dense per-position predictions on protein sequences. Our model is significantly simpler than the state-of-the-art, yet achieves better results. By combining MUST and the efficient convolution operation, we can consider far more parameters while retaining very fast prediction speeds. We beat the state-of-the-art performance on two large protein property prediction datasets.
Two of the most used algorithms in bioinformatics literature for protein property prediction are PSIPRED @cite_12 and Jpred @cite_3 . PSIPRED 3.2, which uses a two layer MLP approach, claims a 3-class per-position accuracy (Q @math ) score of 81.6 similar structure of a two layer MLP network. However, Jpred considers more features and uses a jury based approach with multiple models @cite_0 . Jpred claims an 81.5 , and also predicts relative solvent accessibility. @cite_4 uses a deep MLP architecture with multitask learning and achieves 81.7 @cite_17 created a generative stochastic network to predict secondary structure from the same data we used, for a Q @math of 66.4 Q @math , the Q @math accuracy tries to distinguish between more classes.
@cite_4 @cite_3 @cite_0 @cite_12 @cite_17
2153187042 2029476353 2139582206 2131474431
A two-stage neural network has been used to predict protein secondary structure based on the position specific scoring matrices generated by PSI-BLAST. Despite the simplicity and convenience of the approach used, the results are found to be superior to those produced by other methods, including the popular PHD method according to our own benchmarking results and the results from the recent Critical Assessment of Techniques for Protein Structure Prediction experiment (CASP3), where the method was evaluated by stringent blind testing. Using a new testing set based on a set of 187 unique folds, and three-way cross-validation based on structural similarity criteria rather than sequence similarity criteria used previously (no similar folds were present in both the testing and training sets) the method presented here (PSIPRED) achieved an average Q3 score of between 76.5 to 78.3 depending on the precise definition of observed secondary structure used, which is the highest published score for any method to date. Given the success of the method in CASP3, it is reasonable to be confident that the evaluation presented here gives a fair indication of the performance of the method in general. # 1999 Academic Press JPred4 (http: www.compbio.dundee.ac.uk jpred4) is the latest version of the popular JPred protein secondary structure prediction server which provides predictions by the JNet algorithm, one of the most accurate methods for secondary structure prediction. In addition to protein secondary structure, JPred also makes predictions of solvent accessibility and coiled-coil regions. The JPred service runs up to 94 000 jobs per month and has carried out over 1.5 million predictions in total for users in 179 countries. The JPred4 web server has been re-implemented in the Bootstrap framework and JavaScript to improve its design, usability and accessibility from mobile devices. JPred4 features higher accuracy, with a blind three-state (α-helix, β-strand and coil) secondary structure prediction accuracy of 82.0 while solvent accessibility prediction accuracy has been raised to 90 for residues <5 accessible. Reporting of results is enhanced both on the website and through the optional email summaries and batch submission results. Predictions are now presented in SVG format with options to view full multiple sequence alignments with and without gaps and insertions. Finally, the help-pages have been updated and tool-tips added as well as step-by-step tutorials. The effect of training a neural network secondary structure prediction algorithm with different types of multiple sequence alignment profiles derived from the same sequences, is shown to provide a range of accuracy from 70.5 to 76.4 . The best accuracy of 76.4 (standard deviation 8.4 ), is 3.1 (Q3) and 4.4 (SOV2) better than the PHD algorithm run on the same set of 406 sequence non-redundant proteins that were not used to train either method. Residues predicted by the new method with a confidence value of 5 or greater, have an average Q3 accuracy of 84 , and cover 68 of the residues. Relative solvent accessibility based on a two state model, for 25, 5, and 0 accessibility are predicted at 76.2, 79.8, and 86.6 accuracy respectively. The source of the improvements obtained from training with different representations of the same alignment data are described in detail. The new Jnet prediction method resulting from this study is available in the Jpred secondary structure prediction server, and as a stand-alone computer program from: http: barton.ebi.ac.uk . Proteins 2000;40:502–511. © 2000 Wiley-Liss, Inc. Motivation: Accurately predicting protein secondary structure and relative solvent accessibility is important for the study of protein evolution, structure and function and as a component of protein 3D structure prediction pipelines. Most predictors use a combination of machine learning and profiles, and thus must be retrained and assessed periodically as the number of available protein sequences and structures continues to grow. Results: We present newly trained modular versions of the SSpro and ACCpro predictors of secondary structure and relative solvent accessibility together with their multi-class variants SSpro8 and ACCpro20. We introduce a sharp distinction between the use of sequence similarity alone, typically in the form of sequence profiles at the input level, and the additional use of sequence-based structural similarity, which uses similarity to sequences in the Protein Data Bank to infer annotations at the output level, and study their relative contributions to modern predictors. Using sequence similarity alone, SSpro’s accuracy is between 79 and 80 (79 for ACCpro) and no other predictor seems to exceed 82 . However, when sequence-based structural similarity is added, the accuracy of SSpro rises to 92.9 (90 for ACCpro). Thus, by combining both approaches, these problems appear now to be essentially solved, as an accuracy of 100 cannot be expected for several well-known reasons. These results point also to several open technical challenges, including (i) achieving on the order of 80 accuracy, without using any similarity with known proteins and (ii) achieving on the order of 85 accuracy, using sequence similarity alone. Availability and implementation: SSpro, SSpro8, ACCpro and ACCpro20 programs, data and web servers are available through the SCRATCH suite of protein structure predictors at http: scratch.