Attention-embedded Quadratic Network (Qttention) for Effective and Interpretable Bearing Fault Diagnosis
Bearing fault diagnosis is of great importance to decrease the damage risk of
rotating machines and further improve economic profits. Recently, machine
learning, represented by deep learning, has made great progress in bearing
fault diagnosis. However, applying deep learning to such a task still faces two
major problems. On the one hand, deep learning loses its effectiveness when
bearing data are noisy or big data are unavailable, making deep learning hard
to implement in industrial fields. On the other hand, a deep network is
notoriously a black box. It is difficult to know how a model classifies faulty
signals from the normal and the physics principle behind the classification. To
solve the effectiveness and interpretability issues, we prototype a
convolutional network with recently-invented quadratic neurons. This quadratic
neuron empowered network can qualify the noisy and small bearing data due to
the strong feature representation ability of quadratic neurons. Moreover, we
independently derive the attention mechanism from a quadratic neuron, referred
to as qttention, by factorizing the learned quadratic function in analogue to
the attention, making the model with quadratic neurons inherently
interpretable. Experiments on the public and our datasets demonstrate that the
proposed network can facilitate effective and interpretable bearing fault
diagnosis.