Simple and Efficient Heterogeneous Graph Neural Network
Heterogeneous graph neural networks (HGNNs) deliver the powerful capability
to embed rich structural and semantic information of a heterogeneous graph into
low-dimensional node representations. Existing HGNNs usually learn to embed
information using hierarchy attention mechanism and repeated neighbor
aggregation, suffering from unnecessary complexity and redundant computation.
This paper proposes Simple and Efficient Heterogeneous Graph Neural Network
(SeHGNN) which reduces this excess complexity through avoiding overused
node-level attention within the same relation and pre-computing the neighbor
aggregation in the pre-processing stage. Unlike previous work, SeHGNN utilizes
a light-weight parameter-free neighbor aggregator to learn structural
information for each metapath, and a transformer-based semantic aggregator to
combine semantic information across metapaths for the final embedding of each
node. As a result, SeHGNN offers the simple network structure, high prediction
accuracy, and fast training speed. Extensive experiments on five real-world
heterogeneous graphs demonstrate the superiority of SeHGNN over the
state-of-the-arts on both the accuracy and training speed. Codes are available
at https://github.com/ICT-GIMLab/SeHGNN.