Improved Graph Convolutional Network with Enriched Graph Topology Representation for Skeleton-Based Action Recognition

Abstract

Lately, skeleton-based action recognition has drawn remarkable attention to graph convolutional networks (GCNs). Recent methods have focused on graph learning because graph topology is the key to GCNs. We propose to align graph learning on the channel level by introducing graph convolution with enriched topology based on careful channel-wise correlations, namely the attentive channel-wise correlation graph convolution (ACC-GC). For the model to learn channel-wise enriched topologies, ACC-GC learns a shared graph topology spanning many channels and enhances it with careful channel-wise correlations. Encoding the intra-correlation between various nodes within each channel, boosting informative channel-wise correlations, and suppressing trivial ones generates attentive channel-wise correlations. Our enhanced ACC-GCN is created by substituting our ACC-GC for the GC in a standard GCN. Extensive experiments on NTURGB60 and Northwestern-UCLA datasets demonstrate that our proposed ACC-GCN performs comparably to state-of-the-art methods while reducing the computational cost.