Disjoint-CNN for Multivariate Time Series Classification

Abstract

Time series classification algorithms have been mainly dominated by non-deep learning models. Deep learning for Multivariate Time Series Classification (MTSC) has gained huge interest in recent years. Most state of the art deep learning methods are convolutional-based where 1-dimensional (1D) convolutions are used to extract features from the 2-dimensional time series. This study shows that factorization of 1D convolution filters into disjoint temporal and spatial components yields significant accuracy improvements with almost no additional computational cost. Based on our study on disjoint temporal-spatial filters, we have designed a novel filter block called "1+1D", which emphasizes the interaction between dimensions to improve the model performance of the convolution based on deep learning MTSC models. We also proposed a new and effective MTSC method called Disjoint-CNN using our proposed 1+1D filter blocks and through our extensive experiments show that our model (called Disjoint-CNN) outperforms the state-of-the-art MTSC models on 26 datasets in the UEA Multivariate time series archive, achieving the highest average rank among 9 MTSC benchmark models.