Application of neural networks in spatio-temporal hand gesture recognition

Abstract

Several successful approaches to spatio-temporal signal processing such as speech recognition and hand gesture recognition have been proposed. Most of them involve time alignment which requires substantial computation and considerable memory storage. In this paper, we present a neural-network-based approach to spatio-temporal pattern recognition. This approach employs a powerful method based on hyperrectangular composite neural networks (HRCNNs) for selecting templates, therefore, considerable memory is alleviated. In addition, it greatly reduces substantial computation in the matching process because it obviates time alignment. Two databases consisted of 51 spatio-temporal hand gestures were utilized for verifying its performance. An encouraging experimental result confirmed the effectiveness of the proposed method.