RF-Sign: Position-Independent Sign Language Recognition Using Passive RFID Tags

Abstract

Nowadays, sign language is becoming increasingly important in people's daily life. Existing solutions are often based on wireless signals (e.g., acoustic, visible, and WiFi) or wearable sensors to recognize gestures, but they suffer from vulnerability to environmental influences, poor security, and high energy consumption, which prevent them from accurately capturing finger micromovements. In this article, we propose RF-Sign, which uses passive radio-frequency identification (RFID) tags to capture multiple finger micromovements simultaneously to enable sign language support. In particular, two main issues are studied. One is the problem of positional differences when users make the same gesture, and the other is the problem of segmenting consecutive gestures using only empirical thresholding methods and ignoring the existence of differences in thresholds for different gestures. For position differences, we propose position models to normalize the hand's horizontal rotation angle and radial distance. For segmenting consecutive gestures, we use the received signal strength (RSS) trend of the reference tag to represent the finger micromovements state. The experimental results show that the average accuracy reaches 92.81% under different angles, distances, and other conditions.