Recognition of Indonesian sign language using deep learning: convolutional neural network-based approach

Abstract

This study focuses on developing an automatic Indonesian sign language (SIBI) recognition system using a convolutional neural network (CNN). Sign language is essential for communication among deaf and hard-of hearing individuals, and automatic recognition helps improve accessibility and inclusivity. CNNs are chosen for their ability to learn image features automatically, eliminating manual extraction and improving classification accuracy. The SIBI dataset used contains 5,280 images of 26 letters, divided into training and validation sets. In early training, the model achieved low accuracy (3.63% training, 3.33% validation), but after five epochs, it significantly improved to 97.58% for training and 100% for validation.