Real Time Hand Sign Language Translation: Text and Speech Conversion

Abstract

The Sign Language conversion project presents a real-time system that can interpret sign language from a live webcam feed. Leveraging the power of the Media pipe library for landmark detection, the project extracts vital information from each frame, including hand landmarks. The detected landmark coordinates are then collected and stored in a CSV file for further analysis. Using machine learning techniques, a Random Forest Classifier is trained on this landmark data to classify different sign language patterns. During the webcam feed processing, the trained model predicts the sign language class and its probability in real- time. The results are overlaid on the video stream, providing users with immediate insights into the subject's sign language cues. Key Words: Sign language recognition, Hand gesture recognition, Gesture-to-text conversion, Visual language processing.