Search for collections on Unika Repository

DEVELOPING A SIGN LANGUAGE TRANSLATOR APPLICATION BASED ON IMAGE PROCESSING

SEPUTRA, STEPHEN ANGEL (2025) DEVELOPING A SIGN LANGUAGE TRANSLATOR APPLICATION BASED ON IMAGE PROCESSING. S1 thesis, UNIVERSITAS KATOLIK SOEGIJAPRANATA SEMARANG.

[img]
Preview
Text
21.K1.0039-STEPHEN ANGEL SEPUTRA-COVER_a.pdf

Download (657kB) | Preview
[img] Text
21.K1.0039-STEPHEN ANGEL SEPUTRA-BAB_I_a.pdf
Restricted to Registered users only

Download (609kB)
[img] Text
21.K1.0039-STEPHEN ANGEL SEPUTRA-BAB_II_a.pdf
Restricted to Registered users only

Download (684kB)
[img] Text
21.K1.0039-STEPHEN ANGEL SEPUTRA-BAB_III_a.pdf
Restricted to Registered users only

Download (812kB)
[img] Text
21.K1.0039-STEPHEN ANGEL SEPUTRA-BAB_IV_a.pdf
Restricted to Registered users only

Download (4MB)
[img] Text
21.K1.0039-STEPHEN ANGEL SEPUTRA-BAB_V_a.pdf
Restricted to Registered users only

Download (697kB)
[img] Text
21.K1.0039-STEPHEN ANGEL SEPUTRA-BAB_VI_a.pdf
Restricted to Registered users only

Download (589kB)
[img]
Preview
Text
21.K1.0039-STEPHEN ANGEL SEPUTRA-DAPUS_a.pdf

Download (653kB) | Preview
[img] Text
21.K1.0039-STEPHEN ANGEL SEPUTRA-LAMP_a.pdf
Restricted to Registered users only

Download (811kB)

Abstract

Sign language plays an important role in communication for the deaf community. However, there are still difficulties in interacting with individuals who do not understand sign language. This study aims to develop a real-time sign language recognition and translation system using the YOLOv5 model and compare its performance with and without preprocessing techniques. The dataset used is the Indonesian Sign Language (BISINDO) from Agung Maruf which is available on Kaggle. In the first approach, the data is used without preprocessing, while in the second approach, preprocessing is carried out in the form of normalization, augmentation, and segmentation to improve data quality. The YOLOv5 model is then trained and validated using transfer learning techniques and hyperparameter tuning to optimize performance. The evaluation results show that the use of preprocessing improves the accuracy of sign language gesture detection and translation, but has an impact on increasing computation time. Conversely, without preprocessing, the system works faster but experiences decreased accuracy, especially in less-than-ideal lighting conditions. This system is expected to help improve communication for the deaf community in everyday life.

Item Type: Thesis (S1)
Subjects: 000 Computer Science, Information and General Works
000 Computer Science, Information and General Works > 004 Data processing & computer science
Divisions: Faculty of Computer Science > Department of Informatics Engineering
Depositing User: Mr Yosua Norman Rumondor
Date Deposited: 09 Jul 2025 04:10
Last Modified: 09 Jul 2025 04:10
URI: http://repository.unika.ac.id/id/eprint/37318
Keywords: UNSPECIFIED

Actions (login required)

View Item View Item