Diseminasi Kios-K Pendeteksi Hand Gesture dengan Kesadaran Bahasa Isyarat dalam Meningkatkan Efisiensi dan Keterjangkauan Penjualan di Kedai Susu Tuli

Abstract

Deaf people in Indonesia currently face communication difficulties, limited access to education, and employment discrimination. The urgency of this issue stems from the significant challenges faced by deaf people with disabilities in Indonesia, where limited access to communication and information is a major obstacle in their daily lives. With 1,820,000 deaf people in Indonesia, there is an urgent need for technological solutions to improve access to information and services, in line with the government's commitment to equality for people with disabilities. This project aims to develop a kiosk that is accessible to deaf people, with a hand movement recognition feature based on Long Short-Term Memory (LSTM) as a solution to the above problems. This project will involve the development of an LSTM model trained to recognize hand movements in sign language, enabling deaf individuals to interact with the KiosK system independently and efficiently. The stages of implementing this community service activity began with preparation and coordination with partners through discussions and focus group discussions (FGD) to agree on solutions, targets, objectives, and the roles of each party. This is followed by a literature study to gather research related to the optimal design of smart Kios-K to support sign language detection applications for self-service systems. Then, the team will design and create Kios-K based on the needs of partners obtained in the initial stage. Next, training, implementation, and assistance will be provided to partners regarding the use of Kios-K, as well as data collection to maximize output. Finally, monitoring and evaluation will be carried out to observe the impact of the community service activities on the partners. The achievements of this activity show significant progress in realizing solutions that can improve communication accessibility for the deaf, empower their economy through digital MSMEs, and increase awareness and social inclusion in the community. With the completion of the planning and implementation phases, the training, application, and mentoring stages will be completed.