Jurnal Titik Imaji

In 2021, approximately 22.5 million people in Indonesia had disabilities, with hearing impairments being among the most prevalent. Access to education and information for the deaf community remains limited, particularly in rural areas. As a result, many deaf individuals rely on visual communication methods, such as sign language, which can be challenging for the general public to understand without specialized training. In situations where communication with non-sign language speakers is necessary, the deaf community often resorts to alternatives such as lip-reading, sign language interpreters, or assistive technology. Sign language avatars have emerged as a technological innovation aimed at bridging the information access gap for the deaf community. This study seeks to review the development of sign language avatars, assess their effectiveness in improving educational access and public services for the deaf, and highlight the importance of involving the deaf community in the development of such technologies. A literature review was conducted following the PRISMA 2020 approach, with data sourced from the Publish or Perish database. The findings suggest that advanced technologies such as artificial intelligence, 3D modeling, and augmented reality have significantly enhanced the delivery of sign language, facilitating more inclusive interactions. Avatars incorporating visual features such as facial expressions and smooth body movements improve communication comprehension by conveying emotions and contextual meaning. Sign language avatars not only boost learning motivation but also promote more effective communication between the deaf and the general public, particularly in inclusive education and public service contexts. This technology has substantial potential to bridge information access gaps and improve the quality of life for the deaf community in Indonesia, especially when developed with active involvement from the user community.

3D Animation, Communication Technology, Hearing Impaired or Deaf, Sign Language Avatar and Technology Effectiveness

Abuzinadah, N. E. (2020). An Avatar-based System for Arabic Sign Language to Enhance Hard-of-hearing and Deaf Students' Performance in a Fundamentals of Computer Programming Course (Doctoral dissertation, University of Surrey).

Alethary, A. A., Aliwy, A. H., & Ali, N. S. (2022). Automated Arabic-Arabic sign language translation system based on 3D avatar technology. Int J Adv Appl Sci, 11(4), 383-396.

Atasoy, M., Şılbır, L., Erümit, S. F., Bahçekapılı, E., Yıldız, A., & Karal, H. (2023). Visual Appearance Features of Sign Language Avatars. Kastamonu Education Journal, 31(3), 386-403.

Arkushin, R. S., Moryossef, A., & Fried, O. (2023). Ham2pose: Animating sign language notation into pose sequences. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 21046-21056).

Aziz, M., & Othman, A. (2023). Evolution and Trends in Sign Language Avatar Systems: Unveiling a 40-Year Journey via Systematic Review. Multimodal Technologies and Interaction, 7(10), 97.

Bernhard, L., Nunnari, F., Unger, A., Bauerdiek, J., Dold, C., Hauck, M., ... & Wallach, D. (2022, June). Towards automated sign language production: A pipeline for creating inclusive virtual humans. In Proceedings of the 15th International Conference on PErvasive Technologies Related to Assistive Environments (pp. 260-268).

Choudhury, S. (2022, June). Analysis of torso movement for signing avatar using deep learning. In Proceedings of the 7th International Workshop on Sign Language Translation and Avatar Technology: The Junction of the Visual and the Textual: Challenges and Perspectives (pp. 7-12).

Dewi, R. K., Pramana, R. P., Sadaly, H., Dewi, R. K., Pramana, R. P., & Sadaly, H. (2020). Kendala Mewujudkan Pembangunan Inklusif Penyandang Disabilitas. The SMERU Research Institute.

De Martino, J. M., Silva, I. R., Bolognini, C. Z., Costa, P. D. P., Kumada, K. M. O., Coradine, L. C., ... & De Conti, D. F. (2017). Signing avatars: making education more inclusive. Universal access in the information society, 16, 793-808.

dos Santos Paim, P., & Prietch, S. S. (2019). Problems and solutions in the design for Deaf persons who are sign language users to adopt assistive technology products. Journal on Interactive Systems, 10(2), 70-81.

Ebling, S., Wolfe, R., Schnepp, J., Baowidan, S., McDonald, J., Moncrief, R., ... & Tissi, K. (2015). Synthesizing the finger alphabet of Swiss German Sign Language and evaluating the comprehensibility of the resulting animations.

Erianda, A., Alanda, A., & Hidayat, R. (2023). Systematic Literature Review: Digitalization of Rural Tourism Towards Sustainable Tourism. International Journal of Advanced Science Computing and Engineering, 5(3), 247-256.

Ferreira, A. C. A. (2017). 3D Character Animation Using Sign Language (Master's thesis, Universidade do Porto (Portugal))

Gamra, M. B., & Akhloufi, M. A. (2021). A review of deep learning techniques for 2D and 3D human pose estimation. Image and Vision Computing, 114, 104282.

Huerta-Enochian, M., & Ko, C. (2023, June). Sign Language Avatar Animation Search: An Ani2Ani Search Application. In 2023 IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) (pp. 1-5). IEEE.

Hu, L., Li, J., Zhang, J., Wang, Q., Zhang, B., & Tan, P. (2022, July). A Speech-driven Sign Language Avatar Animation System for Hearing Impaired Applications. In IJCAI (pp. 5912-5915).

Нургазина, Д. М., Кудубаева, С. А., & Бекбауова, А. У. (2024). CREATING AN ANIMATED CHARACTER FOR A COMPUTERIZED DEAF TRANSLATION SYSTEM. Вестник КазНПУ имени Абая, Серия «Физико-математические науки», 85(1), 123-134.

Indra, D., Madenda, S., & Wibowo, E. P. (2019). Indonesian sign language recognition based on shape of hand gesture. Procedia Computer Science, 161, 74-81.

Kacorri, H. (2015). TR-2015001: A survey and critique of facial expression synthesis in sign language animation.

Kaviyaraj, R., Sathya, P., Nandhini, P., Chelliah, S., & Ezhilmathi, S. (2024, March). Augmented Reality and Artificial Intelligence in Sign Language Expression. In 2024 Third International Conference on Intelligent Techniques in Control, Optimization and Signal Processing (INCOS) (pp. 1-6). IEEE.

Korte, J. (2022). YoungDeafDesign: Participatory design with young Deaf children. International Journal of Child-Computer Interaction, 34, 100542.

Lacerda, I., Nicolau, H., & Coheur, L. (2023). Enhancing Portuguese Sign Language Animation with Dynamic Timing and Mouthing. arXiv preprint arXiv:2307.06124.

Lu, P., & Huenerfauth, M. (2014). Collecting and evaluating the CUNY ASL corpus for research on American Sign Language animation. Computer Speech & Language, 28(3), 812-831.

Matthews, S. C. (2016). Instructional design for deaf students: An experimental study of multimedia instruction and cognitive load (Doctoral dissertation, University of Kentucky Libraries).

Mokhtar, E. S., Omar, A. C., & Aziz, N. (2022). Expert Consensus on Formation of Design Principles for Malay Sign Language Mobile Application Based on Nielsen’s and Molich’s Design Guidelines. TEM Journal, 11(2), 585.

Nathan, S. S., Hussain, A., & Hashim, N. L. (2016). Studies on deaf mobile application: Need for functionalities and requirements. Journal of Telecommunication, Electronic and Computer Engineering, 8(8), 47-50.

Novaliendry, D., Budayawan, K., Auvi, R., Fajri, B. R., & Huda, Y. (2023). Design of Sign Language Learning Media Based on Virtual Reality. International Journal of Online & Biomedical Engineering, 19(16).

Pankau, P. M. (2023). Serious and Adventure Video Games as Tools in the Deaf Education of Children (Master's thesis, The University of Bergen).

Perciaccante, A., & Coralli, A. (2019). Comics and cartoons against the stigma of hearing loss. The Lancet Child & Adolescent Health, 3(12), 850.

Prieto, P., Puglesi, C., Borràs-Comes, J., Arroyo, E., & Blat, J. (2015). Exploring the contribution of prosody and gesture to the perception of focus using an animated agent☆. Journal of Phonetics, 49, 41-54.

Rakun, E., Muzahidin, S., Darmana, I. S. A., & Setiaji, W. (2022). SIBI (Sign System Indonesian Language) Text-to-3D Animation Translation Mobile Application. International Journal of Advanced Computer Science and Applications, 13(9).

Rastgoo, R., Kiani, K., Escalera, S., Athitsos, V., & Sabokrou, M. (2022). All you need in sign language production. arXiv preprint arXiv:2201.01609.

Rui Xia Ang, J., Liu, P., McDonnell, E., & Coppola, S. (2022, April). “In this online environment, we're limited”: Exploring Inclusive Video Conferencing Design for Signers. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (pp. 1-16).

Rusli, M. S., & Ibrahim, Z. (2022). Augmented Reality (AR) for Deaf and Hard of Hearing (DHH) for animation. e-Academia Journal, 11(2), 175-186.

Saunders, B., Camgoz, N. C., & Bowden, R. (2021). Continuous 3d multi-channel sign language production via progressive transformers and mixture density networks. International journal of computer vision, 129(7), 2113-2135.

Shovkovyi, Y., Grynyova, O., Udovenko, S., & Chala, L. (2023). Automatic sign language translation system using neural network technologies and 3d animation.

Techaraungrong, P., Suksakulchai, S., Kaewprapan, W., & Murphy, E. (2017). The design and testing of multimedia for teaching arithmetic to deaf learners. Education and Information Technologies, 22, 215-237.

Uchida, T., Nakatani, N., Miyazaki, T., Kaneko, H., & Sano, M. (2023, June). Motion Editing Tool for Reproducing Grammatical Elements of Japanese Sign Language Avatar Animation. In 2023 IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) (pp. 1-5). IEEE.

Uchida, T., Sumiyoshi, H., Miyazaki, T., Azuma, M., Umeda, S., Kato, N., ... & Yamanouchi, Y. (2019). Systems for supporting deaf people in viewing sports programs by using sign language animation synthesis. ITE Transactions on Media Technology and Applications, 7(3), 126-133.

Valarmathi, R., Surya, P. J., Balaji, P., & Ashik, K. (2024, April). Animated Sign Language For People With Speaking And Hearing Disability Using Deep Learning. In 2024 International Conference on Communication, Computing and Internet of Things (IC3IoT) (pp. 1-5). IEEE.