A Usability Study of Augmented Reality Indoor Navigation using Handheld Augmented Reality Usability Scale (HARUS)

Matahari Bhakti Nendya; Aditya Wikan Mahastama; Bantolo  Setiadi

doi:10.31154/cogito.v10i2.658.326-338

Authors

Matahari Bhakti Nendya Universitas Kristen Duta Wacana
Aditya Wikan Mahastama Universitas Kristen Duta Wacana
Bantolo Setiadi Universitas Kristen Duta Wacana

DOI:

https://doi.org/10.31154/cogito.v10i2.658.326-338

Keywords:

Augmented Reality, HARUS, Indoor Navigation, Usability Scale

Abstract

Augmented Reality (AR) indoor navigation has surfaced as an unprecedented and inventive method of aiding and directing users as they traverse intricate indoor landscapes, including campuses and structures. The efficacy of AR interior navigation system implementation is predominantly contingent upon the ease of use and adeptness of users in engaging with this technology. This study sets out to comprehensively evaluate the usability of AR indoor navigation with a primary focus on the manipulability and comprehensibility aspects of AR technology, assessing how effectively it facilitates navigation within indoor spaces. To achieve this, the Handheld Augmented Reality Usability Scale (HARUS) was used as the framework for evaluation. The research involved the creation of a marker-based AR indoor navigation application called "DutaNavAR," designed specifically for use within the Agape Building at Universitas Kristen Duta Wacana (Duta Wacana Christian University). The evaluation yielded noteworthy results, with the mean manipulability score averaging 75.19 and the mean comprehensibility score averaging 81.63. In summary, the overall average HARUS score obtained was 78.41. This score indicates a high level of user satisfaction with the interaction and overall experience of the indoor navigation application. These findings underscore the positive impact of AR technology in enhancing indoor navigation, emphasizing the usability and user-friendliness of AR solutions in complex indoor environments.

References

M. Centorrino, J. Condemi, L. D. Paola, and C. Ferrigno, "From Virtual Reality to Augmented Reality: Devices, Bodies, Places and Relationships," in 2021 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), 2021, pp. 1–7, doi: 10.1109/ISMAR-Adjunct54149.2021.00011.

X. Qiao, P. Ren, S. Dustdar, L. Liu, H. Ma, and J. Chen, "Web AR: A Promising Future for Mobile Augmented Reality-State of the Art, Challenges, and Insights," Proc. IEEE, vol. 107, no. 4, pp. 651–666, Apr. 2019, doi: 10.1109/JPROC.2019.2895105.

N. A. Giudice, B. A. Guenther, T. M. Kaplan, S. M. Anderson, R. J. Knuesel, and J. F. Cioffi, "Use of an Indoor Navigation System by Sighted and Blind Travelers," ACM Trans. Access. Comput., vol. 13, no. 3, Aug. 2020, doi: 10.1145/3407191.

E. L.-C. Law and M. Heintz, "Augmented reality applications for K-12 education: A systematic review from the usability and user experience perspective," Int. J. Child Comput. Interact., vol. 30, p. 100321, 2021.

B. Berman and D. Pollack, "Strategies for the successful implementation of augmented reality," Bus. Horiz., vol. 64, no. 5, pp. 621–630, Sep. 2021, doi: 10.1016/J.BUSHOR.2021.02.027.

K. Arning, M. Ziefle, M. Li, and L. Kobbelt, "Insights into user experiences and acceptance of mobile indoor navigation devices," in Proc. 11th Int. Conf. Mobile Ubiquitous Multimedia, 2012, pp. 1–10.

F. Paz and J. A. Pow-Sang, "A systematic mapping review of usability evaluation methods for software development process," Int. J. Softw. Eng. Its Appl., vol. 10, no. 1, pp. 165–178, 2016.

B. Ens et al., "Grand Challenges in Immersive Analytics," in Proc. Conf. Human Factors Comput. Syst., Assoc. Comput. Mach., May 2021, doi: 10.1145/3411764.3446866.

A. Basiri et al., "Indoor location based services challenges, requirements and usability of current solutions," Comput. Sci. Rev., vol. 24, pp. 1–12, 2017.

R. Dutta, A. Mantri, and G. Singh, "Evaluating system usability of mobile augmented reality application for teaching Karnaugh-Maps," Smart Learn. Environ., vol. 9, no. 1, p. 6, 2022, doi: 10.1186/s40561-022-00189-8.

M. E. C. Santos, J. Polvi, T. Taketomi, G. Yamamoto, C. Sandor, and H. Kato, "Usability scale for handheld augmented reality," in Proc. ACM Symp. Virtual Reality Softw. Technol., Assoc. Comput. Mach., Nov. 2014, pp. 167–176, doi: 10.1145/2671015.2671019.

M. R. Dwifano and P. P. Suarli, "Pengukuran usability aplikasi augmented reality desain mebel rumah dengan metode handheld augmented reality usability scale," Sriwijaya Univ., Palembang, 2022.

H. Urban, G. Pelikan, and C. Schranz, "Augmented Reality in AEC Education: A Case Study," Buildings, vol. 12, no. 4, Apr. 2022, doi: 10.3390/buildings12040391.

D. P. Kaur and A. Mantri, "Augmented reality based interactive table-top environment for real-time visualization of control theory concepts: An empirical study," Educ. Inf. Technol., pp. 1–22, 2023.

D. Plikynas, A. Žvironas, A. Budrionis, and M. Gudauskis, "Indoor navigation systems for visually impaired persons: Mapping the features of existing technologies to user needs," Sensors, vol. 20, no. 3, p. 636, 2020.

J. T. Roscoe, Fundamental Research Statistics for the Behavioral Sciences. Holt, Rinehart, and Winston, 1975. [Online]. Available: https://books.google.co.id/books?id=Fe8vAAAAMAAJ

D. A. Plecher, C. Eichhorn, C. Steinmetz, and G. Klinker, "TrackSugAR," in Digital Human Modeling and Applications in Health, Safety, Ergonomics and Risk Management: Posture, Motion and Health, Springer, 2020, pp. 442–459, doi: 10.1007/978-3-030-49904-4_33.

J. Dong, M. Noreikis, Y. Xiao, and A. Ylä-Jääski, "ViNav: A vision-based indoor navigation system for smartphones," IEEE Trans. Mob. Comput., vol. 18, no. 6, pp. 1461–1475, 2018.

A. Bangor, P. T. Kortum, and J. T. Miller, "An empirical evaluation of the System Usability Scale," Int. J. Hum. Comput. Interact., vol. 24, no. 6, pp. 574–594, 2008, doi: 10.1080/10447310802205776.

G. Bansal, K. Rajgopal, V. Chamola, Z. Xiong, and D. Niyato, "Healthcare in Metaverse: A Survey on Current Metaverse Applications in Healthcare," IEEE Access, vol. 10, pp. 119914–119946, 2022, doi: 10.1109/ACCESS.2022.3219845.

K. C. Brata, N. Funabiki, S. Sukaridhoto, E. D. Fajrianti, and M. Mentari, "An Investigation of Running Load Comparisons of ARCore on Native Android and Unity for Outdoor Navigation System Using Smartphone," in 2023 6th Int. Conf. Vocational Educ. Electr. Eng., 2023, pp. 133–138, doi: 10.1109/ICVEE59738.2023.10348201.

W. G. Van Toll, A. F. Cook IV, and R. Geraerts, "A navigation mesh for dynamic environments," Comput. Animat. Virtual Worlds, vol. 23, no. 6, pp. 535–546, Nov. 2012, doi: 10.1002/cav.1468.

M. B. Nendya, A. W. Mahastama, and B. Setiadi, "Augmented Reality Indoor Navigation Using NavMesh," in 2023 1st IEEE Int. Conf. Smart Technol. (ICE-SMARTec), 2023, pp. 134–139, doi: 10.1109/ICE-SMARTECH59237.2023.10461972.

V. Saprikis, G. Avlogiaris, and A. Katarachia, "Determinants of the intention to adopt mobile augmented reality apps in shopping malls among university students," J. Theor. Appl. Electron. Commerce Res., vol. 16, no. 3, pp. 491–512, 2021, doi: 10.3390/jtaer16030030.

A. Alaraj et al., "Virtual reality training in neurosurgery: Review of current status and future applications," Surg. Neurol. Int., vol. 2, no. 1, p. 52, 2011, doi: 10.4103/2152-7806.80117.

M. Li et al., "Evaluation of a mobile projector-based indoor navigation interface," Interact. Comput., vol. 26, no. 6, pp. 595–613, 2014.

C. Papakostas, C. Troussas, A. Krouska, and C. Sgouropoulou, "Exploration of augmented reality in spatial abilities training: A systematic literature review for the last decade," Informatics Educ., vol. 20, no. 1, pp. 107–130, 2021.

S. Liang, "Research Proposal on Reviewing Augmented Reality Applications for Supporting Ageing Population," Procedia Manuf., vol. 3, pp. 219–226, Jan. 2015, doi: 10.1016/J.PROMFG.2015.07.132.

F. Gullà et al., "Prototyping adaptive systems in smart environments using virtual reality," Int. J. Interact. Design Manuf., vol. 13, Jun. 2019, doi: 10.1007/s12008-018-00522-x.

N. A. Nik Ahmad and N. Hasni, "ISO 9241-11 and SUS Measurement for Usability Assessment of Dropshipping Sales Management Application," 2021, doi: 10.1145/3457784.3457794.