Deep Learning Incorporated with Augmented Reality Application for Watch Try-On

Andri Andri, Tri Basuki Kurniawan, Deshinta Arrova Dewi, Mashal Kasem Alqudah, Musab Kasim Alqudah, Mohd Zaki Zakaria, Putri Aisha Athira binti Hisham
Pages 259-271
Abstract Views 812
PDF Downloads 696
Crossref Citations -
DOI https://doi.org/10.47738/jads.v6i1.529

Abstract


In evaluating the dynamic landscape of online shopping, the integration of Augmented Reality (AR) technologies has emerged as a transformative force, redefining the way consumers engage with products in virtual environments. This research project investigates the intersection of deep learning and AR in the context of online shopping, with a particular focus on a Watch Try-On application. The experimentation involves the use of SSD MobileNet's models for real-time object detection aimed at enhancing the user experience during online watch shopping. Training both SSD MobileNet's V1 and V2 models through 50,000 iterations, the results reveal intriguing insights into their performance. SSD MobileNet's V1 demonstrated superior results, boasting a mean average precision (mAP) of 0.9725 and a significant reduction in total loss from 0.774 to 0.5405. However, the longer training time of 7 hours and 42 minutes prompted the selection of SSD MobileNet's V2 for real-time applications due to its faster inference capabilities. Extending beyond traditional online shopping experiences, the research explores the potential of AR technologies to revolutionize product visualization and interaction. The choice of the Vuforia model target for the Watch Try-On application showcases the synergy between deep learning and AR, allowing users to virtually try on watches and visualize them in their real-world environment. The application successfully detects users' hands with high accuracy, creating an immersive and visually enriching experience. In conclusion, this project contributes to the ongoing discourse on the fusion of deep learning and AR for online shopping. The exploration of SSD MobileNet's models, coupled with the integration of AR technologies, underscores the potential to elevate the online shopping experience by providing users with dynamic, interactive, and personalized ways to engage with products.

Keywords


Augmented Reality (AR); Deep Learning; SSD MobileNet; Watch Try-On Application; Process Innovation

Full Text:

PDF

References


Zhang, Z., Weng, D., Jiang, H., Liu, Y., & Wang, Y, (2018). Inverse Augmented Reality: A Virtual Agent’s Perspective. IEEE Xplore. https://doi.org/10.1109/ISMAR-Adjunct.2018.00056

Grampp, M., Rohr, D., Buti, M., & Egerth, K. (2020). The Deloitte Swiss Watch Industry Study 2020. Deloitte. https://www2.deloitte.com/content/dam/Deloitte/it/Documents/consumerbusiness/The%20Deloitte%20Swiss %20Watch%20Industry%20Study%202020.pdf

Fontclara Bargalló Supervisor, C., & Manuel Moreno Eguilaz, J. (2023). Product development for the watchmaking industry. https://upcommons.upc.edu/handle/2117/406549

Lorenz, M., Knopp, S., & Klimant, Pl, (2018), Industrial Augmented Reality: Requirements for an Augmented Reality Maintenance Worker Support System. IEEE Xplore. https://doi.org/10.1109/ISMARAdjunct.2018.00055

Doaa Nae'l Nasser. (2018), Augmented Reality in Education Learning and Training. International Conference on Control and Automation. https://doi.org/10.1109/icca-ticet.2018.8726192

Taiane Silva Barbosa, & Artur Henrique Kronbauer. (2019). Panorama of Researches Related to the Application of Virtual Reality in the Health Area in SVR. https://doi.org/10.1109/svr.2019.00027

Chen, S., Hu, B., Gao, Y., Liao, Z., Li, J., & Hao, A. (2020, November 1). Lower Limb Balance Rehabilitation of Post-stroke Patients Using an Evaluating and Training Combined Augmented Reality System. IEEE Xplore. https://doi.org/10.1109/ISMAR-Adjunct51615.2020.00064

Upadhyay, G. K., Aggarwal, D., Bansal, A., & Bhola, G. (2020, February 1). Augmented Reality and Machine Learning based Product Identification in Retail using Vuforia and MobileNets. IEEE Xplore. https://doi.org/10.1109/ICICT48043.2020.9112490

Wu, G., Qiu, M., Zhang, Y., & Zheng, Y. (2019, August 1). Research and Development of Augmented Reality Children’s Puzzle Game Based on Vuforia. IEEE Xplore. https://doi.org/10.1109/ICCSE.2019.8845385

Rieder, J. S. I., van Tol, D. H., & Aschenbrenner, D. (2021, March 1). Effective close-range accuracy comparison of Microsoft HoloLens Generation one and two using Vuforia ImageTargets. IEEE Xplore. https://doi.org/10.1109/VRW52623.2021.00158

Zeng, Z., Yao, Y., Liu, Z., & Sun, M. (2022). A deep-learning system is bridging molecule structure and biomedical text with comprehension comparable to human professionals. Nature Communications, 13(1), 862. https://doi.org/10.1038/s41467-022-28494-3

Bilal, M., Ali, G., Iqbal, M. W., Anwar, M., Malik, M. S. A., & Kadir, R. A. (2022). Auto-Prep: Efficient and Automated Data Preprocessing Pipeline. IEEE Access, 10, 107764–107784. https://doi.org/10.1109/ACCESS.2022.3198662

White Jules and Hays, S. and F. Q. and S.-S. J. and S. D. C. (2024). ChatGPT Prompt Patterns for Improving Code Quality, Refactoring, Requirements Elicitation, and Software Design. In P. and K. F. Nguyen-Duc Anh and Abrahamsson (Ed.), Generative AI for Effective Software Development (pp. 71–108). Springer Nature Switzerland. https://doi.org/10.1007/978-3-031-55642-5_4

Ho, P. T., Albajez, J. A., Santolaria, J., & Yagüe-Fabra, J. A. (2022). Study of Augmented Reality Based Manufacturing for Further Integration of Quality Control 4.0: A Systematic Literature Review. Applied Sciences, 12(4). https://doi.org/10.3390/app12041961

Islam, R. bin, Akhter, S., Iqbal, F., Saif Ur Rahman, Md., & Khan, R. (2023). Deep learning based object detection and surrounding environment description for visually impaired people. Heliyon, 9(6). https://doi.org/10.1016/j.heliyon.2023.e16924

Liu, Y., Liu, Y., Xu, S., Cheng, K., Masuko, S., & Tanaka, J. (2020). Comparing VR- and AR-Based Try-On Systems Using Personalized Avatars. Electronics, 9(11). https://doi.org/10.3390/electronics9111814

Liu, R., & Wang, Y. (2024). Enhancing Enterprise Value Creation Through Intelligent Digital Transformation of the Value Chain: A Deep Learning and Edge Computing Approach. Journal of the Knowledge Economy, 1-19.




DOI: https://doi.org/10.47738/jads.v6i1.529

Refbacks

  • There are currently no refbacks.


Barcode

Journal of Applied Data Sciences

ISSN:2723-6471 (Online)
Publisher:Bright Publisher
Website:http://bright-journal.org/JADS
Email:taqwa@amikompurwokerto.ac.id (principal contact)
  support@bright-journal.org (technical issues)

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0