Intelligent Voice Guidance in VR: Understanding the Value of NLP in Virtual Environments
Date of Award
Department or Program
Virtual assistants such as Google Assistant, Alexa and Siri emerged because of the growth of NLP(natural language processing) technology. At the same time, virtual reality has developed rapidly in recent years and has become a crucial tool in engineering product development procedures. However, people feel overwhelmed in some complicated VR environments. Thus, this thesis tries to incorporate NLP technology into the VR environment and explores the value of intelligent voice guidance in VR environments. In this thesis, a car repair training system with intelligent voice guidance is designed: users can utilize voice to perform various tasks in this system, such as; viewing all voice commands, teleporting to distinct work areas, inquiry regarding specific steps in a task, collaborating with system items, etc. This thesis also discusses the user study process in detail. It is concluded that voice guidance is an effective method of teaching the training task, particularly for individuals who have no prior experience with virtual reality. However, the current system still has a certain amount of low accuracy, which is the future direction that needs to be improved.
Xiao, Zhiyu, "Intelligent Voice Guidance in VR: Understanding the Value of NLP in Virtual Environments" (2022). Dartmouth College Master’s Theses. 49.