This study introduces a visualization framework designed to make GPT-driven voice command systems in virtual reality (VR) more transparent and predictable. Conventional interfaces usually show only the final action result, leaving users uncertain about how their spoken instructions were understood or processed. Our approach instead visualizes each stage of interpretation—from speech recognition and semantic understanding to planning and execution—so that users can preview and verify the system’s reasoning in real time. The framework integrates GPT-based language interpretation with a Unity visualization engine and live feedback loops. A prototype implementation was tested through scenario-based experiments, showing that process visualization helps users understand system behavior, recover from errors more efficiently, and develop stronger trust compared with traditional result-focused interfaces.
목차
Abstract I. INTRODUCTION II. THEORETICAL BACKGROUND A. From Result-Centric to Process-Centric Interaction Result B. Maintaining the Integrity of the Specifications C. Hierarchical Command Decomposition III. SYSTEM DESIGNN A. Feedback-Driven Interaction B. Scenario-Based Evaluation C. Observations V. CONCLUSION ACKNOWLEDGMENT REFERENCES
Inju Kang [ Department of Culture and Technology Convergence Changwon National University Changwon, Republic of Korea ]
Gongkyu Byeon [ Department of Culture and Technology Convergence Changwon National University Changwon, Republic of Korea ]
Hyeonbin Choi [ Department. of Artificial Intelligence Convergence Engineering Changwon National University Changwon, Republic of Korea ]
Sunjin Yu [ Meta-Convergence Content Major / Dept. of Artificial Intelligence Convergence Engineering Changwon National University Changwon, Republic of Korea ]