Logo image
Immersive virtual reality with multimodal interaction and streaming technology
Conference paper

Immersive virtual reality with multimodal interaction and streaming technology

Wan-Lun Tsai, You-Lun Hsu, Chi-Po Lin, Chen-Yu Zhu, Yu-Cheng Chen and Min-Chun Hu
ICMI 2016 - Proceedings of the 18th ACM International Conference on Multimodal Interaction, p.416
10/2016

Abstract

Google cardboard Head trajectory Kinect Myo Streaming Virtual object control Virtual reality Computer Science Applications Human-Computer Interaction Hardware and Architecture Computer Vision and Pattern Recognition
In this demo, we present an immersive virtual reality (VR) system which integrates multimodal interaction sensors (i.e., smartphone, Kinect v2, and Myo armband) and streaming technology to improve the VR experience. The integrated system solves the common problems in most VR systems: (1) the very limited playing area due to transmission cable between computer and display/interaction devices, and (2) non-intuitive way of controlling virtual objects. We use Unreal Engine 4 to develop an immersive VR game with 6 interactive levels to demonstrate the feasibility of our system. In the game, the user not only can freely walk within a large playing area surrounded by multiple Kinect sensors but also select the virtual objects to grab and throw with the Myo armband. The experiment shows that our idea is workable for VR experience.

Metrics

1 Record Views

Details

Logo image