Cloud-assisted Augmented Reality Streaming Service System: Architecture Design and Implementation

Abstract

This work presents a cloud-assisted augmented reality (AR) streaming service system over wireless network. The goal of the proposed system is to provide interactive AR streaming services of high quality with low latency through a time-varying wireless network. In the proposed system, we employ progressive mesh technique to enhance the scalability of AR streaming services, and adopt meta-file structure to include various attributes of progressive meshes of AR contents necessary for rendering and displaying according to the wireless network conditions. Based on this meta-file provided by a cloud AR server, the proposed system requests the next chunk among AR contents to improve the human visual perceptual quality of all selected AR contents while considering the marker sizes detected by the camera of the mobile AR device. The proposed system is fully implemented by using well-known open sources (e.g., Android, ARCore, and Nexus) and C/C++. Finally, the system is examined in real wireless network environments.