A multi-sensor integrated head-mounted display setup for augmented reality applications

Abstract

We present an HMD based AR system comprising visual and inertial sensors. The visual sensor is a camera pair and the inertial sensors consist of an accelerometer and a gyroscope. We discuss the temporal and spatial calibration issues that relate to such a system. We introduce simple yet effective methods for estimating the time lag between the camera and the inertial sensors and for estimating the relative pose between the camera and the inertial sensors. These methods do not require a complicated setup for data collection and involve simple equations to solve. Sample results are presented to demonstrate the visual performance of the system.