Scene Reconstruction From Video

Reconstruction from Airborne Video and Inertial and GPS Data

Computer displays and processing power have reached the point where realistic 3D presentation with smooth motion is available to most home and business users. Increased use of broadband internet connections in the home is enabling transmission and viewing of detailed interactive graphic material. Volumetric database management systems have been optimized for efficient data transfer and presentation over limited bandwidths for medical, navigation, engineering, and personal use.

The bottleneck in the availability of ubiquitous 3D presentation and interaction materials is the acquisition of accurate 3D models from real world spaces. If such models can be rapidly and automatically created with video sequences from a freely moving video camera, this bottleneck can be removed. Generating these models can be facilitated through the use of complementary sensors attached to the video camera. In particular, inertial sensors can help resolve many of the ambiguities that affect video-only reconstruction, including initial point of view estimates and linear scale.

Acuity's initial research has targeted sparsely furnished room interiors, using high quality handheld video with a standard lens and field of view, augmented with linear accelerations and angular velocities from an attached IMU.