Back to publications page

SIGGRAPH Asia 2008

Interactive 3D Architectural Modeling from Unordered Photo Collections

Sudipta N. Sinha
UNC Chapel Hill


Drew Steedly
Microsoft Live Labs


Richard Szeliski
Microsoft Research


Maneesh Agrawala
UC Berkeley


Marc Pollefeys
ETH Zurich

Overview of our system

Our interactive image-based modeling system provides an intuitive sketch-based interface for reconstructing a photorealistic textured piecewise planar 3D model of a building or architectural scene from an unordered collection of photographs.


IWe present an interactive system for generating photorealistic, textured, piecewise-planar 3D models of architectural structures and urban scenes from unordered sets of photographs. To reconstruct 3D geometry in our system, the user draws outlines overlaid on 2D photographs. The 3D structure is then automatically computedby combining the 2D interaction with the multi-view geometric information recovered by performing structure from motion analysis on the input photographs. We utilize vanishing point constraints at multiple stages during the reconstruction, which is particularly useful for architectural scenes where parallel lines are abundant. Our approach enables us to accurately model polygonal faces from 2D interactions in a single image. Our system also supports useful operations such as edge snapping and extrusions.

Seamless texture maps are automatically generated by combining multiple input photographs using graph cut optimization and Poisson blending. The user can add brush strokes as hints during the
texture generation stage to remove artifacts caused by unmodeled geometric structures. We build models for a variety of architectural scenes from collections of up to about a hundred photographs.
author = {Sudipta N. Sinha and Drew Steedly and Richard Szeliski and
Maneesh Agrawala and Marc Pollefeys},
title = {Interactive 3D Architectural Modeling from Unordered Photo Collections},
journal = {ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia 2008)},
year = {2008},
volume = {to appear},
number = {to appear},
pages = {to appear},
[2 MB]  [22 MB]
video 1
Video 1
(Coming Soon)
video 2
Video 2
(Coming Soon)


Back to publications page