Editing Real World Scenes: Augmented Reality with Image-based Rendering

We present a method that using only an uncalibratedcamera allows the capture of object geometry and appearance,and then at a later stage registration and ARoverlay into a new scene.Using only image informationfirst a coarse object geometry is obtained usingstructure-from-motion, then a dynamic, view dependenttexture is estimated to account for the differences betweenthe reprojected coarse model and the training images.In AR rendering, the object structure is interactively aligned in one frame by the user, object andscene structure is registered, and rendered in subsequentframes by a virtual scene camera, with parameters estimated from real-time visual tracking.Using the sameviewing geometry for both object acquisition, registration,and rendering ensures consistency and minimizeserros.