Towards Urban 3D Reconstruction from Video

The paper introduces a data collection system and a processing pipeline for automatic geo-registered 3D reconstruction of urban scenes from video. The system collects multiple video streams, as well as GPS and INS measurements in order to place the reconstructed models in geo- registered coordinates. Besides high quality in terms of both geometry and appearance, we aim at real-time performance. Even though our processing pipeline is currently far from being real-time, we select techniques and we design processing modules that can achieve fast performance on multiple CPUs and GPUs aiming at real-time performance in the near future. We present the main considerations in designing the system and the steps of the processing pipeline. We show results on real video sequences captured by our system.

• Publication year

  2006

• Venue

  3D Data Processing Visualization and Transmission

• Publication date

  2006-06-01

• Fields of study

  Geography, Computer Science, Engineering, Environmental Science

• Identifiers
  DOI 10.1109/3DPVT.2006.141
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Line-Based Structure from Motion for Urban Environments

  2006cited by this paper
• GPU-based Video Feature Tracking And Matching

  2006influential reference
• Visual odometry for ground vehicle applications

  2006cited by this paper
• Fast Compact City Modeling for Navigation Pre-Visualization

  2006cited by this paper
• FIRST EXPERIENCES WITH A MOBILE PLATFORM FOR FLEXIBLE 3 D MODEL ACQUISITION IN INDOOR AND OUTDOOR ENVIRONMENTS – THE WÄGELE 1

  2005cited by this paper
• Ensuring color consistency across multiple cameras

  2005cited by this paper
• An efficient solution to the five-point relative pose problem

  2004cited by this paper
• Visual Modeling with a Hand-Held Camera

  2004cited by this paper
• Modelling and Interpretation of Architecture from Several Images

  2004cited by this paper
• An Automated Method for Large-Scale, Ground-Based City Model Acquisition

  2004cited by this paper
• Automatic passive recovery of 3D from images and video

  2004cited by this paper
• Distinctive Image Features from Scale-Invariant Keypoints

  2004cited by this paper
• Distinctive Image Features from Scale-Invariant Keypoints

  2004cited by this paper
• Multi-resolution real-time stereo on commodity graphics hardware

  2003cited by this paper
• Preemptive RANSAC for live structure and motion estimation

  2003cited by this paper
• 3D Recording for Archaeological Fieldwork

  2003cited by this paper
• New Techniques for Automated Architectural Reconstruction from Photographs

  2002cited by this paper
• Geometry and Texture Recovery of Scenes of Large Scale

  2002cited by this paper
• Linear Multi View Reconstruction and Camera Recovery Using a Reference Plane

  2002cited by this paper
• Multiple View Geometry in Computer Vision

  2001cited by this paper
• Automatic Dense Reconstruction from Uncalibrated Video Sequences

  2001cited by this paper
• Automatic 3D Modelling of Architecture

  2000cited by this paper
• Automated urban model acquisition : Project rationale and status

  1999cited by this paper
• Self-Calibration and Metric Reconstruction Inspite of Varying and Unknown Intrinsic Camera Parameters

  1999cited by this paper
• Consensus surfaces for modeling 3D objects from multiple range images

  1998cited by this paper
• Constructing virtual worlds using dense stereo

  1998cited by this paper
• Multi Viewpoint Stereo from Uncalibrated Video Sequences

  1998cited by this paper
• From Multiple Stereo Views to Multiple 3-D Surfaces

  1997cited by this paper
• A volumetric method for building complex models from range images

  1996cited by this paper
• Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach

  1996cited by this paper
• A space-sweep approach to true multi-image matching

  1996cited by this paper
• Three-Dimensional Computer Vision: A Geometric Viewpoint

  1995cited by this paper
• An Iterative Image Registration Technique with an Application to Stereo Vision

  1981cited by this paper
• From Multiple Stereo Views to Multiple 3-D Surfaces

  year unknowncited by this paper
• 3D Modeling Heritage

  year unknowncited by this paper

• DIGITAL ORCHARD CONSTRUCTION BASED ON NEURAL RADIANCE FIELD AND GEOREFERENCING TECHNOLOGY

  2025cites this paper
• 3D point cloud reconstruction using panoramic images

  2024cites this paper
• Robust extension of light fields with probable 3D distribution based on iterative scene estimation from multi-focus images

  2022cites this paper
• Graph SLAM Built over Point Clouds Matching for Robot Localization in Tunnels

  2021cites this paper
• Real VR – Immersive Digital Reality: How to Import the Real World into Head-Mounted Immersive Displays

  2020cites this paper
• An Aerial Mixed-Reality Environment for First-Person-View Drone Flying

  2020influential citation
• Multiview Panorama Alignment and Optical Flow Refinement

  2020cites this paper
• Pré-localisation des données pour la modélisation 3D de tunnels : développements et évaluations

  2020cites this paper
• Cities as they could be: Artificial Life and Urban Systems

  2020influential citation
• Recovering absolute scale for Structure from Motion using the law of free fall

  2019cites this paper
• Global Trifocal Adjustment

  2019cites this paper
• 3D Virtual Urban Scene Reconstruction From a Single Optical Remote Sensing Image

  2019cites this paper
• Unsupervised Learning From Video With Deep Neural Embeddings

  2019cites this paper
• Accurate 3D Reconstruction from Small Motion Clip for Rolling Shutter Cameras

  2019cites this paper
• Pragma-Oriented Parallelization of the Direct Sparse Odometry SLAM Algorithm

  2019cites this paper
• D RECONSTRUCTION FROM STEREO / RANGE IMAGES

  2019cites this paper
• Combining SLAM with muti-spectral photometric stereo for real-time dense 3D reconstruction

  2018cites this paper
• Autonomous aerial navigation using monocular visual‐inertial fusion

  2018cites this paper
• Low Cost Setup for High Resolution Multiview Panorama Recording and Registration

  2018cites this paper
• Scene Reconstruction for Storytelling in 360 ^\circ Videos

  2018cites this paper
• Combining depth-estimation-based multi-spectral photometric stereo and SLAM for real-time dense 3D reconstruction

  2018cites this paper
• Reconstructing 3D virtual environments within a collaborative e‐infrastructure

  2018cites this paper
• Gaze and peripheral vision analysis for human-environment interaction

  2018cites this paper
• ACCURACY ANALYSIS OF THREE-DIMENSIONAL MODEL RECONSTRUCTED BY SPHERICAL VIDEO IMAGES

  2018cites this paper
• On-line 3D Body Modelling for Augmented Reality

  2018cites this paper
• Semi-Transparent Checkerboard Calibration Method for KINECT’s Color and Depth Camera

  2018cites this paper
• 6DOF decoupled roto-translation alignment of large-scale indoor point clouds

  2017cites this paper
• Integrating Spherical Panoramas and Maps for Visualization of Cultural Heritage Objects Using Virtual Reality Technology

  2017cites this paper
• A fast 3D scene reconstructing method using continuous video

  2017cites this paper
• Image-Based Technologies for Constructing As-Is Building Information Models for Existing Buildings

  2017cites this paper
• CoMaL Tracking: Tracking Points at the Object Boundaries

  2017cites this paper
• Texturizing and Refinement of 3D City Models with Mobile Devices

  2017cites this paper
• High-Quality Depth from Uncalibrated Small Motion Clip

  2016cites this paper
• Extracting Cognition out of Images for the Purpose of Autonomous Driving

  2016cites this paper
• Mesh addition based on the depth image (MABDI)

  2016cites this paper
• 3D MODELLING AND INTERACTIVE WEB-BASED VISUALIZATION OF CULTURAL HERITAGE OBJECTS

  2016cites this paper
• Depth estimation and camera calibration of a focused plenoptic camera for visual odometry

  2016cites this paper
• Reconstructing building mass models from UAV images

  2016cites this paper
• Automatic Representation and Segmentation of Video Sequences via a Novel Framework Based on the nD-EVM and Kohonen Networks

  2016cites this paper
• Evolution Strategy Sampling Consensus for Robust Estimator

  2016cites this paper
• NARROW FIELD-OF-VIEW VISUAL ODOMETRY BASED ON A FOCUSED PLENOPTIC CAMERA

  2015cites this paper
• When Location Meets Social Multimedia

  2015cites this paper
• HIERARCHICAL REPETITION EXTRACTION FOR BUILDING FAÇADE RECONSTRUCTION FROM OBLIQUE AERIAL IMAGES

  2015cites this paper
• MAPEAMENTO 3D DE AMBIENTES INTERNOS USANDO DADOS RGB-D

  2015cites this paper
• Automated as-built 3D reconstruction of civil infrastructure using computer vision: Achievements, opportunities, and challenges

  2015cites this paper
• A Multimodal ADAS System for Unmarked Urban Scenarios Based on Road Context Understanding

  2015cites this paper
• Automating measurement process to improve quality management for piping fabrication

  2015cites this paper
• 3D Scene Reconstruction for Robotic Bridge Inspection

  2015cites this paper
• Global rotation estimation for stereo camera systems

  2015cites this paper
• Design and implementation of a framework to generate synthetic 3D urban reconstruction datasets

  2015cites this paper
• Hybrid Photogrammetry Structure-from-Motion Systems for Scene Measurement and Analysis

  2014cites this paper
• Extrinsic self-calibration of multiple cameras with non-overlapping views in vehicles

  2014cites this paper
• Development of a New Stereo‐Panorama System Based on off‐The‐Shelf Stereo Cameras

  2014cites this paper
• Person Reidentification and Recognition in Video

  2014cites this paper
• Inverse Procedural Modelling and Applications

  2014cites this paper
• Behavior analysis of Evolution Strategy Sample Consensus

  2014cites this paper
• Modifications in SIFT-based 3D reconstruction from image sequence

  2014cites this paper
• EVALUATION OF MASS MARKET DEVICES FOR THE DOCUMENTATION OF THE CULTURAL HERITAGE

  2014cites this paper
• LSD-SLAM: Large-Scale Direct Monocular SLAM

  2014cites this paper
• A geometric and semantic evaluation of 3D data sourcing methods for land and property information

  2014cites this paper
• A Methodology for Automated Segmentation and Reconstruction of Urban 3-D Buildings from ALS Point Clouds

  2014cites this paper
• 3D Reconstruction of Indoor Scenes

  2014cites this paper
• Automated Tracking and Estimation for Control of Non-rigid Cloth

  2014cites this paper
• 3D Data Sourcing for Land and Property Information: A Geometric and Semantic Perspective

  2013cites this paper
• Restricciones algebraicas epipolares para estimación visual eficiente de movimiento sin la estructura 3D = Algebraic epipolar constraints for efficient structureless multiview motion estimation.

  2013cites this paper
• A Branch-and-Bound Approach to Correspondence and Grouping Problems

  2013cites this paper
• A Survey of Urban Reconstruction

  2013cites this paper
• Semantic decomposition and reconstruction of residential scenes from LiDAR data

  2013cites this paper
• Feature track summary visualization for sequential multi-view reconstruction

  2013cites this paper
• A robust fusion method for RGB-D SLAM

  2013cites this paper
• Drivable Road Boundary Detection for Intelligent Vehicles based on Stereovision with Plane-induced Homography

  2013cites this paper
• Is There a Procedural Logic to Architecture?

  2013cites this paper
• Reconstruction of 3D Building Models Based on Architectural Construction Drawings

  2013cites this paper
• Visual semantic segmentation and its applications

  2013cites this paper
• A Shot Detection Approach to Synchronize Stereoscopic Video

  2013cites this paper
• A Real-Time SFM Method in Augmented Reality

  2013cites this paper
• A computational framework for next-generation inspection imaging

  2013cites this paper
• 3D Scene Reconstruction from Multiple Spherical Stereo Pairs

  2013influential citation
• 3D Shape Cropping

  2013cites this paper
• Stable Two View Reconstruction Using the Six-Point Algorithm

  2012cites this paper
• Semantic-based road environment recognition in mixed traffic for intelligent vehicles and advanced driver assistance systems

  2012cites this paper
• Challenges in 3D Reconstruction from Images for Difficult Large-Scale Objects: A Study on the Modeling of Electrical Substations

  2012cites this paper
• 3-line RANSAC for orthogonal vanishing point detection

  2012cites this paper
• Simultaneous line matching and epipolar geometry estimation based on the intersection context of coplanar line pairs

  2012cites this paper
• Rotation estimation and vanishing point extraction by omnidirectional vision in urban environment

  2012cites this paper
• View Planning for Multi-View Stereo 3D Reconstruction Using an Autonomous Multicopter

  2012cites this paper
• Visualization of scene structure uncertainty in multi-view reconstruction

  2012cites this paper
• RGB-D mapping: Using Kinect-style depth cameras for dense 3D modeling of indoor environments

  2012influential citation
• Motion Adjustment for Extrinsic Calibration of Cameras with Non-overlapping Views

  2012cites this paper
• ClayVision: the (elastic) image of the city

  2012cites this paper
• Robust road boundary estimation for intelligent vehicles in challenging scenarios based on a semantic graph

  2012cites this paper
• Tuning stereo image matching with stereo video sequence processing

  2012cites this paper
• Map building with RGB-D camera for mobil robot

  2012cites this paper
• Robust Augmented Reality

  2012cites this paper
• Visualization of Scene Structure Uncertainty in a Multi-View Reconstruction Pipeline

  2012cites this paper
• Probabilistic voxel mapping using an adaptive confidence measure of stereo matching

  2012cites this paper
• A probabilistic framework for geometry and motion reconstruction using prior information

  2011cites this paper
• Hand-held 3D scanning based on coarse and fine registration of multiple range images

  2011cites this paper
• Lightweight 3D Modeling of Urban Buildings from Range Data

  2011cites this paper
• Image based detection of geometric changes in urban environments

  2011cites this paper