3D Reconstruction using a Sparse Laser Scanner and a Single Camera for Outdoor Autonomous Vehicle

Honggu Lee, Soohwan Song, Sungho Jo

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

10 Scopus citations

Abstract

This paper presents a 3D scene reconstruction method for autonomous vehicle driving in a wide range of outdoor environments. Autonomous vehicles, most of which currently employ laser and image sensors, are required to have systems for object detection, obstacle avoidance, navigation etc. The one of the most important pieces of information for these systems is an accurate dense 3D depth map. However, range data is much sparser than image data, thus the challenging problem is to reconstruct a dense depth map using sparse range and image data. Here we propose a novel approach to fuse these different types of sensor data to reconstruct 3D scenes which maintains the shape of local objects. Our method features two main phases: The local range modeling phase and 3D depth map reconstruction phase. In the local range modeling phase we interpolate 3D points from the laser scanner using Gaussian Process regression. It estimates 3D measurements across the outdoor environment and accommodates for defective sensor information. In the reconstruction phase, we fuse an image and interpolated points to build a 3D depth map and optimize based on a Markov Random Field. It provides a depth map corresponding to all image pixels. Qualitative and time complexity results show that our approach is robust and fast enough to demonstrate in real-Time for an autonomous vehicle in complex urban scenes.

Original languageEnglish
Title of host publication2016 IEEE 19th International Conference on Intelligent Transportation Systems, ITSC 2016
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages629-634
Number of pages6
ISBN (Electronic)9781509018895
DOIs
StatePublished - 22 Dec 2016
Event19th IEEE International Conference on Intelligent Transportation Systems, ITSC 2016 - Rio de Janeiro, Brazil
Duration: 1 Nov 20164 Nov 2016

Publication series

NameIEEE Conference on Intelligent Transportation Systems, Proceedings, ITSC

Conference

Conference19th IEEE International Conference on Intelligent Transportation Systems, ITSC 2016
Country/TerritoryBrazil
CityRio de Janeiro
Period1/11/164/11/16

Fingerprint

Dive into the research topics of '3D Reconstruction using a Sparse Laser Scanner and a Single Camera for Outdoor Autonomous Vehicle'. Together they form a unique fingerprint.

Cite this