Real-time 3D object pose estimation and tracking for natural landmark based visual servo

Changhyun Choi, Seung Min Baek, Sukhan Lee

Research output: Chapter in Book/Report/Conference proceedingConference contribution

24 Scopus citations

Abstract

A real-time solution for estimating and tracking the 3D pose of a rigid object is presented for image-based visual servo with natural landmarks. The many state-of-the-art technologies that are available for recognizing the 3D pose of an object in a natural setting are not suitable for real-time servo due to their time lags. This paper demonstrates that a real-time solution of 3D pose estimation become feasible by combining a fast tracker such as KLT [7] [8] with a method of determining the 3D coordinates of tracking points on an object at the time of SIFT based tracking point initiation, assuming that a 3D geometric model with SIFT description of an object is known a-priori. Keeping track of tracking points with KLT, removing the tracking point outliers automatically, and reinitiating the tracking points using SIFT once deteriorated, the 3D pose of an object can be estimated and tracked in real-time. This method can be applied to both mono and stereo camera based 3D pose estimation and tracking. The former guarantees higher frame rates with about 1 ms of local pose estimation, while the latter assures of more precise pose results but with about 16 ms of local pose estimation. The experimental investigations have shown the effectiveness of the proposed approach with real-time performance.

Original languageEnglish (US)
Title of host publication2008 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS
Pages3983-3989
Number of pages7
DOIs
StatePublished - Dec 1 2008
Event2008 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS - Nice, France
Duration: Sep 22 2008Sep 26 2008

Publication series

Name2008 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS

Other

Other2008 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS
CountryFrance
CityNice
Period9/22/089/26/08

Fingerprint Dive into the research topics of 'Real-time 3D object pose estimation and tracking for natural landmark based visual servo'. Together they form a unique fingerprint.

Cite this