Application of the controlled active vision framework to robotic and transportation problems

Christopher E. Smith, Nikolaos P. Papanikolopoulos, Scott A. Brandt

Research output: Contribution to conferencePaperpeer-review

Abstract

Flexible operation of a robotic agent in an uncalibrated environment requires the ability to recover unknown or partially known parameters of the workspace through sensing. Of the sensors available to a robotic agent, visual sensors provide information that is richer and more complete than other sensors. In this paper we present robust techniques for the derivation of depth from feature points on a target's surface and for the accurate and high-speed tracking of moving targets. We use these techniques in a system that operates with little or no a priori knowledge of the object-related parameters present in the environment. The system is designed under the Controlled Active Vision framework [16] and robustly determines parameters such as velocity for tracking moving objects and depth maps of objects with unknown depths and surface structure. Such determination of intrinsic environmental parameters is essential for performing higher level tasks such as inspection, exploration, tracking, grasping, and collision-free motion planning. For both applications, we use the Minnesota Robotic Visual Tracker (a single visual sensor mounted on the end-effector of a robotic manipulator combined with a real-time vision system) to automatically select feature points on surfaces, to derive an estimate of the environmental parameter in question, and to supply a control vector based upon these estimates to guide the manipulator. The paper concludes with applications of these techniques to transportation problems such as vehicle tracking.

Original languageEnglish (US)
Pages213-220
Number of pages8
StatePublished - 1994
EventProceedings of the 2nd IEEE Workshop on Applications of Computer Vision - Sarasota, FL, USA
Duration: Dec 5 1994Dec 7 1994

Other

OtherProceedings of the 2nd IEEE Workshop on Applications of Computer Vision
CitySarasota, FL, USA
Period12/5/9412/7/94

Fingerprint

Dive into the research topics of 'Application of the controlled active vision framework to robotic and transportation problems'. Together they form a unique fingerprint.

Cite this