Vision and control techniques for robotic visual tracking

N. Papanikolopoulos, P. K. Khosla, T. Kanade

Research output: Chapter in Book/Report/Conference proceedingConference contribution

63 Scopus citations

Abstract

Algorithms for robotic real-time visual tracking of arbitrary 3-D objects traveling at unknown velocities in a 2-D space are presented. The problem of visual tracking is formulated as a problem of combining control with computer vision. A mathematical formulation that is general enough to be extended to the problem of tracking 3-D objects in 3-D space is presented. The authors propose the use of sum-of-squared differences (SSD) optical flow for the computation of the vector of discrete displacements each instant of time. These displacements can be fed either directly to a PI controller, a pole assignment controller, or a discrete steady-state Kalman filter. In the latter case, the Kalman filter calculates the estimated values of the system's states and exogenous disturbances, and a discrete LQG controller computes the desired motion of the robotic system. The outputs of the controllers are sent to a Cartesian robotic controller that drives the robot.

Original languageEnglish (US)
Title of host publicationProceedings - IEEE International Conference on Robotics and Automation
PublisherPubl by IEEE
Pages857-864
Number of pages8
ISBN (Print)081862163X
StatePublished - Jan 1 1991
EventProceedings of the 1991 IEEE International Conference on Robotics and Automation - Sacramento, CA, USA
Duration: Apr 9 1991Apr 11 1991

Publication series

NameProceedings - IEEE International Conference on Robotics and Automation
Volume1

Other

OtherProceedings of the 1991 IEEE International Conference on Robotics and Automation
CitySacramento, CA, USA
Period4/9/914/11/91

Fingerprint

Dive into the research topics of 'Vision and control techniques for robotic visual tracking'. Together they form a unique fingerprint.

Cite this