Abstract
In this paper we present algorithms for robotic (eve- in-hand configuration) real-time visual tracking of arbitrary 3-D objects traveling at unknown velocities in a 2-D space (depth is given as known). We formulate the problem of visual tracking as a problem of combining control with computer vision. We present a mathematical formulation of a control problem that includes the sensory information of a novel and important feedback sensor (vision sensor). This formulation represents everything with respect to the camera frame and not with respect to the world frame. Due to this fact, we have the ability to quickly and accurately control the camera. We propose using the sum-of-squared differences (SSD) optical flow for the computation of the vector of discrete displacements each instant of time. These displacements can be fed either directly to a PI controller or to a pole assignment controller or to a discrete steady-state Kalman filter. In the latter case, the Kalman filter calculates the estimated values of the system’s states and the exogenous disturbances, and a discrete LQG controller computes the desired motion of the robotic system. The outputs of the controllers are sent to a Cartesian robotic controller that drives the robot. The performance of the proposed algorithms has been tested on the CMU Direct-Drive (DD) Arm II, and the results are presented in this paper.
| Original language | English (US) |
|---|---|
| Pages (from-to) | 14-35 |
| Number of pages | 22 |
| Journal | IEEE Transactions on Robotics and Automation |
| Volume | 9 |
| Issue number | 1 |
| DOIs | |
| State | Published - Feb 1993 |
Bibliographical note
Funding Information:Manuscript received June 3, 1991; revised June 2, 1992. This work was supported in part by the Defense Advanced Research Projects Agency through DARPA Order DAAA-21-89C-0001 and by the Department of Electrical and Computer Engineering and the Robotics Institute of Carnegie Mellon University. Portions of this paper were presented at the IEEE Intemational Conference on Robotics and Automation, Sacramento, CA, 1991. N. P. Papanikolopoulos is with the Department of Computer Science, University of Minnesota, Minneapolis, MN 55455. P. K. Khosla is with the Department of Electrical and Computer Engineering, The Robotics Institute, Carnegie Mellon University, Pittsburgh, PA 15213. T. Kanade is with the Department of Computer Science. The Robotics Institute, Camegie Mellon University, Pittsburgh, PA 152 13. IEEE Log Number 9203044.