Integrating computer vision and control for vision-assisted robotic tasks

Research output: Contribution to journalConference article

3 Citations (Scopus)

Abstract

One of the most desirable characteristics of a robotic manipulator is its flexibility. Flexibility and adaptability can be achieved by incorporating vision and generally, sensory information in the feedback loop. Our research introduces a framework called controlled active vision for efficient integration of the vision sensor in the feedback loop. This framework was applied to the problem of robotic visual tracking and servoing and the results were very promising. Full 3-D robotic visual tracking was achieved at rates of 30 Hz. Most importantly, the tracking was successful even under the assumption of poor calibration of the hand-eye system. This paper extends this framework to other problems of sensor-based robotics such as the derivation of depth maps from controlled motion; the vision-assisted grasping; the active calibration of the system robot-camera; and the computation of the relative pose of the target from the camera. We dealt with these problems by combining adaptive control techniques with computer vision algorithms. The paper concludes with a discussion on several relative issues such as the stability and robustness of the proposed algorithms.

Original languageEnglish (US)
Pages (from-to)904-908
Number of pages5
JournalProceedings of the American Control Conference
Volume1
StatePublished - Jan 1 1995
EventProceedings of the 1995 American Control Conference. Part 1 (of 6) - Seattle, WA, USA
Duration: Jun 21 1995Jun 23 1995

Fingerprint

Computer control
Computer vision
Robotics
Cameras
Calibration
Feedback
Sensors
Manipulators
Robots

Cite this

Integrating computer vision and control for vision-assisted robotic tasks. / Papanikolopoulos, Nikolaos P.

In: Proceedings of the American Control Conference, Vol. 1, 01.01.1995, p. 904-908.

Research output: Contribution to journalConference article

@article{642c7153088f4e4584378e79be12b437,
title = "Integrating computer vision and control for vision-assisted robotic tasks",
abstract = "One of the most desirable characteristics of a robotic manipulator is its flexibility. Flexibility and adaptability can be achieved by incorporating vision and generally, sensory information in the feedback loop. Our research introduces a framework called controlled active vision for efficient integration of the vision sensor in the feedback loop. This framework was applied to the problem of robotic visual tracking and servoing and the results were very promising. Full 3-D robotic visual tracking was achieved at rates of 30 Hz. Most importantly, the tracking was successful even under the assumption of poor calibration of the hand-eye system. This paper extends this framework to other problems of sensor-based robotics such as the derivation of depth maps from controlled motion; the vision-assisted grasping; the active calibration of the system robot-camera; and the computation of the relative pose of the target from the camera. We dealt with these problems by combining adaptive control techniques with computer vision algorithms. The paper concludes with a discussion on several relative issues such as the stability and robustness of the proposed algorithms.",
author = "Papanikolopoulos, {Nikolaos P.}",
year = "1995",
month = "1",
day = "1",
language = "English (US)",
volume = "1",
pages = "904--908",
journal = "Proceedings of the American Control Conference",
issn = "0743-1619",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - JOUR

T1 - Integrating computer vision and control for vision-assisted robotic tasks

AU - Papanikolopoulos, Nikolaos P.

PY - 1995/1/1

Y1 - 1995/1/1

N2 - One of the most desirable characteristics of a robotic manipulator is its flexibility. Flexibility and adaptability can be achieved by incorporating vision and generally, sensory information in the feedback loop. Our research introduces a framework called controlled active vision for efficient integration of the vision sensor in the feedback loop. This framework was applied to the problem of robotic visual tracking and servoing and the results were very promising. Full 3-D robotic visual tracking was achieved at rates of 30 Hz. Most importantly, the tracking was successful even under the assumption of poor calibration of the hand-eye system. This paper extends this framework to other problems of sensor-based robotics such as the derivation of depth maps from controlled motion; the vision-assisted grasping; the active calibration of the system robot-camera; and the computation of the relative pose of the target from the camera. We dealt with these problems by combining adaptive control techniques with computer vision algorithms. The paper concludes with a discussion on several relative issues such as the stability and robustness of the proposed algorithms.

AB - One of the most desirable characteristics of a robotic manipulator is its flexibility. Flexibility and adaptability can be achieved by incorporating vision and generally, sensory information in the feedback loop. Our research introduces a framework called controlled active vision for efficient integration of the vision sensor in the feedback loop. This framework was applied to the problem of robotic visual tracking and servoing and the results were very promising. Full 3-D robotic visual tracking was achieved at rates of 30 Hz. Most importantly, the tracking was successful even under the assumption of poor calibration of the hand-eye system. This paper extends this framework to other problems of sensor-based robotics such as the derivation of depth maps from controlled motion; the vision-assisted grasping; the active calibration of the system robot-camera; and the computation of the relative pose of the target from the camera. We dealt with these problems by combining adaptive control techniques with computer vision algorithms. The paper concludes with a discussion on several relative issues such as the stability and robustness of the proposed algorithms.

UR - http://www.scopus.com/inward/record.url?scp=0029203125&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0029203125&partnerID=8YFLogxK

M3 - Conference article

AN - SCOPUS:0029203125

VL - 1

SP - 904

EP - 908

JO - Proceedings of the American Control Conference

JF - Proceedings of the American Control Conference

SN - 0743-1619

ER -