Semantic saliency driven camera control for personal remote collaboration

Cha Zhang, Zicheng Liu, Zhengyou Zhang, Qi Zhao

Research output: Chapter in Book/Report/Conference proceedingConference contribution

12 Scopus citations

Abstract

This paper presents a camera combo system for personal remote collaboration applications. The system consists of two different cameras. One camera has a wide field of view, and the other can pan/tilt/zoom (PTZ) based on analysis of the images captured by the wide angle camera. Unlike traditional approaches which usually drive the PTZ camera to follow the person or his/her head, our system is capable of capturing general objects of interest in remote collaboration. For instance, when the user raises something trying to show it to the remote person, our system will automatically position the PTZ camera to zoom in at the object. At the core of our system is a semantic saliency map that overcomes many limitations of low-level saliency maps computed from preliminary image features. We demonstrate how such a semantic saliency map can be computed through contextual analysis, sign analysis and transitional analysis, and how it can be used for PTZ camera control with a novel information loss optimization based virtual director. The effectiveness of the proposed method is demonstrated with real-world sequences.

Original languageEnglish (US)
Title of host publicationProceedings of the 2008 IEEE 10th Workshop on Multimedia Signal Processing, MMSP 2008
Pages28-33
Number of pages6
DOIs
StatePublished - Dec 31 2008
Event2008 IEEE 10th Workshop on Multimedia Signal Processing, MMSP 2008 - Cairns, QLD, Australia
Duration: Oct 8 2008Oct 10 2008

Publication series

NameProceedings of the 2008 IEEE 10th Workshop on Multimedia Signal Processing, MMSP 2008

Other

Other2008 IEEE 10th Workshop on Multimedia Signal Processing, MMSP 2008
CountryAustralia
CityCairns, QLD
Period10/8/0810/10/08

Fingerprint Dive into the research topics of 'Semantic saliency driven camera control for personal remote collaboration'. Together they form a unique fingerprint.

  • Cite this

    Zhang, C., Liu, Z., Zhang, Z., & Zhao, Q. (2008). Semantic saliency driven camera control for personal remote collaboration. In Proceedings of the 2008 IEEE 10th Workshop on Multimedia Signal Processing, MMSP 2008 (pp. 28-33). [4665044] (Proceedings of the 2008 IEEE 10th Workshop on Multimedia Signal Processing, MMSP 2008). https://doi.org/10.1109/MMSP.2008.4665044