Saliency prediction with scene structural guidance

Haoran Liang, Ming Jiang, Ronghua Liang, Qi Zhao

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations

Abstract

Previous works have suggested the role of scene information in directing gaze. The structure of a scene provides global contextual information that complements local object information in saliency prediction. In this study, we explore how scene envelopes such as openness, depth, and perspective affect visual attention in natural outdoor images. To facilitate this study, an eye tracking dataset is first built with 500 natural scene images and eye tracking data with 15 subjects free-viewing the images. We make observations on scene layout properties and propose a set of scene structural features relating to visual attention. We further integrate features from deep neural networks and use the set of complementary features for saliency prediction. Our features are independent of and can work together with many computational modules, and this work demonstrates the use of Multiple kernel learning (MKL) as an example to integrate the features at low- and high-levels. Experimental results demonstrate that our model outperforms existing methods and our scene structural features can improve the performance of other saliency models in outdoor scenes.

Original languageEnglish (US)
Title of host publication2017 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2017
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages3483-3488
Number of pages6
ISBN (Electronic)9781538616451
DOIs
StatePublished - Nov 27 2017
Event2017 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2017 - Banff, Canada
Duration: Oct 5 2017Oct 8 2017

Publication series

Name2017 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2017
Volume2017-January

Other

Other2017 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2017
CountryCanada
CityBanff
Period10/5/1710/8/17

Keywords

  • Eye-tracking dataset
  • Scene envelop
  • Visual saliency

Fingerprint Dive into the research topics of 'Saliency prediction with scene structural guidance'. Together they form a unique fingerprint.

  • Cite this

    Liang, H., Jiang, M., Liang, R., & Zhao, Q. (2017). Saliency prediction with scene structural guidance. In 2017 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2017 (pp. 3483-3488). (2017 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2017; Vol. 2017-January). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/SMC.2017.8123170