Augmenting image processing with social tag mining for landmark recognition

Amogh Mahapatra, Xin Wan, Yonghong Tian, Jaideep Srivastava

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations


Social Multimedia computing is a new approach which combines the contextual information available in the social networks with available multimedia content to achieve greater accuracy in traditional multimedia problems like face and landmark recognition. Tian et al.[12] introduce this concept and suggest various fields where this approach yields significant benefits. In this paper, this approach has been applied to the landmark recognition problem. The dataset of was used to select a set of images for a given landmark. Then image processing techniques were applied on the images and text mining techniques were applied on the accompanying social metadata to determine independent rankings. These rankings were combined using models similar to meta search engines to develop an improved integrated ranking system. Experiments have shown that the recombination approach gives better results than the separate analysis.

Original languageEnglish (US)
Title of host publicationAdvances in Multimedia Modeling - 17th International Multimedia Modeling Conference, MMM 2011, Proceedings
Number of pages11
EditionPART 1
StatePublished - 2011
Event17th Multimedia Modeling Conference, MMM 2011 - Taipei, Taiwan, Province of China
Duration: Jan 5 2011Jan 7 2011

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
NumberPART 1
Volume6523 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


Other17th Multimedia Modeling Conference, MMM 2011
Country/TerritoryTaiwan, Province of China

Bibliographical note

Funding Information:
We would like to express our gratitude to members of the DMR lab in the University of Minneosta, for their valuable inputs during both design and discussion phase.This work is supported by a grant from the Chinese National Natural Science Foundation under contract number 60973055,a grant from the CADAL project and ARL Network Science CTA via BBN TECH/W911NF-09-2-0053.


  • Landmark Recognition
  • Social Mutimedia Computing


Dive into the research topics of 'Augmenting image processing with social tag mining for landmark recognition'. Together they form a unique fingerprint.

Cite this