Augmenting image processing with social tag mining for landmark recognition

Amogh Mahapatra; Xin Wan; Yonghong Tian; Jaideep Srivastava

doi:10.1007/978-3-642-17832-0_26

Augmenting image processing with social tag mining for landmark recognition

Amogh Mahapatra, Xin Wan, Yonghong Tian, Jaideep Srivastava

Computer Science and Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

1 Scopus citations

Abstract

Social Multimedia computing is a new approach which combines the contextual information available in the social networks with available multimedia content to achieve greater accuracy in traditional multimedia problems like face and landmark recognition. Tian et al.[12] introduce this concept and suggest various fields where this approach yields significant benefits. In this paper, this approach has been applied to the landmark recognition problem. The dataset of flickr.com was used to select a set of images for a given landmark. Then image processing techniques were applied on the images and text mining techniques were applied on the accompanying social metadata to determine independent rankings. These rankings were combined using models similar to meta search engines to develop an improved integrated ranking system. Experiments have shown that the recombination approach gives better results than the separate analysis.

Original language	English (US)
Title of host publication	Advances in Multimedia Modeling - 17th International Multimedia Modeling Conference, MMM 2011, Proceedings
Pages	273-283
Number of pages	11
Edition	PART 1
DOIs	https://doi.org/10.1007/978-3-642-17832-0_26
State	Published - 2011
Event	17th Multimedia Modeling Conference, MMM 2011 - Taipei, Taiwan, Province of China Duration: Jan 5 2011 → Jan 7 2011

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Number	PART 1
Volume	6523 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Other

Other	17th Multimedia Modeling Conference, MMM 2011
Country/Territory	Taiwan, Province of China
City	Taipei
Period	1/5/11 → 1/7/11

Bibliographical note

Funding Information:
We would like to express our gratitude to members of the DMR lab in the University of Minneosta, for their valuable inputs during both design and discussion phase.This work is supported by a grant from the Chinese National Natural Science Foundation under contract number 60973055,a grant from the CADAL project and ARL Network Science CTA via BBN TECH/W911NF-09-2-0053.

Keywords

Landmark Recognition
Social Mutimedia Computing

Publisher link

10.1007/978-3-642-17832-0_26

Find It

Find It at U of M Libraries

Cite this

Mahapatra, A., Wan, X., Tian, Y., & Srivastava, J. (2011). Augmenting image processing with social tag mining for landmark recognition. In Advances in Multimedia Modeling - 17th International Multimedia Modeling Conference, MMM 2011, Proceedings (PART 1 ed., pp. 273-283). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 6523 LNCS, No. PART 1). https://doi.org/10.1007/978-3-642-17832-0_26

Augmenting image processing with social tag mining for landmark recognition. / Mahapatra, Amogh; Wan, Xin; Tian, Yonghong et al.
Advances in Multimedia Modeling - 17th International Multimedia Modeling Conference, MMM 2011, Proceedings. PART 1. ed. 2011. p. 273-283 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 6523 LNCS, No. PART 1).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Mahapatra, A, Wan, X, Tian, Y & Srivastava, J 2011, Augmenting image processing with social tag mining for landmark recognition. in Advances in Multimedia Modeling - 17th International Multimedia Modeling Conference, MMM 2011, Proceedings. PART 1 edn, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), no. PART 1, vol. 6523 LNCS, pp. 273-283, 17th Multimedia Modeling Conference, MMM 2011, Taipei, Taiwan, Province of China, 1/5/11. https://doi.org/10.1007/978-3-642-17832-0_26

Mahapatra A, Wan X, Tian Y, Srivastava J. Augmenting image processing with social tag mining for landmark recognition. In Advances in Multimedia Modeling - 17th International Multimedia Modeling Conference, MMM 2011, Proceedings. PART 1 ed. 2011. p. 273-283. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 1). doi: 10.1007/978-3-642-17832-0_26

Mahapatra, Amogh ; Wan, Xin ; Tian, Yonghong et al. / Augmenting image processing with social tag mining for landmark recognition. Advances in Multimedia Modeling - 17th International Multimedia Modeling Conference, MMM 2011, Proceedings. PART 1. ed. 2011. pp. 273-283 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 1).

@inproceedings{d6917ad0c3c3488483bfe33aa19e1ef6,

title = "Augmenting image processing with social tag mining for landmark recognition",

abstract = "Social Multimedia computing is a new approach which combines the contextual information available in the social networks with available multimedia content to achieve greater accuracy in traditional multimedia problems like face and landmark recognition. Tian et al.[12] introduce this concept and suggest various fields where this approach yields significant benefits. In this paper, this approach has been applied to the landmark recognition problem. The dataset of flickr.com was used to select a set of images for a given landmark. Then image processing techniques were applied on the images and text mining techniques were applied on the accompanying social metadata to determine independent rankings. These rankings were combined using models similar to meta search engines to develop an improved integrated ranking system. Experiments have shown that the recombination approach gives better results than the separate analysis.",

keywords = "Landmark Recognition, Social Mutimedia Computing",

author = "Amogh Mahapatra and Xin Wan and Yonghong Tian and Jaideep Srivastava",

note = "Funding Information: We would like to express our gratitude to members of the DMR lab in the University of Minneosta, for their valuable inputs during both design and discussion phase.This work is supported by a grant from the Chinese National Natural Science Foundation under contract number 60973055,a grant from the CADAL project and ARL Network Science CTA via BBN TECH/W911NF-09-2-0053.; 17th Multimedia Modeling Conference, MMM 2011 ; Conference date: 05-01-2011 Through 07-01-2011",

year = "2011",

doi = "10.1007/978-3-642-17832-0_26",

language = "English (US)",

isbn = "3642178316",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

number = "PART 1",

pages = "273--283",

booktitle = "Advances in Multimedia Modeling - 17th International Multimedia Modeling Conference, MMM 2011, Proceedings",

edition = "PART 1",

}

TY - GEN

T1 - Augmenting image processing with social tag mining for landmark recognition

AU - Mahapatra, Amogh

AU - Wan, Xin

AU - Tian, Yonghong

AU - Srivastava, Jaideep

N1 - Funding Information: We would like to express our gratitude to members of the DMR lab in the University of Minneosta, for their valuable inputs during both design and discussion phase.This work is supported by a grant from the Chinese National Natural Science Foundation under contract number 60973055,a grant from the CADAL project and ARL Network Science CTA via BBN TECH/W911NF-09-2-0053.

PY - 2011

Y1 - 2011

N2 - Social Multimedia computing is a new approach which combines the contextual information available in the social networks with available multimedia content to achieve greater accuracy in traditional multimedia problems like face and landmark recognition. Tian et al.[12] introduce this concept and suggest various fields where this approach yields significant benefits. In this paper, this approach has been applied to the landmark recognition problem. The dataset of flickr.com was used to select a set of images for a given landmark. Then image processing techniques were applied on the images and text mining techniques were applied on the accompanying social metadata to determine independent rankings. These rankings were combined using models similar to meta search engines to develop an improved integrated ranking system. Experiments have shown that the recombination approach gives better results than the separate analysis.

AB - Social Multimedia computing is a new approach which combines the contextual information available in the social networks with available multimedia content to achieve greater accuracy in traditional multimedia problems like face and landmark recognition. Tian et al.[12] introduce this concept and suggest various fields where this approach yields significant benefits. In this paper, this approach has been applied to the landmark recognition problem. The dataset of flickr.com was used to select a set of images for a given landmark. Then image processing techniques were applied on the images and text mining techniques were applied on the accompanying social metadata to determine independent rankings. These rankings were combined using models similar to meta search engines to develop an improved integrated ranking system. Experiments have shown that the recombination approach gives better results than the separate analysis.

KW - Landmark Recognition

KW - Social Mutimedia Computing

UR - http://www.scopus.com/inward/record.url?scp=78751674461&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=78751674461&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-17832-0_26

DO - 10.1007/978-3-642-17832-0_26

M3 - Conference contribution

AN - SCOPUS:78751674461

SN - 3642178316

SN - 9783642178313

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 273

EP - 283

BT - Advances in Multimedia Modeling - 17th International Multimedia Modeling Conference, MMM 2011, Proceedings

T2 - 17th Multimedia Modeling Conference, MMM 2011

Y2 - 5 January 2011 through 7 January 2011

ER -

Augmenting image processing with social tag mining for landmark recognition

Abstract

Publication series

Other

Bibliographical note

Keywords

Publisher link

Find It

Other files and links

Fingerprint

Cite this