Large margin hierarchical classification with mutually exclusive class membership

Huixin Wang, Xiaotong T Shen, Wei Pan

Research output: Contribution to journalArticle

7 Scopus citations

Abstract

In hierarchical classification, class labels are structured, that is each label value corresponds to one non-root node in a tree, where the inter-class relationship for classification is specified by directed paths of the tree. In such a situation, the focus has been on how to leverage the interclass relationship to enhance the performance of flat classification, which ignores such dependency. This is critical when the number of classes becomes large relative to the sample size. This paper considers single-path or partial-path hierarchical classification, where only one path is permitted from the root to a leaf node. A large margin method is introduced based on a new concept of generalized margins with respect to hierarchy. For implementation, we consider support vector machines and ψ-learning. Numerical and theoretical analyses suggest that the proposed method achieves the desired objective and compares favorably against strong competitors in the literature, including its flat counterparts. Finally, an application to gene function prediction is discussed.

Original languageEnglish (US)
Pages (from-to)2721-2748
Number of pages28
JournalJournal of Machine Learning Research
Volume12
StatePublished - Sep 1 2011

    Fingerprint

Keywords

  • Difference convex programming
  • Gene function annotation
  • Margins
  • Multi-class classification
  • Structured learning

Cite this