The F-norm support vector machine

Zou Hui, Yuan Ming

Research output: Contribution to journalArticle

61 Scopus citations

Abstract

In this paper we propose a new support vector machine (SVM), the F -norm SVM, to perform automatic factor selection in classification. The Foo-norm SVM methodology is motivated by the feature selection problem in cases where the input features are generated by factors, and the model is best interpreted in terms of significant factors. This type of problem arises naturally when a set of dummy variables is used to represent a categorical factor and/or a set of basis functions of a continuous variable is included in the predictor set. In problems without such obvious group information, we propose to first create groups among features by clustering, and then apply the Foo-norm SVM. We show that the Foo-norm SVM is equivalent to a linear programming problem and can be efficiently solved using standard techniques. Analysis on simulated and real data shows that the Foo-norm SVM enjoys competitive performance when compared with the 1-norm and 2-norm SVMs.

Original languageEnglish (US)
Pages (from-to)379-398
Number of pages20
JournalStatistica Sinica
Volume18
Issue number1
StatePublished - Jan 1 2008

Keywords

  • F penalty
  • Factor selection
  • Feature selection
  • L penalty
  • Linear programming
  • Support vector machine

Fingerprint Dive into the research topics of 'The F<sub>∞</sub>-norm support vector machine'. Together they form a unique fingerprint.

  • Cite this

    Hui, Z., & Ming, Y. (2008). The F-norm support vector machine. Statistica Sinica, 18(1), 379-398.