An analysis of logistic models: Exponential family connections and online performance

Research output: Chapter in Book/Report/Conference proceedingConference contribution

18 Scopus citations

Abstract

Logistic models are arguably one of the most widely used data analysis techniques. In this paper, we present analyses focussing on two important aspects of logistic models-its relationship with exponential family based generative models, and its performance in online and potentially adversarial settings. In particular, we present two new theoretical results on logistic models focusing on the above two aspects. First, we establish an exact connection between logistic models and exponential family based generative models, resolving a long-standing ambiguity over their relationship. Second, we show that online Bayesian logistic models are competitive to the best batch models, even in potentially adversarial settings. Further, we discuss relevant connections of our analysis to the literature on integral transforms, and also present a new optimality result for Bayesian models. The analysis makes a strong case for using logistic models and partly explains the success of such models for a wide range of practical problems.

Original languageEnglish (US)
Title of host publicationProceedings of the 7th SIAM International Conference on Data Mining
PublisherSociety for Industrial and Applied Mathematics Publications
Pages204-215
Number of pages12
ISBN (Print)9780898716306
DOIs
StatePublished - 2007
Externally publishedYes
Event7th SIAM International Conference on Data Mining - Minneapolis, MN, United States
Duration: Apr 26 2007Apr 28 2007

Publication series

NameProceedings of the 7th SIAM International Conference on Data Mining

Other

Other7th SIAM International Conference on Data Mining
Country/TerritoryUnited States
CityMinneapolis, MN
Period4/26/074/28/07

Fingerprint

Dive into the research topics of 'An analysis of logistic models: Exponential family connections and online performance'. Together they form a unique fingerprint.

Cite this