High dimensional data analysis using multivariate generalized spatial quantiles

Nitai D. Mukhopadhyay, Snigdhansu Chatterjee

Research output: Contribution to journalArticle

5 Scopus citations

Abstract

High dimensional data routinely arises in image analysis, genetic experiments, network analysis, and various other research areas. Many such datasets do not correspond to well-studied probability distributions, and in several applications the data-cloud prominently displays non-symmetric and non-convex shape features. We propose using spatial quantiles and their generalizations, in particular, the projection quantile, for describing, analyzing and conducting inference with multivariate data. Minimal assumptions are made about the nature and shape characteristics of the underlying probability distribution, and we do not require the sample size to be as high as the data-dimension. We present theoretical properties of the generalized spatial quantiles, and an algorithm to compute them quickly. Our quantiles may be used to obtain multidimensional confidence or credible regions that are not required to conform to a pre-determined shape. We also propose a new notion of multidimensional order statistics, which may be used to obtain multidimensional outliers. Many of the features revealed using a generalized spatial quantile-based analysis would be missed if the data was shoehorned into a well-known probabilistic configuration.

Original languageEnglish (US)
Pages (from-to)768-780
Number of pages13
JournalJournal of Multivariate Analysis
Volume102
Issue number4
DOIs
StatePublished - Apr 1 2011

    Fingerprint

Keywords

  • Brain imaging
  • Generalized spatial quantile
  • High dimensional data visualization
  • Multidimensional coverage sets
  • Multivariate order statistics
  • Multivariate quantile
  • Projection quantile
  • Spatial quantile

Cite this