ParCube: Sparse parallelizable CANDECOMP-PARAFAC tensor decomposition

Evangelos E. Papalexakis, Christos Faloutsos, Nicholas D. Sidiropoulos

Research output: Contribution to journalArticlepeer-review

21 Scopus citations

Abstract

How can we efficiently decompose a tensor into sparse factors, when the data do not fit in memory? Tensor decompositions have gained a steadily increasing popularity in data-mining applications; however, the current state-of-art decomposition algorithms operate on main memory and do not scale to truly large datasets. In this work, we propose PARCUBE, a new and highly parallelizable method for speeding up tensor decompositions that is well suited to produce sparse approximations. Experiments with even moderately large data indicate over 90% sparser outputs and 14 times faster execution, with approximation error close to the current state of the art irrespective of computation and memory requirements. We provide theoretical guarantees for the algorithm's correctness and we experimentally validate our claims through extensive experiments, including four different real world datasets (ENRON, LBNL, FACEBOOK and NELL), demonstrating its effectiveness for data-mining practitioners. In particular, we are the first to analyze the very large NELL dataset using a sparse tensor decomposition, demonstrating that PARCUBE enables us to handle effectively and efficiently very large datasets. Finally, we make our highly scalable parallel implementation publicly available, enabling reproducibility of our work.

Original languageEnglish (US)
Article number3
JournalACM Transactions on Knowledge Discovery from Data
Volume10
Issue number1
DOIs
StatePublished - Jul 1 2015

Bibliographical note

Publisher Copyright:
© 2015 ACM.

Keywords

  • Algorithms
  • H.2.8 [database applications]: Data mining
  • H.3.3 [information search and retrieval]: Clustering
  • PARAFA decomposition
  • Parallel algorithms
  • Performance
  • Randomized algorithms
  • Sampling
  • Sparsity
  • Tensors

Fingerprint

Dive into the research topics of 'ParCube: Sparse parallelizable CANDECOMP-PARAFAC tensor decomposition'. Together they form a unique fingerprint.

Cite this