Ultra-scalable and efficient methods for hybrid observational and experimental local causal pathway discovery

Alexander Statnikov, Sisi Ma, Mikael Henaff, Nikita Lytkin, Efstratios Efstathiadis, Eric R. Peskin, Constantin F. Aliferis

Research output: Contribution to journalArticlepeer-review

8 Scopus citations

Abstract

Discovery of causal relations from data is a fundamental objective of several scientific disciplines. Most causal discovery algorithms that use observational data can infer causality only up to a statistical equivalency class, thus leaving many causal relations undetermined. In general, complete identification of causal relations requires experimentation to augment discoveries from observational data. This has led to the recent development of several methods for active learning of causal networks that utilize both observational and experimental data in order to discover causal networks. In this work, we focus on the problem of discovering local causal pathways that contain only direct causes and direct effects of the target variable of interest and propose new discovery methods that aim to minimize the number of required experiments, relax common sufficient discovery assumptions in order to increase discovery accuracy, and scale to high-dimensional data with thousands of variables. We conduct a comprehensive evaluation of new and existing methods with data of dimensionality up to 1,000,000 variables. We use both artificially simulated networks and in-silico gene transcriptional networks that model the characteristics of real gene expression data.

Original languageEnglish (US)
Pages (from-to)3219-3267
Number of pages49
JournalJournal of Machine Learning Research
Volume16
StatePublished - Dec 2015

Keywords

  • Causality
  • Experimental data
  • Large-scale experimental design
  • Local causal pathway discovery
  • Observational data
  • Randomized experiments

Fingerprint Dive into the research topics of 'Ultra-scalable and efficient methods for hybrid observational and experimental local causal pathway discovery'. Together they form a unique fingerprint.

Cite this