Skip to main navigation Skip to search Skip to main content

Efficient and Robust Semi-supervised Estimation of Average Treatment Effect with Partially Annotated Treatment and Response

  • Jue Hou
  • , Rajarshi Mukherjee
  • , Tianxi Cai

Research output: Contribution to journalArticlepeer-review

Abstract

A notable challenge of leveraging Electronic Health Records (EHR) for treatment effect assessment is the lack of precise information on important clinical variables, including the treatment received and the response. Both treatment information and response cannot be accurately captured by readily available EHR features in many studies and require labor-intensive manual chart review to precisely annotate, which limits the number of available gold standard labels on these key variables. We considered average treatment effect (ATE) estimation when 1) exact treatment and outcome variables are only observed together in a small labeled subset and 2) noisy surrogates of treatment and outcome, such as relevant prescription and diagnosis codes, along with potential confounders are observed for all subjects. We derived the efficient influence function for ATE and used it to construct a semi-supervised multiple machine learning (SMMAL) estimator. We justified that our SMMAL ATE estimator is semi-parametric efficient with B-spline regression under low-dimensional smooth models. We developed the adaptive sparsity/model doubly robust estimation under high-dimensional logistic propensity score and outcome regression models. Results from simulation studies demonstrated the validity of our SMMAL method and its superiority over supervised and unsupervised benchmarks. We applied SMMAL to the assessment of targeted therapies for metastatic colorectal cancer in comparison to chemotherapy.

Original languageEnglish (US)
JournalJournal of Machine Learning Research
Volume26
StatePublished - 2025

Bibliographical note

Publisher Copyright:
©2025 Jue Hou, Rajarshi Mukherjee, Tianxi Cai.

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

  1. SDG 3 - Good Health and Well-being
    SDG 3 Good Health and Well-being

Keywords

  • double robustness
  • high-dimensional regression
  • semi-parametric efficiency
  • semi-supervised learning

Fingerprint

Dive into the research topics of 'Efficient and Robust Semi-supervised Estimation of Average Treatment Effect with Partially Annotated Treatment and Response'. Together they form a unique fingerprint.

Cite this