Passive non-line-of-sight imaging using plenoptic information

Di Lin, Connor Hashemi, James R. Leger

Research output: Contribution to journalArticlepeer-review

12 Scopus citations


We present a methodology for recovering the perspective imagery of a non-line-of-sight scene based on plenoptic observations of indirect photons scattered from a homogeneous surface. Our framework segregates the visual contents observed along the scattering surface into angular and spatial components. Given the reflectance characteristics of the scatterer, we show that the former can be deduced from scattering measurements employing diversity in angle at individual surface points, whereas the latter can be deduced from captured images of the scatterer based on prior knowledge of occlusions within the scene. We then combine the visual contents from both components into a plenoptic modality capable of imaging at higher resolutions than what is allowed by the angular information content and discriminating against extraneous signals in complex scenes that spatial information struggles to discern. We demonstrate the efficacy of this approach by reconstructing the imagery of test scenes from both synthetic and measured data.

Original languageEnglish (US)
Pages (from-to)540-551
Number of pages12
JournalJournal of the Optical Society of America A: Optics and Image Science, and Vision
Issue number4
StatePublished - Apr 1 2020

Bibliographical note

Funding Information:
Acknowledgment. This work was funded by DARPA (contract HR0011-16-C-0024). The views, opinions, and/or findings contained in this article are those of the authors and should not be interpreted as representing the official views or policies of the Department of Defense or the U.S. Government.

Publisher Copyright:
© 2020 Optical Society of America.


Dive into the research topics of 'Passive non-line-of-sight imaging using plenoptic information'. Together they form a unique fingerprint.

Cite this