Optimal image-based euclidean calibration of structured light systems in general scenes

This paper presents a method to perform Euclidean calibration on camera and projector-based structured light systems, without assuming specific scene structure. The vast majority of the methods in the literature rely on prior knowledge of the 3D scene geometry in order to perform calibration, i.e., the nature of the occluding bodies in the scene needs to be known beforehand in order to calibrate structured light systems. Examples of prior knowledge used include using known stationary occluding bodies, precisely maneuvering known occluding bodies, knowing the exact world location of projected points or lines, or ensuring the entire scene obeys some other specific setup. By using multiple cameras, the method presented in this paper is able to calibrate camera and projector systems without requiring any of these constraints on occluding bodies in the scene. The method presented optimizes the calibration of the scene in terms of image-based reprojection error. Simulations are shown which characterize the effect noise has on the system, and experimental verification is performed on complex and cluttered scenes. The main contribution of this paper is the elimination of the requirement of using known occluding bodies in the scene for camera and projector-based structured light system calibration, which has not been extensively studied.