Pedestrian detection by multi-spectral fusion

Yunqian Ma, Zheng Wang, Mike Bazakos

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Scopus citations


Security systems increasingly rely on the use of Automated Video Surveillance (AVS) technology. In particular the use of digital video renders itself to internet and local communications, remote monitoring, and to computer processing. AVS systems can perform many tedious and repetitive tasks currently performed by trained security personnel. AVS technology has already made some significant steps towards automating some basic security functions such as: motion detection, object tracking and event-based video recording. However, there are still many problems associated with just these automated functions, which need to be addressed further. Some examples of these problems are: the high "false alarm rate" and the "loss of track" under total or partial occlusion, when used under a wide range of operational parameters (day, night, sunshine, cloudy, foggy, range, viewing angle, clutter, etc.). Current surveillance systems work well only under a narrow range of operational parameters. Therefore, they need be hardened against a wide range of operational conditions. In this paper, we present a Multi-spectral fusion approach to perform accurate pedestrian segmentation under varying operational parameters. Our fusion method combines the "best" detection results from the visible images and the "best" from the thermal images. Commonly, the motion detection results in the visible images are easily affected by noise and shadows. The objects in the thermal image are relatively stable, but they may be missing some parts of the objects, because they thermally blend with the background. Our method makes use of the "best" object components and de-emphasize the "not best".

Original languageEnglish (US)
Title of host publicationMultisensor, Multisource Information Fusion
Subtitle of host publicationArchitectures, Algorithms, and Applications 2006
StatePublished - 2006
EventMultisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2006 - Kissimmee, FL, United States
Duration: Apr 19 2006Apr 20 2006

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
ISSN (Print)0277-786X


ConferenceMultisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2006
Country/TerritoryUnited States
CityKissimmee, FL


  • Level Set
  • Pedestrian detection
  • Sensor Fusion
  • Surveillance


Dive into the research topics of 'Pedestrian detection by multi-spectral fusion'. Together they form a unique fingerprint.

Cite this