Automatic real-time detection of endoscopic procedures using temporal features

Sean R. Stanek, Wallapak Tavanapong, Johnny Wong, Jung Hwan Oh, Piet C. de Groen

Research output: Contribution to journalArticlepeer-review

24 Scopus citations


Endoscopy is used for inspection of the inner surface of organs such as the colon. During endoscopic inspection of the colon or colonoscopy, a tiny video camera generates a video signal, which is displayed on a monitor for interpretation in real-time by physicians. In practice, these images are not typically captured, which may be attributed by lack of fully automated tools for capturing, analysis of important contents, and quick and easy retrieval of these contents. This paper presents the description and evaluation results of our novel software that uses new metrics based on image color and motion over time to automatically record all images of an individual endoscopic procedure into a single digitized video file. The software automatically discards out-patient video frames between different endoscopic procedures. We validated our software system on 2464. h of live video (over 265 million frames) from endoscopy units where colonoscopy and upper endoscopy were performed. Our previous classification method achieved a frame-based sensitivity of 100.00%, but only a specificity of 89.22%. Our new method achieved a frame-based sensitivity and specificity of 99.90% and 99.97%, a significant improvement. Our system is robust for day-to-day use in medical practice.

Original languageEnglish (US)
Pages (from-to)524-535
Number of pages12
JournalComputer Methods and Programs in Biomedicine
Issue number2
StatePublished - Nov 2012
Externally publishedYes

Bibliographical note

Funding Information:
This work was supported in part by the National Science Foundation grant nos. 0740596 , IIP-0956847 , Agency for Healthcare Research and Quality grant no. HS17537 and National Institute of Diabetes and Digestive and Kidney Diseases DK083745 , the Mayo Clinic, Grow Iowa Values Fund, and Iowa State University Research Foundation. Wong, Tavanapong and Oh hold positions at EndoMetric Corporation, Ames, IA 50014, USA, a for profit company that markets endoscopy-related software. Wong, Tavanapong, Oh and Mayo Clinic own stock in EndoMetric. Wong, Tavanapong and de Groen have received royalty payments from EndoMetric. Findings, opinions, and conclusions expressed in this paper do not necessarily reflect the view of the funding agencies.


  • Colonoscopy
  • Endoscopy
  • Image analysis
  • Real-time
  • Video capture
  • Video content analysis


Dive into the research topics of 'Automatic real-time detection of endoscopic procedures using temporal features'. Together they form a unique fingerprint.

Cite this