Real-Time Instrument Scene Detection in Screening GI Endoscopic Procedures

Chuanhai Zhang; Wallapak Tavanapong; Johnny Wong; Piet C.De Groen; Junghwan Oh

doi:10.1109/CBMS.2017.42

Real-Time Instrument Scene Detection in Screening GI Endoscopic Procedures

Chuanhai Zhang
, Wallapak Tavanapong
, Johnny Wong
, Piet C.De Groen
, Junghwan Oh

Medicine - Gastro, Hepatology, Nutrition Division

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

2 Scopus citations

Abstract

We describe a new and effective real-time solution for detecting video segments showing an instrument used during diagnostic or therapeutic operations in endoscopic procedures. In addition, we present a new method to collect a large training dataset: similarity-based data augmentation. This method automates most of the creation of a large training dataset and prevents extensive manual effort to collect and annotate training data by domain experts. Convolutional Neural Network (CNN) analysis using the training data collected with similarity-based data augmentation yields an average F1 score within 1% of that of the CNN analysis using a large manually collected training dataset.

Original language	English (US)
Title of host publication	Proceedings - 2017 IEEE 30th International Symposium on Computer-Based Medical Systems, CBMS 2017
Editors	Panagiotis D. Bamidis, Stathis Th. Konstantinidis, Pedro Pereira Rodrigues
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	720-725
Number of pages	6
ISBN (Electronic)	9781538617106
DOIs	https://doi.org/10.1109/CBMS.2017.42
State	Published - Nov 10 2017
Event	30th IEEE International Symposium on Computer-Based Medical Systems, CBMS 2017 - Thessaloniki, Greece Duration: Jun 22 2017 → Jun 24 2017

Publication series

Name	Proceedings - IEEE Symposium on Computer-Based Medical Systems
Volume	2017-June
ISSN (Print)	1063-7125

Other

Other	30th IEEE International Symposium on Computer-Based Medical Systems, CBMS 2017
Country/Territory	Greece
City	Thessaloniki
Period	6/22/17 → 6/24/17

Bibliographical note

Publisher Copyright:
© 2017 IEEE.

Keywords

CNN
Scene Detection
Similarity Learning

Publisher link

10.1109/CBMS.2017.42

Find It

Find It at U of M Libraries

Cite this

Zhang, C., Tavanapong, W., Wong, J., Groen, P. C. D., & Oh, J. (2017). Real-Time Instrument Scene Detection in Screening GI Endoscopic Procedures. In P. D. Bamidis, S. T. Konstantinidis, & P. P. Rodrigues (Eds.), Proceedings - 2017 IEEE 30th International Symposium on Computer-Based Medical Systems, CBMS 2017 (pp. 720-725). Article 8104286 (Proceedings - IEEE Symposium on Computer-Based Medical Systems; Vol. 2017-June). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/CBMS.2017.42

Real-Time Instrument Scene Detection in Screening GI Endoscopic Procedures. / Zhang, Chuanhai; Tavanapong, Wallapak; Wong, Johnny et al.
Proceedings - 2017 IEEE 30th International Symposium on Computer-Based Medical Systems, CBMS 2017. ed. / Panagiotis D. Bamidis; Stathis Th. Konstantinidis; Pedro Pereira Rodrigues. Institute of Electrical and Electronics Engineers Inc., 2017. p. 720-725 8104286 (Proceedings - IEEE Symposium on Computer-Based Medical Systems; Vol. 2017-June).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Zhang, C, Tavanapong, W, Wong, J, Groen, PCD & Oh, J 2017, Real-Time Instrument Scene Detection in Screening GI Endoscopic Procedures. in PD Bamidis, ST Konstantinidis & PP Rodrigues (eds), Proceedings - 2017 IEEE 30th International Symposium on Computer-Based Medical Systems, CBMS 2017., 8104286, Proceedings - IEEE Symposium on Computer-Based Medical Systems, vol. 2017-June, Institute of Electrical and Electronics Engineers Inc., pp. 720-725, 30th IEEE International Symposium on Computer-Based Medical Systems, CBMS 2017, Thessaloniki, Greece, 6/22/17. https://doi.org/10.1109/CBMS.2017.42

Zhang C, Tavanapong W, Wong J, Groen PCD, Oh J. Real-Time Instrument Scene Detection in Screening GI Endoscopic Procedures. In Bamidis PD, Konstantinidis ST, Rodrigues PP, editors, Proceedings - 2017 IEEE 30th International Symposium on Computer-Based Medical Systems, CBMS 2017. Institute of Electrical and Electronics Engineers Inc. 2017. p. 720-725. 8104286. (Proceedings - IEEE Symposium on Computer-Based Medical Systems). doi: 10.1109/CBMS.2017.42

Zhang, Chuanhai ; Tavanapong, Wallapak ; Wong, Johnny et al. / Real-Time Instrument Scene Detection in Screening GI Endoscopic Procedures. Proceedings - 2017 IEEE 30th International Symposium on Computer-Based Medical Systems, CBMS 2017. editor / Panagiotis D. Bamidis ; Stathis Th. Konstantinidis ; Pedro Pereira Rodrigues. Institute of Electrical and Electronics Engineers Inc., 2017. pp. 720-725 (Proceedings - IEEE Symposium on Computer-Based Medical Systems).

@inproceedings{0b7c04a51af44844856bc838e3425cd3,

title = "Real-Time Instrument Scene Detection in Screening GI Endoscopic Procedures",

abstract = "We describe a new and effective real-time solution for detecting video segments showing an instrument used during diagnostic or therapeutic operations in endoscopic procedures. In addition, we present a new method to collect a large training dataset: similarity-based data augmentation. This method automates most of the creation of a large training dataset and prevents extensive manual effort to collect and annotate training data by domain experts. Convolutional Neural Network (CNN) analysis using the training data collected with similarity-based data augmentation yields an average F1 score within 1\% of that of the CNN analysis using a large manually collected training dataset.",

keywords = "CNN, Scene Detection, Similarity Learning",

author = "Chuanhai Zhang and Wallapak Tavanapong and Johnny Wong and Groen, \{Piet C.De\} and Junghwan Oh",

note = "Publisher Copyright: {\textcopyright} 2017 IEEE.; 30th IEEE International Symposium on Computer-Based Medical Systems, CBMS 2017 ; Conference date: 22-06-2017 Through 24-06-2017",

year = "2017",

month = nov,

day = "10",

doi = "10.1109/CBMS.2017.42",

language = "English (US)",

series = "Proceedings - IEEE Symposium on Computer-Based Medical Systems",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "720--725",

editor = "Bamidis, \{Panagiotis D.\} and Konstantinidis, \{Stathis Th.\} and Rodrigues, \{Pedro Pereira\}",

booktitle = "Proceedings - 2017 IEEE 30th International Symposium on Computer-Based Medical Systems, CBMS 2017",

}

TY - GEN

T1 - Real-Time Instrument Scene Detection in Screening GI Endoscopic Procedures

AU - Zhang, Chuanhai

AU - Tavanapong, Wallapak

AU - Wong, Johnny

AU - Groen, Piet C.De

AU - Oh, Junghwan

PY - 2017/11/10

Y1 - 2017/11/10

N2 - We describe a new and effective real-time solution for detecting video segments showing an instrument used during diagnostic or therapeutic operations in endoscopic procedures. In addition, we present a new method to collect a large training dataset: similarity-based data augmentation. This method automates most of the creation of a large training dataset and prevents extensive manual effort to collect and annotate training data by domain experts. Convolutional Neural Network (CNN) analysis using the training data collected with similarity-based data augmentation yields an average F1 score within 1% of that of the CNN analysis using a large manually collected training dataset.

AB - We describe a new and effective real-time solution for detecting video segments showing an instrument used during diagnostic or therapeutic operations in endoscopic procedures. In addition, we present a new method to collect a large training dataset: similarity-based data augmentation. This method automates most of the creation of a large training dataset and prevents extensive manual effort to collect and annotate training data by domain experts. Convolutional Neural Network (CNN) analysis using the training data collected with similarity-based data augmentation yields an average F1 score within 1% of that of the CNN analysis using a large manually collected training dataset.

KW - CNN

KW - Scene Detection

KW - Similarity Learning

UR - https://www.scopus.com/pages/publications/85040342841

UR - https://www.scopus.com/pages/publications/85040342841#tab=citedBy

U2 - 10.1109/CBMS.2017.42

DO - 10.1109/CBMS.2017.42

M3 - Conference contribution

AN - SCOPUS:85040342841

T3 - Proceedings - IEEE Symposium on Computer-Based Medical Systems

SP - 720

EP - 725

BT - Proceedings - 2017 IEEE 30th International Symposium on Computer-Based Medical Systems, CBMS 2017

A2 - Bamidis, Panagiotis D.

A2 - Konstantinidis, Stathis Th.

A2 - Rodrigues, Pedro Pereira

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 30th IEEE International Symposium on Computer-Based Medical Systems, CBMS 2017

Y2 - 22 June 2017 through 24 June 2017

ER -

Real-Time Instrument Scene Detection in Screening GI Endoscopic Procedures

Abstract

Publication series

Other

Bibliographical note

Keywords

Publisher link

Find It

Other files and links

Fingerprint

Cite this