Blended shared control utilizing online identification: Regulating grasping forces of a surrogate surgical grasper

Trevor K. Stephens, Nathan J. Kong, Rodney L. Dockter, John J. O’Neill, Robert M. Sweet, Timothy M. Kowalewski

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Purpose: Surgical robots are increasingly common, yet routine tasks such as tissue grasping remain potentially harmful with high occurrences of tissue crush injury due to the lack of force feedback from the grasper. This work aims to investigate whether a blended shared control framework which utilizes real-time identification of the object being grasped as part of the feedback may help address the prevalence of tissue crush injury in robotic surgeries. Methods: This work tests the proposed shared control framework and tissue identification algorithm on a custom surrogate surgical robotic grasping setup. This scheme utilizes identification of the object being grasped as part of the feedback to regulate to a desired force. The blended shared control is arbitrated between human and an implicit force controller based on a computed confidence in the identification of the grasped object. The online identification is performed using least squares based on a nonlinear tissue model. Testing was performed on five silicone tissue surrogates. Twenty grasps were conducted, with half of the grasps performed under manual control and half of the grasps performed with the proposed blended shared control, to test the efficacy of the control scheme. Results: The identification method resulted in an average of 95% accuracy across all time samples of all tissue grasps using a full leave-grasp-out cross-validation. There was an average convergence time of 8.1 ± 6.3 ms across all training grasps for all tissue surrogates. Additionally, there was a reduction in peak forces induced during grasping for all tissue surrogates when applying blended shared control online. Conclusion: The blended shared control using online identification more successfully regulated grasping forces to the desired target force when compared with manual control. The preliminary work on this surrogate setup for surgical grasping merits further investigation on real surgical tools and with real human tissues.

Original languageEnglish (US)
Pages (from-to)769-776
Number of pages8
JournalInternational Journal of Computer Assisted Radiology and Surgery
Volume13
Issue number6
DOIs
StatePublished - Jun 1 2018

Fingerprint

Tissue
Hand Strength
Manual control
Identification (control systems)
Robotics
Feedback
Nonlinear Dynamics
Silicones
Least-Squares Analysis
Controllers
Testing

Keywords

  • Robotic surgery
  • Shared control
  • Tissue crush injury
  • Tissue identification

PubMed: MeSH publication types

  • Journal Article

Cite this

Blended shared control utilizing online identification : Regulating grasping forces of a surrogate surgical grasper. / Stephens, Trevor K.; Kong, Nathan J.; Dockter, Rodney L.; O’Neill, John J.; Sweet, Robert M.; Kowalewski, Timothy M.

In: International Journal of Computer Assisted Radiology and Surgery, Vol. 13, No. 6, 01.06.2018, p. 769-776.

Research output: Contribution to journalArticle

@article{e8504c6ede604c29b0bfa0219a2863ab,
title = "Blended shared control utilizing online identification: Regulating grasping forces of a surrogate surgical grasper",
abstract = "Purpose: Surgical robots are increasingly common, yet routine tasks such as tissue grasping remain potentially harmful with high occurrences of tissue crush injury due to the lack of force feedback from the grasper. This work aims to investigate whether a blended shared control framework which utilizes real-time identification of the object being grasped as part of the feedback may help address the prevalence of tissue crush injury in robotic surgeries. Methods: This work tests the proposed shared control framework and tissue identification algorithm on a custom surrogate surgical robotic grasping setup. This scheme utilizes identification of the object being grasped as part of the feedback to regulate to a desired force. The blended shared control is arbitrated between human and an implicit force controller based on a computed confidence in the identification of the grasped object. The online identification is performed using least squares based on a nonlinear tissue model. Testing was performed on five silicone tissue surrogates. Twenty grasps were conducted, with half of the grasps performed under manual control and half of the grasps performed with the proposed blended shared control, to test the efficacy of the control scheme. Results: The identification method resulted in an average of 95{\%} accuracy across all time samples of all tissue grasps using a full leave-grasp-out cross-validation. There was an average convergence time of 8.1 ± 6.3 ms across all training grasps for all tissue surrogates. Additionally, there was a reduction in peak forces induced during grasping for all tissue surrogates when applying blended shared control online. Conclusion: The blended shared control using online identification more successfully regulated grasping forces to the desired target force when compared with manual control. The preliminary work on this surrogate setup for surgical grasping merits further investigation on real surgical tools and with real human tissues.",
keywords = "Robotic surgery, Shared control, Tissue crush injury, Tissue identification",
author = "Stephens, {Trevor K.} and Kong, {Nathan J.} and Dockter, {Rodney L.} and O’Neill, {John J.} and Sweet, {Robert M.} and Kowalewski, {Timothy M.}",
year = "2018",
month = "6",
day = "1",
doi = "10.1007/s11548-018-1745-3",
language = "English (US)",
volume = "13",
pages = "769--776",
journal = "Computer-Assisted Radiology and Surgery",
issn = "1861-6410",
publisher = "Springer Verlag",
number = "6",

}

TY - JOUR

T1 - Blended shared control utilizing online identification

T2 - Regulating grasping forces of a surrogate surgical grasper

AU - Stephens, Trevor K.

AU - Kong, Nathan J.

AU - Dockter, Rodney L.

AU - O’Neill, John J.

AU - Sweet, Robert M.

AU - Kowalewski, Timothy M.

PY - 2018/6/1

Y1 - 2018/6/1

N2 - Purpose: Surgical robots are increasingly common, yet routine tasks such as tissue grasping remain potentially harmful with high occurrences of tissue crush injury due to the lack of force feedback from the grasper. This work aims to investigate whether a blended shared control framework which utilizes real-time identification of the object being grasped as part of the feedback may help address the prevalence of tissue crush injury in robotic surgeries. Methods: This work tests the proposed shared control framework and tissue identification algorithm on a custom surrogate surgical robotic grasping setup. This scheme utilizes identification of the object being grasped as part of the feedback to regulate to a desired force. The blended shared control is arbitrated between human and an implicit force controller based on a computed confidence in the identification of the grasped object. The online identification is performed using least squares based on a nonlinear tissue model. Testing was performed on five silicone tissue surrogates. Twenty grasps were conducted, with half of the grasps performed under manual control and half of the grasps performed with the proposed blended shared control, to test the efficacy of the control scheme. Results: The identification method resulted in an average of 95% accuracy across all time samples of all tissue grasps using a full leave-grasp-out cross-validation. There was an average convergence time of 8.1 ± 6.3 ms across all training grasps for all tissue surrogates. Additionally, there was a reduction in peak forces induced during grasping for all tissue surrogates when applying blended shared control online. Conclusion: The blended shared control using online identification more successfully regulated grasping forces to the desired target force when compared with manual control. The preliminary work on this surrogate setup for surgical grasping merits further investigation on real surgical tools and with real human tissues.

AB - Purpose: Surgical robots are increasingly common, yet routine tasks such as tissue grasping remain potentially harmful with high occurrences of tissue crush injury due to the lack of force feedback from the grasper. This work aims to investigate whether a blended shared control framework which utilizes real-time identification of the object being grasped as part of the feedback may help address the prevalence of tissue crush injury in robotic surgeries. Methods: This work tests the proposed shared control framework and tissue identification algorithm on a custom surrogate surgical robotic grasping setup. This scheme utilizes identification of the object being grasped as part of the feedback to regulate to a desired force. The blended shared control is arbitrated between human and an implicit force controller based on a computed confidence in the identification of the grasped object. The online identification is performed using least squares based on a nonlinear tissue model. Testing was performed on five silicone tissue surrogates. Twenty grasps were conducted, with half of the grasps performed under manual control and half of the grasps performed with the proposed blended shared control, to test the efficacy of the control scheme. Results: The identification method resulted in an average of 95% accuracy across all time samples of all tissue grasps using a full leave-grasp-out cross-validation. There was an average convergence time of 8.1 ± 6.3 ms across all training grasps for all tissue surrogates. Additionally, there was a reduction in peak forces induced during grasping for all tissue surrogates when applying blended shared control online. Conclusion: The blended shared control using online identification more successfully regulated grasping forces to the desired target force when compared with manual control. The preliminary work on this surrogate setup for surgical grasping merits further investigation on real surgical tools and with real human tissues.

KW - Robotic surgery

KW - Shared control

KW - Tissue crush injury

KW - Tissue identification

UR - http://www.scopus.com/inward/record.url?scp=85044438376&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85044438376&partnerID=8YFLogxK

U2 - 10.1007/s11548-018-1745-3

DO - 10.1007/s11548-018-1745-3

M3 - Article

C2 - 29594854

AN - SCOPUS:85044438376

VL - 13

SP - 769

EP - 776

JO - Computer-Assisted Radiology and Surgery

JF - Computer-Assisted Radiology and Surgery

SN - 1861-6410

IS - 6

ER -