A conversational agent for early detection of neurotoxic effects of medications through automated intensive observation

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations


We present a fully automated AI-based system for intensive monitoring of cognitive symptoms of neurotoxicity that frequently appear as a result of immunotherapy of hematologic malignancies. Early manifestations of these symptoms are evident in the patients speech in the form of mild aphasia and confusion and can be detected and effectively treated prior to onset of more serious and potentially life-threatening impairment. We have developed the Automated Neural Nursing Assistant (ANNA) system designed to conduct a brief cognitive assessment several times per day over the telephone for 5-14 days following infusion of the immunotherapy medication. ANNA uses a conversational agent based on a large language model to elicit spontaneous speech in a semi-structured dialogue, followed by a series of brief language-based neurocognitive tests. In this paper we share ANNAs design and implementation, results of a pilot functional evaluation study, and discuss technical and logistic challenges facing the introduction of this type of technology in clinical practice. A large-scale clinical evaluation of ANNA will be conducted in an observational study of patients undergoing immunotherapy at the University of Minnesota Masonic Cancer Center starting in the Fall 2023.

Original languageEnglish (US)
Title of host publicationPacific Symposium on Biocomputing 2024, PSB 2024
EditorsRuss B. Altman, Lawrence Hunter, Marylyn D. Ritchie, Tiffany Murray, Teri E. Klein
PublisherWorld Scientific
Number of pages15
ISBN (Electronic)9789811286414
StatePublished - 2024
Event29th Pacific Symposium on Biocomputing, PSB 2024 - Kohala Coast, United States
Duration: Jan 3 2024Jan 7 2024


Conference29th Pacific Symposium on Biocomputing, PSB 2024
Country/TerritoryUnited States
CityKohala Coast

Bibliographical note

Publisher Copyright:
© 2023 The Authors.


  • artificial intelligence
  • Immune effector cell-associated neurotoxicity syndrome
  • immunotherapy
  • language
  • Large language models
  • speech

PubMed: MeSH publication types

  • Journal Article


Dive into the research topics of 'A conversational agent for early detection of neurotoxic effects of medications through automated intensive observation'. Together they form a unique fingerprint.

Cite this