ChatGPT in glioma adjuvant therapy decision making: ready to assume the role of a doctor in the tumour board?

Article Article scientifique Article ChatGPT in glioma adjuvant therapy decision making: ready to assume the role of a doctor in the tumour board? eng 2023-06 author Haemmerli Julien 0000-0001-5998-8541 Department of Clinical Neurosciences, Division of Neurosurgery, Geneva University Hospitals, Geneva, Switzerland julien.haemmerli@hcuge.ch. 659636 author Sveikata Lukas 0000-0001-8015-7929 Department of Clinical Neurosciences, Division of Neurology, Geneva University Hospitals, Geneva, Switzerland.,Institute of Cardiology, Lithuanian University of Health Sciences, Kaunas, Lithuania.,Faculty of Medicine, University of Geneva, Geneva, Switzerland. 759773 Département des neurosciences cliniques (OTONO) author Nouri Aria Department of Clinical Neurosciences, Division of Neurosurgery, Geneva University Hospitals, Geneva, Switzerland. author May Adrien 0000-0002-6977-830X Department of Clinical Neurosciences, Division of Neurosurgery, Geneva University Hospitals, Geneva, Switzerland. 672711 author Egervari Kristof Levente 0000-0001-6763-9069 Department of Pathology and Immunology, Geneva University Hospitals, Geneva, Switzerland. 761273 author Freyschlag Christian Department of Neurosurgery, Medical University of Innsbruck, Innsbruck, Austria. author Lobrinus Johannes Alexander Department of Pathology and Immunology, Geneva University Hospitals, Geneva, Switzerland. 647649 author Migliorini Denis Department of Oncology, Geneva University Hospitals, Geneva, Switzerland. 838158 Département de médecine (DEMED) author Momjian Shahan Marc Department of Clinical Neurosciences, Division of Neurosurgery, Geneva University Hospitals, Geneva, Switzerland. 84022 Département des neurosciences cliniques (OTONO) author Sanda Nicolae Department of Clinical Neurosciences, Division of Neurology, Geneva University Hospitals, Geneva, Switzerland. 934598 author Schaller Karl Lothard Department of Clinical Neurosciences, Division of Neurosurgery, Geneva University Hospitals, Geneva, Switzerland. 658606 Département des neurosciences cliniques (OTONO) author Tran Sébastien Dan Department of Radiation Oncology, Geneva University Hospitals, Geneva, Switzerland. 643282 author Yeung Jacky Department of Neurosurgery, Yale University School of Medicine, New Haven, Connecticut, USA. author Bijlenga Philippe Alexandre Pierre Department of Clinical Neurosciences, Division of Neurosurgery, Geneva University Hospitals, Geneva, Switzerland. 104899 Département des neurosciences cliniques (OTONO) e100775 10.1136/bmjhci-2023-100775 37399360 2632-1009 PMC10314415 Objective: To evaluate ChatGPT's performance in brain glioma adjuvant therapy decision-making. Methods: We randomly selected 10 patients with brain gliomas discussed at our institution's central nervous system tumour board (CNS TB). Patients' clinical status, surgical outcome, textual imaging information and immuno-pathology results were provided to ChatGPT V.3.5 and seven CNS tumour experts. The chatbot was asked to give the adjuvant treatment choice, and the regimen while considering the patient's functional status. The experts rated the artificial intelligence-based recommendations from 0 (complete disagreement) to 10 (complete agreement). An intraclass correlation coefficient agreement (ICC) was used to measure the inter-rater agreement. Results: Eight patients (80%) met the criteria for glioblastoma and two (20%) were low-grade gliomas. The experts rated the quality of ChatGPT recommendations as poor for diagnosis (median 3, IQR 1-7.8, ICC 0.9, 95% CI 0.7 to 1.0), good for treatment recommendation (7, IQR 6-8, ICC 0.8, 95% CI 0.4 to 0.9), good for therapy regimen (7, IQR 4-8, ICC 0.8, 95% CI 0.5 to 0.9), moderate for functional status consideration (6, IQR 1-7, ICC 0.7, 95% CI 0.3 to 0.9) and moderate for overall agreement with the recommendations (5, IQR 3-7, ICC 0.7, 95% CI 0.3 to 0.9). No differences were observed between the glioblastomas and low-grade glioma ratings. Conclusions: ChatGPT performed poorly in classifying glioma types but was good for adjuvant treatment recommendations as evaluated by CNS TB experts. Even though the ChatGPT lacks the precision to replace expert opinion, it may serve as a promising supplemental tool within a human-in-the-loop approach. Artificial intelligence Data Management Deep Learning Information Management Humans Brain Neoplasms / drug therapy Brain Neoplasms / pathology Artificial Intelligence Glioma / pathology Glioma / surgery Decision Making Dewey 616.8 Dewey 616.0757 Dewey 616.07 Dewey 616 137 Département de pathologie et immunologie 21F 61 Département des neurosciences cliniques 226 56 Département de médecine 221 62 Département de radiologie et informatique médicale 227 false 1310 Tumeurs cérébrales 1016 513 Groupe Schaller Karl Lothard (neurochirurgie) 851 565 La Sclérose en plaques 908 928 Neuropsychologie et neurologie comportementale 951 BMJ health & care informatics 30 1 d9ba6394-7d6d-4d0e-af47-aaad0933f075 Article (Published version) Public Article-scientifique-from-europePmc.pdf 2383314 application/pdf CC BY-NC-4.0 21dbd26eaf6171df1e621c6619798bce26e30a8a6fdf5e4fe888dee2ded9285d e85d77e0-eaf0-4e03-b1ed-712f8a3a84ee Supplemental data Public bmjhci-2023-100775supp001_data_supp.pdf 192016 application/pdf 626c0fd172257564f52e9504782ee9d2014b85209d0dc6910db844c0407d5ca7 11614611-0e80-4cfb-bd89-696fc5c7ae2b Supplemental data Public bmjhci-2023-100775supp002_data_supp.pdf 33092 application/pdf 55bc7d202c3bb70bb1f4f80b10bbb6d03719932297957836b42e0e2372a66f9a openAccess Faculté de médecine / Section de médecine fondamentale / Département de pathologie et immunologie Faculté de médecine / Section de médecine clinique / Département des neurosciences cliniques Faculté de médecine / Section de médecine clinique / Département de médecine Faculté de médecine / Section de médecine clinique / Département de radiologie et informatique médicale

Title	Published in	Year	Views	Downloads

ChatGPT in glioma adjuvant therapy decision making: ready to assume the role of a doctor in the tumour board?	BMJ health & care informatics	2023	168	93
Intravenous r-tPA before thrombectomy versus thrombectomy alone in strokes with unknown time of onset	Stroke	2022	509	1

Archive ouverte UNIGE

Sanda, Nicolae