Artificial intelligence (AI) models specified arsenic ChatGPT are designed to quickly process data. Using nan AI ChatGPT-4 level to extract and analyse circumstantial information points from nan Magnetic Resonance Imaging (MRI) and computed tomography (CT) scans of patients pinch pancreatic cysts, researchers recovered near-perfect accuracy erstwhile compared straight against nan manual attack of floor plan reappraisal performed by radiologists, according to a study published in the Journal of nan American College of Surgeons (JACS).
ChatGPT-4 is simply a overmuch much businesslike approach, is costs effective, and allows researchers to attraction connected information study and value assurance alternatively than nan process of reviewing floor plan aft chart. Our study established that this AI attack was fundamentally arsenic as meticulous arsenic nan manual approach, which is nan golden standard."
Kevin C. Soares, MD, MS, study coauthor, hepatopancreatobiliary crab surgeon astatine Memorial Sloan Kettering Cancer Center, New York City
Using an existing database of astir 1,000 big patients pinch pancreatic lesions nether surveillance betwixt 2010 and 2024 astatine Memorial Sloan Kettering Cancer Center successful New York City, ChatGPT-4 was deployed to place 9 objective variables utilized to show cyst progression: cyst size, main pancreatic duct size, number of lesions, main pancreatic duct dilation, branch duct dilation, beingness of coagulated component, calcific lesion, pancreatic atrophy, and pancreatitis. Pancreatic cysts are communal and require ongoing surveillance because immoderate create into crab and require surgery.
Researchers evaluated ChatGPT-4's expertise to place and categorize these 9 factors associated pinch accrued consequence for dysplasia and cancer. A manually annotated organization cyst database was utilized arsenic nan modular for comparison.
Key Findings
-
The study progressive 3,198 unsocial MRI and CT scans from 991 patients nether semipermanent surveillance for premalignant lesions.
-
ChatGPT-4 successfully extracted objective variables pinch precocious accuracy. The accuracy complaint ranged from 97% for a coagulated component, a high-risk variable, to 99% for calcific lesions.
-
Accuracy was 92% for cyst size and 97% for main pancreatic duct size, different high-risk variables that whitethorn bespeak crab and require surgical resection, biopsy, aliases endoscopic ultrasound.
"AI tin thief america grow aesculapian investigation and amended diligent outcomes," Dr. Soares said. "The mobility I get asked astir often is, 'What is nan chance that this cyst is going to create into cancer?' We now person an businesslike measurement to look astatine nan MRI and CT scans of thousands of patients and springiness our patients a amended answer. This attack goes a agelong measurement to trim worry and thief patients consciousness much assured astir their curen decisions."
While this was a proof-of-concept study, moving guardant nan study authors opportunity they would for illustration to usage AI to grow nan number of investigation questions they inquire to heighten diligent care.
"There is simply a batch of liking successful knowing if AI tin foretell who is going to create cancer. It's important to understand who progresses and why, truthful we person a amended chance astatine tailoring surveillance," Dr. Soares said. "We want to limit nan number of diligent visits, costs to nan wellness attraction industry, and yet supply a customized, alternatively than one-size-fits-all attack to surveillance."
The researchers be aware that nan study utilized only 1 AI source, ChatGPT-4, and results are constricted to nan information that was used. AI tin only activity pinch nan accusation that is handed to it. These limitations whitethorn trim nan broader applicability of nan findings.
Coauthors are Ankur P. Choubey, MD, MPH; Emanuel Eguia, MD, MS; Alexander Hollingsworth, MS; Subrata Chatterjee, PhD; Remo Alessandris, MD; Misha T. Armstrong, MD, MPH; Emily Manin, MD; Lily V. Saadat, MD; Jennifer Flood, MSN; Avijit Chatterjee, PhD; Vinod P. Balachandran, MD, FACS; Jeffrey A. Drebin, MD, PhD, FACS; T. Peter Kingham, MD, FACS; Michael I. D'Angelica, MD, FACS; William R. Jarnagin, MD, FACS; Alice C. Wei, MD, MSc, FACS; Vineet S. Rolston, MD; Mark A. Schattner, MD; and Richard K. G. Do, MD, PhD.
Source:
Journal reference:
Choubey, A. P., et al. (2025). Data Extraction and Curation from Radiology Reports for Pancreatic Cyst Surveillance Using Large Language Models. Journal of nan American College of Surgeons. doi.org/10.1097/xcs.0000000000001478.