ChatGPT Generates Differential Diagnoses With Similar Accuracy to Emergency Doctors
THURSDAY, Sept. 21, 2023 (HealthDay News) -- ChatGPT performance in generating differential diagnoses appears to be similar to emergency department medical experts, according to a research letter published online Sept. 9 in the Annals of Emergency Medicine to coincide with the annual European Emergency Medicine Congress, held from Sept. 17 to 20 in Barcelona, Spain.
Hidde ten Berg, from Jeroen Bosch Hospital in Utrecht, Netherlands, and colleagues investigated the ability of ChatGPT to generate accurate differential diagnoses based on physician notes recorded at initial emergency department presentation. The analysis included a retrospective analysis of 30 undifferentiated patients presenting to a nonacademic teaching hospital in March 2022 with a single proven diagnosis. ChatGPT results were compared to clinical teams' first formulated differential diagnoses and leading diagnoses without laboratory tests.
The researchers found that physicians correctly included the diagnosis in the top five differential diagnoses for 83 percent of cases, similar to ChatGPT v3.5 (77 percent) and v4.0 (87 percent). When including laboratory data, physicians' accuracy increased to 87 percent and ChatGPT v3.5 accuracy increased to 97 percent, while v4.0 accuracy remained at 87 percent. Physicians outperformed ChatGPT for choosing the correct leading diagnosis (60 versus 37 percent for v3.5 and 53 percent for v4.0). These values changed to 53 percent for physicians with laboratory data and 60 percent for v3.5 and 53 percent for v4.0. Differential diagnoses of physicians and ChatGPT overlapped by 60 percent. However, the researchers noted that ChatGPT can also generate varied responses to the same query.
"This observed inconsistency in ChatGPT's outputs emphasizes the inherent unpredictability in large language models and underscores the fact that these are merely tools that can aid, but not replace physicians' judgment," the authors write.
Abstract/Full Text (subscription or payment may be required)
Related Posts
Las temperaturas extremas del cambio climático podrían significar más muertes cardiacas
LUNES, 12 de diciembre de 2022 (HealthDay News) -- Los días tanto de calor como...
Unos bomberos muestran que las dietas de ayuno pueden funcionar en los trabajadores de turnos
MIÉRCOLES, 5 de octubre de 2022 (HealthDay News) -- La alimentación en "horario...
COVID-19 Boosters Targeted to Latest Variants Could Be Ready After Labor Day
WEDNESDAY, Aug. 24, 2022 (HealthDay News) -- The Biden administration plans to...
Dr. Jeanne Marrazzo Will Replace Fauci to Lead National Institute of Allergy and Infectious Diseases
WEDNESDAY, Aug. 2, 2023 (HealthDay News) -- Dr. Jeanne Marrazzo was named on...