ChatGPT No Aid for Preparing for Ophthalmology Boards

TUESDAY, May 2, 2023 (HealthDay News) -- ChatGPT answered less than half of ophthalmology board certification examination questions correctly, according to a study published online April 27 in JAMA Ophthalmology.
Andrew Mihalache, from University of Western Ontario in London, Canada, and colleagues assessed the performance of ChatGPT in answering practice questions for board certification in ophthalmology. The analysis included consecutive text-based multiple-choice questions provided by the OphthoQuestions practice question bank.
The researchers found that ChatGPT correctly answered 58 of 125 questions (46 percent) in January and 73 of 125 multiple-choice questions (58 percent) in February. Performance was best for the general medicine category (11 of 14) and poorest in retina and vitreous (0 percent). There was no difference observed in the proportion of questions for which ChatGPT provided additional explanations between questions answered correctly or incorrectly. The mean length of questions (difference, 21.4 characters) and responses (difference, −80.0 characters) was similar whether questions were answered correctly or incorrectly.
"Medical professionals and trainees should appreciate the advances of artificial intelligence in medicine while acknowledging that ChatGPT as used in this investigation did not answer sufficient multiple-choice questions correctly for it to provide substantial assistance in preparing for board certification at this time," the authors write.
One author disclosed financial ties to the pharmaceutical industry.
Abstract/Full Text (subscription or payment may be required)
Editorial (subscription or payment may be required)
Related Posts
La grasa que crece alrededor de los músculos podría ser un asesino silencioso
JUEVES, 18 de mayo de 2023 (HealthDay News) -- Todos saben que la acumulación de...
Adherence to Healthy Lifestyle Cuts Breast Cancer Recurrence, Mortality
THURSDAY, May 4, 2023 (HealthDay News) -- Strongest adherence to cancer...
Pill to Counter Postpartum Depression Looks Good in Trial, May Gain FDA Approval
WEDNESDAY, Aug. 2, 2023 (HealthDay News) -- All eyes are on the U.S. Food and...
Lawsuit Against Makers of Ozempic, Mounjaro Claim Meds Caused ‘Stomach Paralysis’
THURSDAY, Aug. 3, 2023 (HealthDay News) -- A Louisiana woman is suing the makers...