ChatGPT Scores Close to Passing U.S. Medical Licensing Exams

MONDAY, Feb. 13, 2023 (HealthDay News) -- A new artificial intelligence system, ChatGPT, scores at or around the passing threshold for the U.S. Medical Licensing Exam, according to a study published online Feb. 9 in PLOS Digital Health.
Tiffany H. Kung, from AnsibleHealth Inc. Mountain View in California, and colleagues examined the performance of the language model ChatGPT on the U.S. Medical Licensing Exam, which consists of Step 1, Step 2CK, and Step 3 exams.
The researchers found that ChatGPT performed at or near the passing threshold of 60 percent accuracy, without any specialized training or reinforcement. Across all questions, ChatGPT outputted answers and explanations with 94.6 percent concordance; the high concordance was sustained across all exams. ChatGPT produced at least one significant insight in 88.9 percent of responses.
"We believe that large language models such as ChatGPT are reaching a maturity level that will soon impact clinical medicine at large, enhancing the delivery of individualized, compassionate, and scalable health care," the authors write.
Related Posts
Asthma Drug Fluticasone Fails as Potential COVID Treatment
THURSDAY, July 14, 2022 (HealthDay News) -- The asthma drug fluticasone furoate...
La COVID prolongada puede dificultar que se haga ejercicio, y la investigación revela por qué
MIÉRCOLES, 31 de mayo de 2023 (HealthDay News) -- La falta de energía para hacer...
AHA News: Born in China With a Heart Defect, She’s Now 14 and Calls Her New Heart ‘Thor’
MONDAY, Feb. 21, 2022 (American Heart Association News) -- Four years after...
Moderna’s Booster Shot Prompts Strong Immune Response Against Omicron Subvariants
MONDAY, Nov. 14, 2022 (HealthDay News) -- Moderna, Inc., announced Monday that...