ChatGPT Does Not Pass American College of Gastroenterology Tests
MONDAY, May 22, 2023 (HealthDay News) -- The natural language processing model Chat Generative Pretrained Transformer (ChatGPT) does not pass the American College of Gastroenterology (ACG) Self-Assessment Tests, according to a study published online May 22 in the American Journal of Gastroenterology.
Kelly Suchman, M.D., from the Zucker School of Medicine at Hofstra/Northwell and the Long Island Jewish Medical Center in New Hyde Park, New York, and colleagues assessed ChatGPT-3 and ChatGPT-4 performance on the 2022 and 2021 ACG Self-Assessment Tests. A 70 percent score or higher was required to pass the assessment.
The researchers found that ChatGPT-3 and ChatGPT-4 scored 65.1 and 62.4 percent, respectively, on 455 included questions across the two exams.
"Recently, there has been a lot of attention on ChatGPT and the use of artificial intelligence across various industries. When it comes to medical education, there is a lack of research around this potential ground-breaking tool," lead author Arvind Trindade, M.D., from the Feinstein Institutes for Medical Research in Manhasset, New York, said in a statement. "Based on our research, ChatGPT should not be used for medical education in gastroenterology at this time and has a ways to go before it should be implemented into the health care field."
Two authors disclosed ties to the medical device and biotechnology industries.
Abstract/Full Text (subscription or payment may be required)
Related Posts
Sepsis Almost Killed Jake Tapper’s Daughter, Alice. Now, She’s Working to Keep Others Safe
FRIDAY, Aug. 25, 2023 (HealthDay News) -- Alice Tapper felt deathly ill,...
First U.S. Polio Case in Nearly a Decade Reported in New York
FRIDAY, July 22, 2022 (HealthDay News) -- New York health officials said...
In an Aging America, a Looming Shortage of Home Health Care Workers
WEDNESDAY, April 26, 2023 (HealthDay News) -- Over the last decade, an aging...
¿Podría un embarazo estresado afectar al desarrollo de un niño pequeño?
MARTES, 3 de mayo de 2022 (HealthDay News) -- Los bebés que nacen de mujeres que...