Showing 1 - 4 of 4 Research Library Publications

The Associations Between United States Medical Licensing Examination Performance and Outcomes of Patient Care

Posted: | John Norcini, Irina Grabovsky, Michael A. Barone, M. Brownell Anderson, Ravi S. Pandian, Alex J. Mechaber

Academic Medicine: Volume 99 - Issue 3 - p 325-330

 

This retrospective cohort study investigates the association between United States Medical Licensing Examination (USMLE) scores and outcomes in 196,881 hospitalizations in Pennsylvania over 3 years.

Category:Product-Oriented Research, USMLE, Assessment-Oriented Research, Links to Outcomes

Examining ChatGPT Performance on USMLE Sample Items and Implications for Assessment

Posted: | Victoria Yaneva, Peter Baldwin, Daniel P. Jurich, Kimberly Swygert, Brian E. Clauser

Academic Medicine: Volume 99 - Issue 2 - p 192-197

 

This report investigates the potential of artificial intelligence (AI) agents, exemplified by ChatGPT, to perform on the United States Medical Licensing Examination (USMLE), following reports of its successful performance on sample items. 

Category:Product-Oriented Research, USMLE, Assessment-Oriented Research, Applications of Technology

A Comparison of Remote vs In-Person Proctored In-Training Examination Administration for Internal Medicine

Posted: | Thai Ong, Becky Krumm, Margaret Wells, Susan Read, Linda Harris, Andrea Altomare, Miguel Paniagua

Academic Medicine: Volume 99 - Issue 7 - Pages 778-783

 

This study examined score comparability between in-person and remote proctored administrations of the 2020 Internal Medicine In-Training Examination (IM-ITE) during the COVID-19 pandemic. Analysis of data from 27,115 IM residents revealed statistically significant but educationally nonsignificant differences in predicted scores, with slightly larger variations observed for first-year residents. Overall, performance did not substantially differ between the two testing modalities, supporting the continued use of remote proctoring for the IM-ITE amidst pandemic-related disruptions.

Category:Assessment-Oriented Research, Scoring, Links to Outcomes

Enhancement of Assessment of Physician-Patient Communication Skills in the United States Medical Licensing Examination (USMLE)

Posted: | Ruth B. Hoppe, Ann M. King, Kathleen M. Mazor, Gail E. Furman, Penelope Wick-Garcia, Heather Corcoran–Ponisciak, Peter J. Katsufrakis

Academic Medicine: Volume 88 - Issue 11 - p 1670-1675

 

From 2007 through 2012, the NBME team reviewed literature in physician–patient communication, examined performance characteristics of the Step 2 CS exam, observed case development and quality assurance processes, interviewed SPs and their trainers, and reviewed video recordings of examinee–SP interactions.  The authors describe perspectives gained by their team from the review process and outline the resulting enhancements to the Step 2 CS exam, some of which were rolled out in June 2012.

Category:Product-Oriented Research, USMLE