Woman consulting library books

RESEARCH LIBRARY

View recent publications to learn how the NBME research team is working to improve our products and services, advance the field of assessment science, and support the health professions.

Showing 1 - 10 of 70 Research Library Publications
Posted: July 1, 2022 | V. Yaneva, J. Mee, L. H., Polina Harik, M. Jodoin, A. Mechaber

Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies - p 2880–2886

This paper presents a corpus of 43,985 clinical patient notes (PNs) written by 35,156 examinees during the high-stakes USMLE® Step 2 Clinical Skills examination.

Posted: December 4, 2021 | V. Yaneva, B.E. Clauser, A. Morales, M. Paniagua

Journal of Educational Measurement: Volume 58, Issue 4, Pages 515-537

 

In this paper, the NBME team reports the results an eye-tracking study designed to evaluate how the presence of the options in multiple-choice questions impacts the way medical students responded to questions designed to evaluate clinical reasoning. Examples of the types of data that can be extracted are presented. We then discuss the implications of these results for evaluating the validity of inferences made based on the type of items used in this study.

Posted: May 25, 2021 | K.E. Hauer, D. Jurich, J. Vandergrift, R. S. Lipner, F.S. McDonald, K. Yamazaki, D. Chick, K. McAllister, E.S. Holmboe

Academic Medicine: Volume 96 - Issue 6 - p 876-884(9)

 

This study examines whether there are group differences in milestone ratings submitted by program directors working with clinical competency committees based on gender for internal medicine residents and whether women and men rated similarly on subsequent in-training and certification examinations.

Posted: April 22, 2021 | C. Morrison, J. Wise, M. Maranki, L. Ross

Medical Science Educator: Volume 31, p 607–613 (2021)

 

This study extended previous research on the NBME Clinical Science Mastery Series self-assessments to investigate the utility of recently released self-assessments for students completing Family Medicine clerkships and Emergency Medicine sub-internships and preparing for summative assessments.

Posted: December 28, 2020 | D. Jurich, M. Daniel, K.E. Hauer, C. Seibert, L. Chandran, A.R. Pock, S.B. Fazio, A. Fleming, S.A. Santeni

Teaching and Learning in Medicine: Volume 33 - Issue 4 - p 366-381

 

CSE scores for students from eight schools that moved Step 1 after core clerkships between 2012 and 2016 were analyzed in a pre-post format. Hierarchical linear modeling was used to quantify the effect of the curriculum on CSE performance. Additional analysis determined if clerkship order impacted clinical subject exam performance and whether the curriculum change resulted in more students scoring in the lowest percentiles before and after the curricular change.

Posted: December 16, 2020 | S. Stites, H. Cao, J. Gill, K. Harkins, J.D. Rubright, J. Flatt

Innovation in Aging, Volume 4, Issue Supplement_1, 2020, Pages 696-697

 

This presentation describes the framework informing our approach and present results from analyses of gender effects in The Health and Retirement Study that examine gender differences in the associations observed between education and cognitive measures in older adults.

Posted: December 10, 2020 | L.A. Ha, V. Yaneva, P. Harik, R. Pandian, A. Morales, B.E. Clauser

Proceedings of the 28th International Conference on Computational Linguistics

 

This paper brings together approaches from the fields of NLP and psychometric measurement to address the problem of predicting examinee proficiency from responses to short-answer questions (SAQs).

Posted: December 4, 2020 | S. Eraslan, Y. Yesilada, V. Yaneva, S. Harper

ACM SIGACCESS Accessibility and Computing

 

In this article, we first summarise STA (Scanpath Trend Analysis) with its application in autism detection, and then discuss future directions for this research.

Posted: November 24, 2020 | P. Baldwin

Educational Measurement: Issues and Practice

 

This article aims to answer the question: when the assumption that examinees may apply themselves fully yet still respond incorrectly is violated, what are the consequences of using the modified model proposed by Lewis and his colleagues? 

Posted: November 3, 2020 | M.G. Tolsgaard, C.K. Boscardin, Y.S. Park, M.M. Cuddy, S.S. Sebok-Syer

Advances in Health Sciences Education: Volume 25, p 1057–1086 (2020)

 

This critical review explores: (1) published applications of data science and ML in HPE literature and (2) the potential role of data science and ML in shifting theoretical and epistemological perspectives in HPE research and practice.