Showing 1 - 5 of 5 Research Library Publications

Using Eye-Tracking Data as Part of the Validity Argument for Multiple-Choice Questions

Posted: | Victoria Yaneva, Brian E. Clauser, Amy Morales, Miguel Paniagua

Journal of Educational Measurement: Volume 58, Issue 4, Pages 515-537

 

In this paper, the NBME team reports the results an eye-tracking study designed to evaluate how the presence of the options in multiple-choice questions impacts the way medical students responded to questions designed to evaluate clinical reasoning. Examples of the types of data that can be extracted are presented. We then discuss the implications of these results for evaluating the validity of inferences made based on the type of items used in this study.

Category:Assessment-Oriented Research, Applications of Technology

Gender Comparison in Milestone Trajectories and Medical Knowledge Examination Scores among Internal Medicine Residents

Posted: | Karen E. Hauer, Daniel Jurich, Jonathan Vandergrift, Rebecca S. Lipner, Furman S. McDonald, Kenji Yamazaki, Davoren Chick, Kevin McAllister, Eric S. Holmboe

Academic Medicine: Volume 96 - Issue 6 - p 876-884(9)

 

This study examines whether there are group differences in milestone ratings submitted by program directors working with clinical competency committees based on gender for internal medicine residents and whether women and men rated similarly on subsequent in-training and certification examinations.

Category:Assessment-Oriented Research, General Measurement

The Cogent3 Study: Examining Gender’s Impact on Education and Cognition Trends in Three American Generations

Posted: | Shana Stites, Hannah Cao, Jeanine Gill, Kristin Harkins, Jonathan Rubright, Jason Flatt

Innovation in Aging, Volume 4, Issue Supplement_1, 2020, Pages 696-697

 

This presentation describes the framework informing our approach and present results from analyses of gender effects in The Health and Retirement Study that examine gender differences in the associations observed between education and cognitive measures in older adults.

Category:Health Professions

When Examinees Cannot Test: The Pandemic's Assault on Certification and Licensure

Posted: | M. G. Jodoin, J. D. Rubright

Educational Measurement: Issues and Practice

 

This short, invited manuscript focuses on the implications for certification and licensure assessment organizations as a result of the wide‐spread disruptions caused by the COVID-19 pandemic. 

Category:Product-Oriented Research, NBME, USMLE

The Choice of Response Probability in Bookmark Standard Setting: An Experimental Study

Posted: | P. Baldwin, M.J. Margolis, B.E. Clauser, J. Mee, M. Winward

Educational Measurement: Issues and Practice, 39: 37-44

 

This article presents the results of an experiment in which content experts were randomly assigned to one of two response probability conditions: .67 and .80. If the standard-setting judgments collected with the bookmark procedure are internally consistent, both conditions should produce highly similar cut scores.

Category:Assessment-Oriented Research, General Measurement