Showing 11 - 14 of 14 Research Library Publications

Conditional Subscore Reporting Using Iterated Discrete Convolutions

Posted: | R.A. Feinberg, M. von Davier

Journal of Educational and Behavioral Statistics: Vol 45, Issue 5, 2020

 

This article describes a method for identifying and reporting unexpectedly high or low subscores by comparing each examinee’s observed subscore with a discrete probability distribution of subscores conditional on the examinee’s overall ability.

Category:Assessment-Oriented Research, Scoring

A Novel Workplace-Based Assessment for Competency-Based Decisions and Learner Feedback

Posted: | P.J. Hicks, M.J. Margolis, C.L. Carraccio, B.E. Clauser, K. Donnelly, H.B. Fromme, K.A. Gifford, S.E. Poynter, D.J. Schumacher, A. Schwartz & the PMAC Module 1 Study Group

Medical Teacher: Volume 40 - Issue 11 - p 1143-1150

 

This study explores a novel milestone-based workplace assessment system that was implemented in 15 pediatrics residency programs. The system provided: web-based multisource feedback and structured clinical observation instruments that could be completed on any computer or mobile device; and monthly feedback reports that included competency-level scores and recommendations for improvement.

Category:Assessment-Oriented Research, General Measurement

Exploring the Relationships Between USMLE Performance and Disciplinary Action in Practice: A Validity Study of Score Inferences From a Licensure Examination

Posted: | Monica M. Cuddy, Aaron Young, Andrew Gelman, David B. Swanson, David A. Johnson, Gerard F. Dillon, Brian E. Clauser

The authors examined the extent to which USMLE scores relate to the odds of receiving a disciplinary action from a U.S. state medical board.

Category:Product-Oriented Research, USMLE, Assessment-Oriented Research, Reliability/Validity, Links to Outcomes

Enhancement of Assessment of Physician-Patient Communication Skills in the United States Medical Licensing Examination (USMLE)

Posted: | Ruth B. Hoppe, Ann M. King, Kathleen M. Mazor, Gail E. Furman, Penelope Wick-Garcia, Heather Corcoran–Ponisciak, Peter J. Katsufrakis

Academic Medicine: Volume 88 - Issue 11 - p 1670-1675

 

From 2007 through 2012, the NBME team reviewed literature in physician–patient communication, examined performance characteristics of the Step 2 CS exam, observed case development and quality assurance processes, interviewed SPs and their trainers, and reviewed video recordings of examinee–SP interactions.  The authors describe perspectives gained by their team from the review process and outline the resulting enhancements to the Step 2 CS exam, some of which were rolled out in June 2012.

Category:Product-Oriented Research, USMLE