How NBME research supports assessment for learning and practice
Read highlights of recent research from NBME in support of evolving assessment needs in medical education.
Lung cancer screening: What do physicians say to reluctant patients and what do patients want them to say?
In this paper, Research Associate Angelo D’Addario, Senior Manager of Measurement Science Ann King, and their coauthors examine the communication strategies physicians employ when discussing lung cancer screening with reluctant patients, and compares these approaches to the preferences of the patients themselves. The study aims to identify potential gaps between physician communication techniques and patient expectations,…
The future of natural language processing (NLP) in medical education assessment
Read some of the highlights from recent articles published by NBME researchers as they continue to explore the use of NLP in transforming assessment development and scoring.
Assessment of clinical skills: a case study in constructing an NLP-based scoring system for patient notes
In this chapter of Advancing Natural Language Processing in Educational Assessment, Director of Research Polina Harik, PhD, Measurement Scientist Janet Mee, PhD, Senior Measurement Scientist Christopher Runyon, PhD and Distinguished Research Scientist Brian Clauser, PhD describe INCITE, a natural language processing (NLP)-based system for scoring free-text responses. The system was developed by NBME to score responses produced as…
SHARP (SHort Answer, Rationale Provision): A new item format to assess clinical reasoning
In this study, Senior Measurement Scientist Christopher Runyon, PhD, Director of Research Polina Harik, PhD, and their coauthors looked at a new 2-step item format called SHARP (SHort Answer, Rationale Provision). In collaboration with physician-educators, they integrated short-answer questions into a patient medical record–based item starting in October 2021 and arrived at an innovative item…
“Best practice” for patient-centered communication: A narrative review
In this narrative review, Senior Manager of Measurement Science Ann King, MA and her coauthor, Ruth Hoppe, MD, aim to summarize the work that has been conducted in physician-patient communication that supports the efficacy of good communications skills. A review of the literature shows it contains impressive evidence supporting positive associations between physician communication behaviors…
How NBME research supports assessment for learning and practice
Read highlights of recent research from NBME in support of evolving assessment needs in medical education.
Lung cancer screening: What do physicians say to reluctant patients and what do patients want them to say?
In this paper, Research Associate Angelo D’Addario, Senior Manager of Measurement Science Ann King, and their coauthors examine the communication strategies physicians employ when discussing lung cancer screening with reluctant patients, and compares these approaches to the preferences of the patients themselves. The study aims to identify potential gaps between physician communication techniques and patient expectations,…
The future of natural language processing (NLP) in medical education assessment
Read some of the highlights from recent articles published by NBME researchers as they continue to explore the use of NLP in transforming assessment development and scoring.
Assessment of clinical skills: a case study in constructing an NLP-based scoring system for patient notes
In this chapter of Advancing Natural Language Processing in Educational Assessment, Director of Research Polina Harik, PhD, Measurement Scientist Janet Mee, PhD, Senior Measurement Scientist Christopher Runyon, PhD and Distinguished Research Scientist Brian Clauser, PhD describe INCITE, a natural language processing (NLP)-based system for scoring free-text responses. The system was developed by NBME to score responses produced as…
SHARP (SHort Answer, Rationale Provision): A new item format to assess clinical reasoning
In this study, Senior Measurement Scientist Christopher Runyon, PhD, Director of Research Polina Harik, PhD, and their coauthors looked at a new 2-step item format called SHARP (SHort Answer, Rationale Provision). In collaboration with physician-educators, they integrated short-answer questions into a patient medical record–based item starting in October 2021 and arrived at an innovative item…
“Best practice” for patient-centered communication: A narrative review
In this narrative review, Senior Manager of Measurement Science Ann King, MA and her coauthor, Ruth Hoppe, MD, aim to summarize the work that has been conducted in physician-patient communication that supports the efficacy of good communications skills. A review of the literature shows it contains impressive evidence supporting positive associations between physician communication behaviors…