In November 2021, NBME hosted Natural Language Processing (NLP) in Assessment, an NBME Educational Virtual Conference. The event provided a forum for scholars in educational measurement and NLP to share research and perspectives on new ways to improve assessment using NLP capabilities. The conference attracted more than 420 individuals from over 20 countries representing 230 organizations.
Watch the talks below to learn about automated scoring of written and spoken responses, automated item generation, assessing writing quality, predicting item characteristics, bias and validity, and potential dangers and challenges related to the use of NLP in assessment.
Keynote Talk: Digital Considerations for AI-enabled Assessments
Automated Scoring: Part 1
Automated Scoring: Part 2
Automated Item Generation: Part 1
Automated Item Generation: Part 2
Assessing Writing Quality
Emerging Topics
Panel Session & Closing Remarks
Want to learn more about NLP?
Reassess the Future
Victoria Yaneva, Manager of NLP Science at NBME, discusses the use of NLP in medical education