
3
presentations
SHORT BIO
Victoria Yaneva is Manager of NLP Research at the National Board of Medical Examiners (NBME). At NBME, Victoria leads a team of NLP scientists conducting research in the intersection between AI/NLP and educational measurement, with an emphasis on developing capabilities for high-stakes clinical exams. Examples include research on LLM-assisted development of exam content, provision of personalized learner feedback, automated prediction of item difficulty, and automated scoring of examinee responses. Another area of interest is the use of behavioral data, such as eye tracking, for investigating the process validity of various types of question formats used in testing. Victoria completed her PhD in NLP at the Research Group in Computational Linguistics at the University of Wolverhampton in 2016. She worked as a postdoctoral researcher in the same research group focusing on accessibility research for people with autism prior to joining NBME in 2018. Victoria has co-authored numerous conference papers and journal articles published in top-tier venues in NLP, educational measurement, medical education, and accessibility. Together with Matthias von Davier, Victoria co-edited the recently released book Advancing Natural Language Processing in Educational Assessment.
Presentations

Automated Scoring of Clinical Patient Notes: Findings From the Kaggle Competition and Their Translation into Practice
Victoria Yaneva and 5 other authors

Panel: Large Language Models (LLMs) and their Impact on Education
Ekaterina Kochmar and 4 other authors

The USMLE® Step 2 Clinical Skills Patient Note Corpus
Victoria Yaneva and 5 other authors