Distractors (i.e. incorrect responses) on research-designed multiple choice instruments are often designed to reflect specific prevalent belief structures among students. Traditional Item Response Theory (IRT) models only consider the correctness of students’ responses, not the specific incorrect responses given, and therefore cannot reveal the specific misconceptions held by a population of students. We introduce a new model, ReMNIRT, which extends upon prior work in polytomous IRT by introducing a weight matrix which concisely quantifies what each possible response tells us about the latent skills of students. We apply this model to a data set of pre- and post-instruction administrations of the Force Concept Inventory (FCI) to approximately 17500 students at seven undergraduate institutions. The insight that this analysis gives on the specific ways in which students misunderstand mechanics will help instructors to use the FCI and other research-designed assessments more effectively as formative assessments to inform their teaching.

Studying distractors with ReMNIRT: Reduced Multidimensional Normalized Item Response Theory

PAR-E.04  PER Assessment, Grading and Feedback II

technical paper

The 2020 AAPT Virtual Summer Meeting brought together physics educators from around the globe to learn about the latest in physics theory, research methodology and education from leaders in their field. The program featured plenary speakers, sessions, workshops and many special activities.

For more information please visit the 2020 AAPT Virtual Summer Meeting page at: https://www.aapt.org/Conferences/SM2020/index.cfm.


AAPT SM 20

The 2020 AAPT Virtual Summer Meeting brought together physics educators from around the globe to learn about the latest in physics theory, research methodology and education from leaders in their field. 

Byron Drury

1

SHORT BIO

Presentations

Studying distractors with ReMNIRT: Reduced Multidimensional Normalized Item Response Theory

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES