United States

&lt;strong&gt;Student understanding of measurement uncertainty is a common learning goal among introductory physics lab courses. In this study, we investigate the open-ended responses to the Physics Measurement Questionnaire (PMQ) from students enrolled in the two-semester Design, Analysis, Tools, and Apprenticeship (DATA) Lab course at Michigan State University.&amp;nbsp; Using an unsupervised natural language processing technique, Latent Dirichlet Allocation (LDA), we were able to extract themes/topics from student responses to this assessment which were in line with the paradigms recently published by Pollard et al. The extracted themes from LDA were then compared to previously hand coded responses. Comparing the prevalence of the extracted topics to the frequencies of the hand-coded responses led to close agreement between the two analyses. Based on these results, topic modelling techniques may be able to provide insight into student understanding of measurement reasoning.&lt;/strong&gt;&lt;/p&gt;

AAPT WM 22

Investigating Open-Ended Responses to the PMQ using Natural Language Processing

uncertainty.

topic

measurement

modelling

learning

machine

unsupervised

This meeting is a great opportunity to explore sessions and workshops designed with your professional development in mind. Present your research and exchange ideas on the latest in teaching and pedagogy. Participate in a wide range of events, activities, plenaries, and so much more, connecting you with peers and colleagues who share your commitment to excellence in physics education.

stages 

COLING, the International Conference on Computational Linguistics, is one of the premier conferences for natural language processing and computational linguistics. Often grouped within the field of artificial intelligence, but actually pre-dating the development of artificial intelligence, advances in computational linguistics and natural language processing are now some of the major drivers behind the use of artificial intelligence for commercial and social applications – for example, on-line search, machine translation and with voice-assisted conversational devices.

First established in 1965, the biennial COLING conference is held in diverse parts of the globe and attracts participants from both top-ranked research centers and emerging countries. Today, the most important developments in our field are taking place not only in universities and academic research institutes, but also in industrial research departments and in technological startups. COLING conferences provide opportunities for all these communities to showcase their exciting developments.

COLING 2020

Student understanding of measurement uncertainty is a common learning goal among introductory physics lab courses. In this study, we investigate the open-ended responses to the Physics Measurement Questionnaire (PMQ) from students enrolled in the two-semester Design, Analysis, Tools, and Apprenticeship (DATA) Lab course at Michigan State University.&nbsp; Using an unsupervised natural language processing technique, Latent Dirichlet Allocation (LDA), we were able to extract themes/topics from student responses to this assessment which were in line with the paradigms recently published by Pollard et al. The extracted themes from LDA were then compared to previously hand coded responses. Comparing the prevalence of the extracted topics to the frequencies of the hand-coded responses led to close agreement between the two analyses. Based on these results, topic modelling techniques may be able to provide insight into student understanding of measurement reasoning.

poster

Dual process theories of reasoning suggest that humans reason using System 1 (heuristic) and System 2 (analytic) thinking processes. The aim of this research is to develop question sequences that serve two purposes: 1) to identify physics students with relevant content knowledge who nevertheless relied on System 1 thinking on a “target” question, and 2) to help students recognize reasoning inconsistencies and activate System 2 thinking effectively to override initial incorrect responses. Screening and target questions are used to identify students making reasoning errors, and intervention questions are designed to alert students of the need to reevaluate their reasoning. Students then have an opportunity to re-answer the target question. Data from recent iterations in calculus-based physics courses at the University of Washington will be discussed.

Developing Question Sequences to Identify and Remedy Student Reasoning Inconsistencies

In a five-year multi-institutional study, we have administered a small set of pre-college mathematics problems to nearly 7000 students enrolled in introductory college physics courses. We found consistently that over 30% of students have considerable difficulty with basic algebraic, trigonometric, and graphing operations, with symbolic representations posing a particularly notable obstacle. We will present our most recent findings, including substantial evidence that student performance on even a small set of these types of problems may be able to provide early warning of probable weak course performance.

Pre-instruction math quiz may predict students’ physics course performance

Helping students develop problem solving skills is a common learning outcome in introductory physics which can be challenging to achieve, particularly in large enrollment courses. This presentation showcases one of our web-based Interactive video-enhanced tutorials (IVETs), which guides students through an expert-like problem-solving approach for a challenging problem involving a given topic, such as one dimensional motion involving two moving objects. IVETs include mini-lectures by a narrator interspersed with branching multiple choice questions that include feedback, allowing students who require less guidance to navigate the tutorials quickly, while students who struggle receive more support according to their needs. This presentation will focus on our One-Dimensional Kinematics IVET and provide details about its design features and impact on students’ problem-solving abilities.

Teaching Problem Solving in One-Dimensional Kinematics Using Interactive Video-enhanced Tutorials

Introductory physics students routinely learn about acoustical beats as a consequence of wave interference. This example is sometimes used to gesture toward heterodyning in commercial radios. Introductory physics students also learn about the overtone series as a consequence of standing waves. Overtones are then used to explain musical timbre and to hint at the importance of Fourier methods. Yet acoustical beats and the overtone series are rarely linked in introductory physics, despite the fact that musicians habitually listen for beats to tune their harmonies. Acoustical beats and harmonic overtones be can be related simply, without any extra physics background, and their relationship leads directly to the problems of musical temperament that have bedeviled musical theorists ever since Pythagoras. Such problems are outlined in this talk, along with suggestions for further reading.

Beats, Overtones, and Musical Temperament

In Spring 2018, I was approached by the Art/Communications/Theater instructors about the unhappiness of their students with the science course options at our school.&nbsp; After talking with them, I applied for release time at our school and was allowed time to build some lab activities that better connected&nbsp;Art, Theater, Music to topics studied in our conceptual physics course.&nbsp; The new lab activities were implemented, and we coordinated the offering of this course with the program chairs in the arts and saw a dramatic increase in enrollment numbers (enrollment increased by 220% in this course).&nbsp; I will present some lessons learned from this experience in building a successful general science course focused on interesting Art/Theater/Communication/Music students.&nbsp;

Building a Physical Science of the Arts Course

Here is an opportunity to build two modular Origami structures, an Octahedral Skeleton (OS) and a turbine. You will need 12 square sheets of paper. The OS represents 3D space, and the turbine can be used to practice rotational motion physics. The second goal is having conversations about framing, as it relates to attracting students to physics and supporting them in physics. For over a decade I have used paper model building to guide learning Physics and Mathematics. In classes for students with majors other than the sciences we use paper to learn physics concepts, skills, and work on design and Art. Teaching an Origami Science class online led to my use of GIFs for instruction. In the GIFs paper in 2D danced into a final 3D object. This dance inspired paper choreography framing of teaching and learning physics. Many students take the class to fold, and endup doing physics.

Paper Choreography Framing of Learning and Teaching Physics

In our modern society, science and art are often perceived as unrelated endeavors. However, the idea that artistic creativity and imagination can play an important role in natural sciences and engineering is finally gaining an acceptance. One of the big questions about the connection between art and science is&nbsp;what features make the work of art look realistic. Questions like this open the dialog between physicists and a public.&nbsp; For example, examining paintings, drawings, and photographs can be used to demonstrate the laws of optics. The presentation will demonstrate how the understanding of basic optics phenomena such as an absorption, scattering, reflection, refraction, diffraction, and polarization of light, is absolutely essential for creating realistic-looking paintings and drawings. Using arts in science and engineering education and outreach has a potential to attract and captivate the new audiences.

Harnessing Visual Arts to Teach About The Light And Color

Columbia College Chicago specializes in&nbsp;arts and media disciplines, and as a result, our most popular physics classes are "The Science of Acoustics" and "Science of Musical Instruments." Also, I have taught a course called "Physics for Filmmakers" (1) for over a decade where students create a final film project using topics and examples of their choice. I will discuss ideas from recent projects including some done over a recent remote term. I also will discuss plans to transition that course to a conceptual physics course which includes the best discussions and project prompts from "Filmmakers" but is also open to projects in music (2) and other forms of the arts.

Including art projects as part of physics courses

Logistic regression, random forest, and ensemble classification algorithms are used to predict students at risk of receiving a failing grade (D or F) in an introductory mechanics class. Institutional variables as well as student performance variables gathered from the first two weeks of class are used. Due to the imbalanced nature of the data, upsampling methods such as synthetic minority oversampling technique (SMOTE) and alternative metrics such as balanced accuracy for evaluating model performance are examined. The importance of variables to the final classification is explored. The best performing models are found to achieve a balanced accuracy of around 80%.

Predicting At-Risk Students in Introductory Physics using Machine Learning

Over the last 25 years, educational researchers have encouraged practitioners to acknowledge and include culturally relevant pedagogy in physics learning. We examine current physics instructors’ views of objectivity in physics and their views of culturally relevant pedagogy. Instructors’ statements are analyzed using the conceptions of Culturally Relevant Pedagogy (CRP) listed in Ladson-Billings’ (1995) framework: Conceptions of Self and Others, Conceptions of Knowledge, and Social Relations. We interviewed 11 physics instructors asking about their views towards CRP and objectivity in physics. Interviews were transcribed and analyzed using thematic analysis. We share two illustrations of instructors who had strong Conceptions of Knowledge that supported CRP: they focus on the knowledge of physics as being constructed and reconstructed - now and into the future. Findings from our study indicate that the third conception, Conceptions of Knowledge, is crucial to develop if we want physics instructors to truly and effectively use CRP.

Investigating Open-Ended Responses to the PMQ using Natural Language Processing

Downloads

Next from AAPT WM 22

Developing Question Sequences to Identify and Remedy Student Reasoning Inconsistencies

Similar lecture

Dynamic Topic Tracker for KB-to-Text Generation

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES