FROMANNUAL REVIEWS

ACL 2026

•

July 03, 2026

•

San Diego, United States

keywords:

curriculum alignment

large language models (llms)

educational nlp

Most existing math benchmarks for LLMs focus on evaluating correct solutions. In educational settings, however, it is equally important to understand whether LLMs grasp the pedagogical intent behind math problems, beyond producing the right solution. Tagging curriculum standards is challenging for the same reason: distinguishing fine-grained standards requires understanding subtle pedagogical distinctions. In this paper, we use the MathFish benchmark, which frames alignment as multi-label prediction over 385 Common Core State Standards, to evaluate a three-stage pipeline inspired by baseline failure modes in retrieval and structural reasoning: curriculum-informed hard negatives (M1), a cross-encoder re-ranker (M2), and a ReAct agent paired with an LLM-as-a-judge critic (M3). We additionally evaluate a training-free alternative (A1) combining hybrid sparse-dense retrieval with curriculum graph reranking. M3 achieves 31.3% exact match, roughly 6.5 times the three-shot GPT-4-Turbo baseline, with the largest gains from deliberative multi-step reasoning. Error analysis shows that even with these improvements, the pipeline struggles with missing predictions, grade-level misalignment, and sibling confusion, reinforcing that precise curriculum alignment is a fundamentally hard problem in educational NLP.

Downloads

PaperTranscript English (automatic)

Next from ACL 2026

Through the Sentence Lens: Explainable Essay Scoring through Fine-Grained Predictions
workshop paper

Through the Sentence Lens: Explainable Essay Scoring through Fine-Grained Predictions

ACL 2026

Andrea Horbach
Andrea Horbach and 2 other authors

03 July 2026

Similar lecture

Evaluating Language Model Math Reasoning via Grounding in Educational Curricula
poster

Evaluating Language Model Math Reasoning via Grounding in Educational Curricula

EMNLP 2024

Lucy Li
+3
Lucy Li and 5 other authors

13 November 2024

Stay up to date with the latest Underline news!

Select topic of interest (you can select more than one)

PRESENTATIONS

  • All Presentations
  • For Librarians
  • Resource Center
  • Free Trial
Underline Science, Inc.
1216 Broadway, 2nd Floor, New York, NY 10001, USA

© 2026 Underline - All rights reserved

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.