Lecture image placeholder

Premium content

Access to this content requires a subscription. You must be a premium user to view this content.

Monthly subscription - $9.99Pay per view - $4.99Access through your institutionLogin with Underline account
Need help?
Contact us
Lecture placeholder background

AAAI 2026

Singapore, Singapore

Would you like to see your presentation here, made available to a global audience of researchers?
Add your own presentation or have us affordably record your next conference.

As large language models (LLMs) exhibit advanced reasoning capabilities in different specialized domains, their application to legal reasoning tasks is actively being explored. The pursuit of justice in legal contexts demands not only correct outcomes but also reasoned elaboration, which necessitates deriving conclusions through logically justified and transparent argumentation. Current legal benchmarks, despite being cited as reasoning-focused, suffer from three critical limitations: conflation of factual recall with genuine inference, fragmentation of holistic reasoning processes, and neglect of reasoning process quality. To bridge these gaps, we construct MSLR, the first Chinese multi-step legal reasoning dataset centered on legal decision-making. To align with real-world legal reasoning trajectories, MSLR employs the IRAC framework (Issue-Rule-Application-Conclusion) to capture expert reasoning traces from official legal decisions. In parallel, we design a scalable human-LLM collaborative annotation pipeline that efficiently generates fine-grained step-level annotations while establishing a reusable methodological framework for multi-step reasoning datasets. Evaluation of a range of LLMs on MSLR reveals only modest performance, highlighting substantial challenges in adapting to complex legal reasoning. Further experiments show that self-initiated CoT prompts—created autonomously by the models—consistently improve reasoning coherence and output quality, outperforming human-designed CoT prompts, which often yield ambiguous results. This work contributes to the broader discourse on LLM reasoning and CoT strategies, offering practical insights and resources for future research. The dataset and code are publicly available.

Next from AAAI 2026

DualCPT: Dual-branch Modeling for Cellular Phenotype Transition
technical paper

DualCPT: Dual-branch Modeling for Cellular Phenotype Transition

AAAI 2026

20 January 2026

Stay up to date with the latest Underline news!

Select topic of interest (you can select more than one)

PRESENTATIONS

  • All Presentations
  • For Librarians
  • Resource Center
  • Free Trial
Underline Science, Inc.
1216 Broadway, 2nd Floor, New York, NY 10001, USA

© 2026 Underline - All rights reserved