EMNLP 2025

November 08, 2025

Suzhou, China

Would you like to see your presentation here, made available to a global audience of researchers?
Add your own presentation or have us affordably record your next conference.

This paper presents our system for Subtask 1: Islamic Inheritance Reasoning in the QIAS 2025 Shared Task, which evaluates large language models (LLMs) on ʿilm al-mawārīth (the Islamic science of inheritance) using a benchmark of Arabic multiple-choice questions (MCQs) derived from expert-reviewed fatwas. We explore static and dynamic few-shot prompting, retrieval-augmented generation (RAG) using a large fatwa corpus, and a progressive n-gram overlap retrieval method. The n-gram method is employed both to select the top five most similar MCQs for dynamic prompting and to retrieve the most relevant fatwa answers as additional context during inference. We evaluate both proprietary and open-source LLMs individually and in ensemble configurations. Results show that dynamic prompting and RAG consistently improve accuracy across models, with our best-performing model, Gemini, achieving 62.26% accuracy on the test set.

Downloads

Paper

Next from EMNLP 2025

AmbiStory: A Challenging Dataset of Lexically Ambiguous Short Stories
workshop paper

AmbiStory: A Challenging Dataset of Lexically Ambiguous Short Stories

EMNLP 2025

Janosch Gehring and 1 other author

08 November 2025

Stay up to date with the latest Underline news!

Select topic of interest (you can select more than one)

PRESENTATIONS

  • All Presentations
  • For Librarians
  • Resource Center
  • Free Trial
Underline Science, Inc.
1216 Broadway, 2nd Floor, New York, NY 10001, USA

© 2026 Underline - All rights reserved