FROMANNUAL REVIEWS

CogSci 2025

•

July 31, 2025

•

San Francisco, United States

keywords:

computer-based experiment

language understanding

artificial intelligence

linguistics

discourse

Questioning has become increasingly crucial for both humans and artificial intelligence, yet there remains limited research comprehensively assessing question quality. In response, this study defines good questions and presents a systematic evaluation framework. We propose two key evaluation dimensions: appropriateness (sociolinguistic competence in context) and effectiveness (strategic competence in goal achievement). Based on these foundational dimensions, a rubric-based scoring system was developed. By incorporating dynamic contextual variables, our evaluation framework achieves structure and flexibility through semi-adaptive criteria. The methodology was validated using the CAUS and SQUARE datasets, demonstrating the ability of the framework to access both well-formed and problematic questions while adapting to varied contexts. As we establish a flexible and comprehensive framework for question evaluation, this study takes a significant step toward integrating questioning behavior with structured analytical methods grounded in the intrinsic nature of questioning.

Downloads

Paper

Next from CogSci 2025

Generative AI-Assisted Clinical Interviewing of Mental Health
poster

Generative AI-Assisted Clinical Interviewing of Mental Health

CogSci 2025

Sverker Sikström

31 July 2025

Similar lecture

AgentMental: An Interactive Multi-Agent Framework for Explainable and Adaptive Mental Health Assessment
poster

AgentMental: An Interactive Multi-Agent Framework for Explainable and Adaptive Mental Health Assessment

AAAI 2026

Dan Guo
+3
Dan Guo and 5 other authors

24 January 2026

Stay up to date with the latest Underline news!

Select topic of interest (you can select more than one)

PRESENTATIONS

  • All Presentations
  • For Librarians
  • Resource Center
  • Free Trial
Underline Science, Inc.
1216 Broadway, 2nd Floor, New York, NY 10001, USA

© 2026 Underline - All rights reserved

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.