FROMANNUAL REVIEWS

CogSci 2025

•

July 31, 2025

•

San Francisco, United States

keywords:

intelligent agents

computer science

decision making

artificial intelligence

natural language processing

Large language models(LLMs) exhibit growing potential as autonomous agents, yet their decision-making capabilities in real-world scenarios remain underexplored, particularly in dynamic scenarios where conditions are constantly changing. Most existing benchmarks mainly focus on static environments, which significantly differ from real-world scenarios. Additionally, existing evaluation frameworks lack fine-grained assessments, providing limited insights during evaluation. To address these, we propose FD-Bench a benchmark for evaluating the decision-making in dynamic scenarios. FD-Bench employs a fire evacuation scenario as a representative dynamic setting and decomposes decision-making into perception, prediction, and action stages, enabling granular evaluation of 8 LLMs and different reasoning frameworks. Our results show that LLMs experience a performance drop of over 50% in dynamic versus static scenarios. Inspired by “chunking” principle in Cognitive Load Theory (CLT), our hierarchical prompting strategy demonstrates improved performance in dynamic decision-making tasks. This work provides insights into LLMs’ limitations and pathways toward robust real-world deployment.

Downloads

SlidesPaperTranscript English (automatic)

Next from CogSci 2025

Selective social influence on aesthetic evaluations via natural language testimony
technical paper

Selective social influence on aesthetic evaluations via natural language testimony

CogSci 2025

Yoko Urano and 1 other author

31 July 2025

Similar lecture

Efficient Sequential Decision Making with Large Language Models
technical paper

Efficient Sequential Decision Making with Large Language Models

EMNLP 2024

Dingyang Chen and 2 other authors

13 November 2024

Stay up to date with the latest Underline news!

Select topic of interest (you can select more than one)

PRESENTATIONS

  • All Presentations
  • For Librarians
  • Resource Center
  • Free Trial
Underline Science, Inc.
1216 Broadway, 2nd Floor, New York, NY 10001, USA

© 2026 Underline - All rights reserved

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.