FROMANNUAL REVIEWS

CogSci 2025

•

August 01, 2025

•

San Francisco, United States

keywords:

behavioral science

quantitative behavior

semantics of language

language comprehension

language understanding

computational modeling

computer science

psychology

artificial intelligence

linguistics

natural language processing

Comparative illusions, also called Escher sentences, are comparative sentences that appear acceptable but challenge the boundaries of comprehension. Escher sentences, illusions that are the subject of this paper, require structural reinterpretation to resolve their anomalies, making them ideal phenomena for probing the mechanisms of language processing in humans and machines. Using human behavior as a benchmark for large language models' (LLM) performance, we assessed LLMs' behavior with three methods: prompt, probability measurement, and lexical disturbance. Our results indicate that LLMs, when prompted, display "human-like'' behavior, LLMs struggled to reliably rank surprisals, and they were sensitive to both lexical and syntactic cues in Eschers. These results indicate that LLMs seem to manifest the good-enough processing seen in human cognition. Understanding and narrowing this discrepancy could result in AI systems that are more in tune with human reasoning and more interpretable, ultimately enhancing our grasp of sentence processing in humans and machines.

Downloads

Paper

Next from CogSci 2025

When Simple Counting Fails: Young Children Understand Event Prevalence Using Proportional Reasoning
poster

When Simple Counting Fails: Young Children Understand Event Prevalence Using Proportional Reasoning

CogSci 2025

Wenqing Cao and 1 other author

01 August 2025

Similar lecture

Can Language Models Be Tricked by Language Illusions? Easier with Syntax, Harder with Semantics
workshop paper

Can Language Models Be Tricked by Language Illusions? Easier with Syntax, Harder with Semantics

EMNLP 2023

Yuhan Zhang

06 December 2023

Stay up to date with the latest Underline news!

Select topic of interest (you can select more than one)

PRESENTATIONS

  • All Presentations
  • For Librarians
  • Resource Center
  • Free Trial
Underline Science, Inc.
1216 Broadway, 2nd Floor, New York, NY 10001, USA

© 2026 Underline - All rights reserved

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.