FROMANNUAL REVIEWS

CogSci 2025

•

August 01, 2025

•

San Francisco, United States

keywords:

eye tracking

human-computer interaction

reading

artificial intelligence

natural language processing

This study investigates how integrating human eye-tracking data into Large Language Models (LLMs) and Visual Large Language Models (VLLMs) can enhance document comprehension in tasks that require both linguistic understanding and visual attention, specifically Semantic Entity Recognition (SER) and Document Question Answering (DQA). Despite rapid advancements in AI-based document understanding, LLMs still face challenges in replicating the depth of human cognition, particularly in how reading order and visual attention affect comprehension. The results demonstrate that human reading order and the regions they focus on significantly impact performance in both tasks. Additionally, while LLMs do not need to fully mimic human reading sequences, their performance improves when their attention patterns align more closely with human visual strategies. This highlights the importance of incorporating cognitive-inspired attention mechanisms in AI systems, offering a path to better AI models that reflect human cognitive strategies in complex document understanding.

Downloads

PaperTranscript English (automatic)

Next from CogSci 2025

A Visual Complexity Measurement Method Based on Monte Carlo Sampling
poster

A Visual Complexity Measurement Method Based on Monte Carlo Sampling

CogSci 2025

Sihan Wang and 1 other author

01 August 2025

Similar lecture

From Human Reading to NLM Understanding: Evaluating the Role of Eye-Tracking Data in Encoder-Based Models
poster

From Human Reading to NLM Understanding: Evaluating the Role of Eye-Tracking Data in Encoder-Based Models

ACL 2025

Luca Dini
Dominique Brunato
Felice Dell'Orletta
+1
Luca Dini and 3 other authors

30 July 2025

Stay up to date with the latest Underline news!

Select topic of interest (you can select more than one)

PRESENTATIONS

  • All Presentations
  • For Librarians
  • Resource Center
  • Free Trial
Underline Science, Inc.
1216 Broadway, 2nd Floor, New York, NY 10001, USA

© 2026 Underline - All rights reserved

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.