FROMANNUAL REVIEWS

CogSci 2025

•

August 02, 2025

•

San Francisco, United States

keywords:

computer-based experiment

language and thought

event cognition

semantics of language

cognitive neuroscience

language understanding

eye tracking

knowledge representation

linguistics

natural language processing

This paper presents a methodology combining multimodal semantic analysis with an eye-tracking experimental protocol to investigate the cognitive effort involved in understanding the communication of future scenarios. We conduct a pilot study examining how visual fixation patterns vary during evaluation of valence and counterfactuality in fictional ad pieces describing futuristic scenarios, using a portable eye tracker. Participants' eye movements are recorded while evaluating the stimuli and describing them to a conversation partner. Gaze patterns are analyzed alongside semantic representations of the stimuli and participants' descriptions, constructed from a frame semantic annotation of both linguistic and visual modalities. Preliminary results show that far-future and pessimistic scenarios are associated with longer fixations and more erratic saccades, supporting the hypothesis that fractures in the base spaces underlying interpretation of future scenarios increase cognitive load for comprehenders.

Downloads

Paper

Next from CogSci 2025

Human Learning of Non-Markov Structures
poster

Human Learning of Non-Markov Structures

CogSci 2025

+1
Juliana Trach and 3 other authors

02 August 2025

Similar lecture

GazeMAE: General Representations of Eye Movements using a Micro-Macro Autoencoder
poster

GazeMAE: General Representations of Eye Movements using a Micro-Macro Autoencoder

ICPR 2020

Louise Gillian Bautista
Louise Gillian Bautista

11 January 2021

Stay up to date with the latest Underline news!

Select topic of interest (you can select more than one)

PRESENTATIONS

  • All Presentations
  • For Librarians
  • Resource Center
  • Free Trial
Underline Science, Inc.
1216 Broadway, 2nd Floor, New York, NY 10001, USA

© 2026 Underline - All rights reserved

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.