Canada

We investigated whether schema congruency differentially affects low level sensory processing (eye gaze) compared to higher-level cognition (memory). Participants performed a two-phase eye tracking task; first a baseline phase with only congruent cartoon events, and subsequently an experimental phase in which the same events were adapted to remain congruent or become incongruent to a theme. Results revealed that participants became quicker in recognizing the congruent cartoon events compared to incongruent in the experimental phase, indicating improved memory for congruent cartoon events. No mean difference in gaze towards congruent versus incongruent events was observed. Surprisingly, a slight bias towards gazing to the left side of the screen in the baseline phase diminished during the experimental phase, indicating that the schema congruency manipulation might affect gaze behavior. Taken together, our results suggest that our schema congruency manipulation affects gaze behavior and memory, but further eye tracking analysis could reveal the dynamic nature of this effect.

CogSci 2022

Effect of stimuli congruency on gaze behavior and memory

poster

Join us for CogSci2022! Our 44th Annual Conference will be centered around the theme of diversity, with an accompanying range of keynotes and invited speakers who themselves highlight the diversity of our field. Our three symposia are Cognition across Diverse Populations, Cognition within Diverse Societies, and Global Challenges for Cognitive Science. The conference is being offered in a fully hybrid environment for onsite and online attendees.
 
 [**The Program at a Glance can be found here**](https://cognitivesciencesociety.org/wp-content/uploads/2022/07/Cogsci-2022-PAAG-Detailed-July-12final-1.pdf)
 [**The Detailed Program can be found here**](https://cognitivesciencesociety.org/wp-content/uploads/2022/08/DeArmond-CogSci2022-program-v113-final.pdf)

This conference requires a registration to attend. Please use the link below to secure your ticket. The website will be available to all registered attendees on July 25th. 

[Register to Attend](https://cognitivesciencesociety.org/registration/)

Registration Is Required

The 44th Annual Meeting of the Cognitive Science Society highlighted research on the theme Cognitive Diversity in addition to the full breadth and diversity of research topics offered by the society’s membership. 





Our ability to forget on demand is called intentional forgetting, and it can be examined using the item-method directed forgetting paradigm. Recently, an inhibition account has gained popularity, arguing that to-be-forgotten (F) items are inhibited in working memory to impair their representations in long-term memory. In a series of experiments, we tested predictions from this inhibitory account by increasing the item and cue durations, respectively. Inhibition predicts decreased recognition for F items with increasing duration. In item recognition, increasing item duration increased memory for both to-be-remembered (R) and F items, in line with a selective rehearsal account of directed forgetting. There was no differential effect of cue duration on memory for R and F items. In associative recognition, increasing item duration increased memory for both R and F items but increasing cue duration increased memory only for R items, which is counter to an inhibition account.

How Increasing Item and Cue Duration Influence Item-Method Directed Forgetting

Humans are able to intentionally forget declarative memory content as demonstrated in directed-forgetting (DF) experiments. Yet, only few studies assessed whether DF affects associations in procedural memory. We tested how the intention to remember/forget a stimulus affected the formation and/or retrieval of stimulus-response (S-R) associations. To do so, we combined an item-specific priming paradigm with list-method DF. We did not find an impact of the intention to remember/forget on either the retrieval of existing or the formation of new S-R associations: Although participants formed S-R associations (evident in decreasing RTs over stimulis’ prime instances), their persisting activation did not impact on RTs in a subsequent item-recognition-test. Potentially, processes contributing to item recognition impeded S-R retrieval. This finding is informative for future studies aiming to assess how intention differentially affects procedural and declarative memory. We formulate experimental design recommendations for future studies assessing the impact of DF on item-specific S-R associations.

Intentional Forgetting of Habits? Combining List-Method Directed Forgetting and Item-Specific Stimulus-Response Priming

Children’s production of mental state verbs can reveal evidence of their theory of mind and general cognitive development. Children produce a certain class of mental state verbs, namely desire verbs such as want, wish, and hope, early in development. Among these desire verbs, they produce want the most frequently. We report on a corpus study of 450+ instances of want as gathered from children’s dialogues with caretakers in the CHILDES database. We developed a novel coding scheme to measure children’s use and understanding of want utterances: i.e., we sought to track the contents of their desires and the agents children predicated desires about. We report on the frequencies of these features across the ages of 2- 4, and highlight noteworthy trends in the way children learn to use want. Children appear to talk about their own desires most often; they primarily use questions to talk about second person desires; and they desire more complex objects as they mature. We describe how these patterns of linguistic competency may serve as an index of a developing theory of mind.

How children talk about their desires: A corpus study of ‘want’

Rule-based learning is an important aspect of language acquisition. Yang (2005,2016) proposed the Tolerance Principle (TP) to predict when a rule will be formed by the language learner. We present the derivation of the TP as originally proposed and test it on both hypothetical data and corpus data from 8 children. Results for the hypothetical data contradict the TP’s predictions, as do the data from 7 of the 8 children. We conclude that the original form of the TP does not explain rule-learning.

Intolerant Data: Testing The Tolerance Principle

Learning to establish joint reference is an important milestone of communicative and linguistic development. Pointing is one of the first entry points into this process, since gestures often precede verbal communication. During early development, as well as later language use, pointing and linguistic utterances interact in many ways, complementing each other. However, little is known about the development of this relationship during development. In this paper, we focus on the development of the co-occurrence of finger pointing and accompanying utterances in two different cultures: Russia and Chintang (Sino-Tibetan, Eastern Nepal). We show that despite the differences in environment, the development of finger pointing and accompanying language use show substantial similarities. Early on, a larger proportion of points is not accompanied by language. As the children's linguistic abilities develop, children first use language to specify what is being pointed at, and later elaborate on some aspect of the referent.

How Do Children Combine Pointing and Language in the Earliest Stages of Development? A Case Study of Russian and Chintang

It has been conjectured that verb learning is hard because verb meanings are not readily "packaged'' from the physical world. To provide new empirical evidence on this account, we analyzed egocentric video collected from natural toy-play interaction and focused on the naming events when action verbs were uttered in parent speech. Using the Human Simulation Paradigm, we showed egocentric videos of those naming events to adult observers and asked them to guess the target verb in parent speech. We found that adult observers used many different verbs to describe the same visual event, and only one of them matched with the verb in parent speech. We analyzed mismatched verbs and identified several sources of mismatch, and found that all of the mismatched verbs are relevant to the target verb, but they capture different properties (temporal, semantic, etc) of the visual event. We also found that different naming events for the same verb also differ in terms of the degree of ambiguity. Taken together, the results in the present paper provided new evidence from the child’s view, showing that verb learning is hard not only because multiple possible meanings are embedded in each learning situation, but also because these candidate meanings expand across multiple dimensions of the physical world, overlap with each other, and relate to the target meaning in many different ways.

Grounding Action Verbs in Egocentric Visual Perception

Even simple, ambiguous signals can have a rich interpretation when viewed in the context of an interaction in a shared environment. We create a model called Paternalistic Communication by combining an existing model of overloaded language -- Rational Speech Acts (RSA) -- with a full agent model of Theory of Mind (ToM). This integration allows signals to be processed in conjunction with common ground in a principled manner dependent on task-dependent action utilities. This modeling perspective treats communication as a way to coordinate diverging perspectives in a cooperative setting. Under Paternalistic Communication, a speaker decides what to say by predicting their partner’s reaction based on the information in common ground and then evaluates those reactions using their own mind which may contain additional information. We demonstrate the flexibility and performance of Paternalistic Communication in a case study with ambiguous signaling through a set of simulations.

Overloaded Communication as Paternalistic Helping

Literature has suggested that self-faces are processed differently at various stages of information processing. Although mechanisms like familiarity, implicit positive attitude, emotional arousal, dual-coding, and dopamine reward pathway have been theorized to explain this effect, it may share a fundamental basis in the attentional mechanism resulting in perceptual prioritization for self-face. In this study, we have assessed the attentional bias resulting from the self-face (over other familiar and unfamiliar faces), by using face pairs as cues before a dot-probe task. We looked at reaction time and its underlying latent variables as a function of face pairs used as cues. We find that both self-face and familiar face result in a faster reaction time for subsequent stimuli at cued locations. Though self-face shows this advantage for both short and long cue-time, a familiar face shows the advantage only for longer cue-time. We also found that drift rate bias is found for the location where self-face is presented. Familiar faces show a prior bias (z) as the reason for underlying advantage. We conclude that although, self-face, as well as familiar faces, might bias the processing of subsequent stimuli the underlying latent factor might differ.

Attentional Bias for Self-Face: Investigation using Dri Diffusion Modelling

People detect painful expressions more easily in members of their racial ingroup than outgroup. Here, we wanted to investigate this racial bias with a machine learning model trained to detect activations of different action units of painful facial expressions. We examined whether the model detected higher action unit activation for European than African faces when trained on datasets with mostly White faces. To control for confounding variables, pictures of faces were generated with the FaceGen Modeller. Results revealed that there exist differences in the visual detectability of some facial muscle activations due to skin color or other race-dependent facial features. Despite the bias towards European looking faces in the training data, some activations were more easily detectable in African faces. Thus, neither the perceptual detectability, nor the larger exposure to own-race faces seems to solely explain the racial bias in pain detection.

Exploring the Racial Bias in Pain Detection with a Computer Vision Model

Categorical perception involves our perceptual system creating sharp boundaries along an objectively continuous stimulus property, such as the discrete colors of the rainbow being perceived despite continuous change in wavelength. The same mechanism is thought to take place in facial emotion perception. But how are emotions at these boundaries perceived? We presented participants with morphed emotional faces made by blending different emotional expressions in equal proportions. Next, we asked participants to respond freely to these ambiguous face morphs and examined these responses via natural language processing methods. The results showed that participants used many more labels than those related to the categories which went into the morphs. These results can inform theories on categorical facial perception as well as the mental representation of facial expressions.

Premium content

Effect of stimuli congruency on gaze behavior and memory

Downloads

Next from CogSci 2022

How Increasing Item and Cue Duration Influence Item-Method Directed Forgetting

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES