United States

The crowd wisdom effect is a well-established phenomenon used for predicting and estimating unknown variables. Previous research focused on enhancing crowd wisdom by improving individual estimates, while maintaining some of the initial opinion diversity. However, it is theoretically possible to increase collective accuracy by increasing diversity in the crowd. In this study, we propose a method that leverages the anchoring effect to extremize individual judgments and increase the diversity of opinions. This is achieved by dividing the crowd into two groups, anchoring them to either a low or high value, and aggregating all estimates. We develop a mathematical model to determine when this strategy is expected to outperform the crowd wisdom effect. Results from three experiments provide converging evidence that this approach outperforms traditional methods in estimating and forecasting unknown quantities. This research presents a novel approach to reduce collective error by maximizing diversity, at the cost of extremizing judgements.

CogSci 2023

Extremizing Judgements Produces More Inaccurate Individuals but Wiser Crowds

poster

The 45th Annual Meeting of the Cognitive Science Society will take place in Sydney, Australia as a modified hybrid conference. Presentations from the main-session room will be live-streamed every day for all events. This will include all invited talks and award sessions. Recordings of all CogSci 2023 sessions will be made available for on-demand viewing after the conference.<br>
The in-person component will be held at the International Convention Centre Sydney at Darling Harbour. The Conference will take place Wednesday July 26th – Saturday July 29th, 2023 (Wednesday, July 26th is the Workshops Day).

Join us!

<br>[**The Program at a Glance can be found here**](https://cognitivesciencesociety.org/wp-content/uploads/2023/07/COgSci-PAAG-V2.pdf)
<br>[**The Detailed Program can be found here**](https://online.fliphtml5.com/ebtyf/mswz/)
<br><br>

#### **CogSci 2023 Program Book**
<iframe style="width:700px;height:400px" src="https://online.fliphtml5.com/ebtyf/tzgk/"  seamless="seamless" scrolling="no" frameborder="0" allowtransparency="true" allowfullscreen="true" ></iframe>
<br>

The 45th Annual Meeting of the Cognitive Science Society presents the latest research across cognitive science and highlights the theme of Cognition in Context.

We investigated the effect of implicit theories (belief about malleability of ability) on help-seeking behavior in peer learning situation. We predicted that entity theorists (those who believe that ability is fixed) are less likely to seek help because they anticipate that peer members would lower their evaluation of competence. We conducted a scenario experiment and required participants to indicate to what extent they would ask questions to the peer member when they encounter an incomprehensive term which was already explained, and others seemed to understand. The results did not support our hypotheses. The results revealed that the interaction between one’s own and perceived others implicit theories predicted intention to ask questions. Specifically, while perceived others’ implicit theory did not affect incremental theorists’ (those who believe that ability is malleable) intention to ask a question, entity theorists were more likely to ask a question when they perceive others as entity theorists.

The effect of implicit theories on help-seeking behavior: Focusing on anticipated evaluation and perceived implicit theories of the peer member.

Peer-assisted learning (PAL) can have both benefits and costs when compared to individual learning. An empirical study aimed at testing whether PAL yields better learning outcomes than individual learning in a set of insight problems is presented. Participants in the PAL condition learned from interacting with their peers and outperformed participants in the individual learning condition. This learning transferred to a final test that was completed individually. The benefit of peer-assisted learning persisted in spite of significantly greater error exposure in the PAL condition.

Interaction Among Peers Increases Performance in the Remote Associates Test

How do essentialist beliefs about categories arise? We hypothesize that such beliefs are transmitted via language. We subject large language models (LLMs) to vignettes from the literature on essentialist categorization and find that they align well with people when the studies manipulated teleological information – information about what something is for. We examine whether in a classic test of essentialist categorization – the transformation task – LLMs prioritize teleological properties over information about what something looks like, or is made of. Experiments 1 and 2 find that telos and what something is made of matter more than appearance. Experiment 3, manipulates all three factors and finds that what something is for matters more than what it’s made of. Overall, these studies suggest that language alone may be sufficient to give rise to essentialist beliefs, and that information about what something is for matters more.

You are what you’re for: Essentialist categorization in large language models

Interpersonal physiological connection is thought to play a crucial role in group activities. A previous study with participants who had little musical experience has shown that the groups with higher heart rate synchronization were better able to perform simple drumming tasks in a coordinated manner. In the present study, we investigated whether heart-rate synchronization is associated with improvement in a complex harmonic performance of an orchestra. The subject of this study was an orchestra composed of several semi-professional and amateur musicians rehearsing a new original piece. The heart rates of sixteen musicians were simultaneously measured during a joint rehearsal. The results indicate that while the average heart rate of the musicians decreased, heart-rate synchronization among the musicians increased over the course of repeated group rehearsals. For a harmonic performance, the musicians may need to have a physiological connection to each other without their physiological arousal being too high.

Interpersonal physiological connection is associated with improved orchestral performance

For effective collaboration between humans and intelligent agents that employ machine learning for decision-making, humans must understand what agents can and cannot do to avoid over/under-reliance. A solution to this problem is adjusting human reliance through communication using reliance calibration cues (RCCs) to help humans assess agents’ capabilities. Previous studies typically attempted to calibrate reliance by continuously presenting RCCs, and when an agent should provide RCCs remains an open question. To answer this, we propose Pred-RC, a method for selectively providing RCCs. Pred-RC uses a cognitive reliance model to predict whether a human will assign a task to an agent. By comparing the prediction results for both cases with and without an RCC, Pred-RC evaluates the influence of the RCC on human reliance. We tested Pred-RC in a human-AI collaboration task and found that it can successfully calibrate human reliance with a reduced number of RCCs.

Selectively Providing Reliance Calibration Cues With Reliance Prediction

Video games represent a complex, engaging task domain that has shown great promise as an experimental paradigm for the study of cognition and skill acquisition. The methods that have thus far been used to study video games, however, have been sub-optimal, and will likely become more outdated as the video gaming landscape continues to change. In this work, I first give a brief overview of the previous literature surrounding video games and cognition. I next address the critical methodological problems such as measuring expertise based solely through time-on-task as a heuristic of expertise rather than true metrics of skilled performance itself. I then suggest how the burgeoning sub-domain of competitive video gaming, or "eSports," provides an elegant solution to these problems. Finally, I discuss the current and future directions of eSports cognition research.

Competitive eSports as a New Paradigm for Cognitive Science: Current State and Future Directions

Deep reinforcement learning (DRL) is capable of training agents that exceed human-levels of performance in multi-agent tasks. However, the behaviors exhibited by these agents are not guaranteed to be human-like or human-compatible. This poses a problem if the goal is to design agents capable of collaborating with humans or augmenting human actions in cooperative or team-based tasks. Indeed, recommender systems designed to augment human decision making need to not only recommend actions that align with the task goal, but which also maintain coordinative behaviors between agents. The current study simultaneously explored skill learning performance of human learners when working alongside different artificial agents (AAs) during a collaborative problem-solving task, as well as evaluated the effectiveness of the same AAs as action decision recommender systems to aid learning. The action decisions of the AAs were either modelled by a heuristic model based on human performance or by a deep neural network trained by reinforcement learning in self-play. In addition to evaluating skill learning performance, the current study also tested the congruence between the decisions of the AAs with actual decisions made by humans. Results demonstrate that the performance of humans was significantly worse when working alongside the DRL AA compared to the heuristic AA. Additionally, the action decisions participants made also showed less allignment with the recommendations made by the DRL AA.

Action decision congruence between human and deep reinforcement learning agents during a coordinated action task

This study attempts to gain novel insights into the mechanisms underlying the bilingual advantage in cognitive control and investigates the effect of code-switching experience in daily life, rather than considering only language proficiency, on these underlying mechanisms. We compared the performances of early and late Japanese-English bilinguals on the AX-Continuous Performance Task. We found early and late bilinguals show different cognitive control mechanisms to cope with interference: with the late bilinguals, the more frequently they switched languages, the better they performed in the proactive control tasks. Conversely, with the early bilinguals who are generally more proficient, the frequency of code-switching did not modulate their dual mechanism of cognitive control any better, showing little correlation with the ability of proactive control. These findings verify the role of switching frequency in the development of cognitive control and suggest a better understanding of the nature of mechanisms regulating early and late bilinguals’ brains.

The effect of code-switching experience on the dual mechanism of cognitive control: A comparison between early and late Japanese-English bilinguals

When assessing children in laboratory experiments, the measured responses also contain task-irrelevant participant-level variability (“noise”) and measurement noise. Since experimental data are used to make inferences of development of cognitive capabilities with age, it is important to know if reliability of the used measurements depends on child age. Any systematic age-dependent changes in reliability could result in misleading developmental trajectories, as lower reliability will necessarily result in smaller effect sizes. This paper examines age-dependency of task-independent measurement variability in early childhood (3–40 months) by analyzing two large-scale datasets of participant-level experimental responses: the ManyBabies infant-directed speech preference (MB-IDS) dataset and a saccadic reaction time (SRT) dataset collected from rural South Africa. Analysis of participant- and study-level data reveals that MB-IDS shows comparable reliability across the included age range. In contrast, SRTs reflect systematically increasing measurement consistency with increasing age. Potential reasons and implications of this divergence are briefly discussed.

Is Reliability of Cognitive Measures in Children Dependent on Participant Age? A Case Study with Two Large-Scale Datasets

Previous research suggests that a verb’s meaning is learned partly through the aggregated profile of syntactic frames associated with it. For example, “turn” occurs with transitive and intransitive frames in causative alternation (“He turned the car”/“The car turned”), indicating it is a causal verb. Some evidence demonstrates that young children combine multiple frames to map verbs to appropriate events. However, previous work always presented these frames together, in a single dialogue. What remains unknown is how verb learning occurs when the frames are separated, uttered in different referential contexts, as is likely in children’s everyday life. In a series of cross-situational word-learning experiments, we show that both adults and three-year-olds generalize verb meanings across different syntactic frames in a cross-situational learning task. These results shed light on the cross-situational mechanisms of syntactic bootstrapping.

Premium content

Extremizing Judgements Produces More Inaccurate Individuals but Wiser Crowds

Next from CogSci 2023

The effect of implicit theories on help-seeking behavior: Focusing on anticipated evaluation and perceived implicit theories of the peer member.

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES