United States

Collaborative problem solving capability (CPS) has become more important recently. Accurate measurement of CPS is necessary for developing training programs. However, most existing CPS measurement tools have two weaknesses. They do not account for individual contributions to the output. Also, it is hard to utilize new problems. Addressing these weaknesses, we modified the PISA 2015 framework to account for individual contributions to the output and introduced peer-assessment. To test the validity of our proposition, we had fifty participants perform two tasks in different groups, and analyzed the results. We found that the score from PISA 2015 and our modified score showed a high correlation. And, peer-assessed modified scores approximated expert-assessed modified scores. Furthermore, peer-assessed modified scores between the tasks showed a significant correlation, suggesting that it is consistent across different tasks and groups. These results suggest that the modified method and adopting peer-assessment can be used to measure CPS.

CogSci 2023

Measuring Collaborative Problem Solving Capability Using Peer Assessment

poster

The 45th Annual Meeting of the Cognitive Science Society will take place in Sydney, Australia as a modified hybrid conference. Presentations from the main-session room will be live-streamed every day for all events. This will include all invited talks and award sessions. Recordings of all CogSci 2023 sessions will be made available for on-demand viewing after the conference.<br>
The in-person component will be held at the International Convention Centre Sydney at Darling Harbour. The Conference will take place Wednesday July 26th – Saturday July 29th, 2023 (Wednesday, July 26th is the Workshops Day).

Join us!

<br>[**The Program at a Glance can be found here**](https://cognitivesciencesociety.org/wp-content/uploads/2023/07/COgSci-PAAG-V2.pdf)
<br>[**The Detailed Program can be found here**](https://online.fliphtml5.com/ebtyf/mswz/)
<br><br>

#### **CogSci 2023 Program Book**
<iframe style="width:700px;height:400px" src="https://online.fliphtml5.com/ebtyf/tzgk/"  seamless="seamless" scrolling="no" frameborder="0" allowtransparency="true" allowfullscreen="true" ></iframe>
<br>

The 45th Annual Meeting of the Cognitive Science Society presents the latest research across cognitive science and highlights the theme of Cognition in Context.

Recent work has suggested that caregivers adjust their speech to their child's individual lexical knowledge when playing a reference game. Whether caregivers display similar scaffolding during shared reading interactions remains unexplored. We hypothesized that similar adjustments may characterize caregivers’ communication during shared reading interactions and support children’s word learning. Caregivers and their 4- and 5-year-olds engaged in shared reading with two custom storybooks with embedded low-frequency words. Immediately before the session, caregivers were asked whether their child understood or produced those words via a vocabulary checklist. The shared reading interactions were video-recorded and transcribed. Caregivers’ communication was coded offline for repetitions, questions, comments, and gestures in relation to target words. Children’s word learning outcomes were measured after the shared reading episodes. Results will clarify whether and how caregivers adjust their communication to their perceived child's individual lexical knowledge, and whether this adjustment enhances word learning in naturalistic settings.

Do caregivers’ communicative adjustments enhance 4- and 5-year-olds' word learning? Testing the generalizability of the fine-tuning hypothesis to naturalistic shared reading interactions

This study investigated the effect of interleaving and epistemological beliefs on the reading comprehension of multiple conflicting documents. Especially, it is assumed that interleaving may highlight the differences through discrimination and contrast, thus improving the integration of source and content information. A one-factor experiment was conducted (n = 179) to examine the effect of interleaving and spacing on reading comprehension. In addition, a parallel chain mediation model was established based on the Documents Model Framework. Path analysis results indicated an interleaving effect which took place through germane cognitive load and viewpoint description, while spacing enhanced source memory and source-content links. Furthermore, justification for knowing moderated the effect of interleaving on germane cognitive load. Participants with high level of justification reported the lowest germane cognitive load in the interleaved condition. Potential mechanism of interleaving in multiple document reading was discussed.

Integrating in Interleaved Conflicting Documents: Content Preference and Epistemic Beliefs Matter

Popular culture consists of elements consumed by the general public, such as movies, television shows, and books, that reflect the attitudes, practices, beliefs, and cultural objects prevalent in society. Popular culture tends to influence numerous facets of one’s lifestyle, and both empirical and anecdotal evidence suggests that it plays a role in determining the career of nascent professionals. We conducted an anonymized survey to assess the effect of popular culture on pursuing a career in Science, Technology, Engineering, Mathematics, and Medicine (STEMM). Results from the path analysis identified the direct effect of different aspects of popular media on the perceptions of social standing in choosing a STEMM career.

Exploring the relationship between popular culture and perceptions of social standing in Science, Technology, Engineering, Mathematics, and Medicine (STEMM) careers: a pilot study using path analysis

In 2021, charitable giving accounted for about 2.1% of the national gross domestic product in the U.S., with 67% of donations coming from individual donors. Despite the profound impact of this industry on the economy, with respect to its provision of services and goods as well as employment opportunities and wages, much is still unknown about the psychological processes supporting charitable giving. One major theoretical distinction emerging in the literature is that between acts of charity motivated by a consideration of the needs of recipients vs. those prompted by the needs of the giver. Here, we investigated how socio-affective constructs of “simulated vs. genuine compassion” impact the inclination to make public vs. anonymous charitable donations and assessed how information about social norms influences those differences.

Socio-Affective Traits Mediating Charitable Giving

Recent empirical work has shown that human children are adept at learning and reasoning with probabilities. Here, we model a series of recent experiments investigating the development of school-age children's non-symbolic probability reasoning ability using the Neural Probability Learner and Sampler (NPLS) system. We demonstrate that NPLS can accurately simulate the probability judgments and a temporary interference from incorrectly using pure numerical frequencies in probabilistic tasks in children. We discuss the roles of model parameters in simulating probability matching in children, and their occasional tendency to wrongly select less probable outcomes based on frequencies.

A Computational Model of Children's Learning and Use of Probabilities

Whether children revise their beliefs depends on the counter-evidence they are given. Research with German-speaking children showed that 5-year-olds but not 3-year-olds were more likely to revise their beliefs when presented with direct rather indirect evidence for a claim contradicting their beliefs (Köymen & Tomasello, 2018). Unlike German or English, in languages like Turkish, the obligatory use of evidential markers provides information about reliability, whether the speaker refers to direct or indirect observation. This online study investigated whether Turkish- and English-speaking 3- and 5-year-olds (N=146) revised their initial plausible beliefs in favor of implausible beliefs supported by various types of counter-evidence (direct, indirect, or inference). The results showed that 3-year-olds not only revised their beliefs more often than 5-year-olds, but they also did so more in the direct and inference conditions compared to the indirect condition. Thus, three-year-olds can consider the evidentiary strength of counterarguments when revising their beliefs.

Turkish- and English- speaking children's belief revision based on their evaluation of counterarguments

Most of what we know about the development of generalization comes from studies on children’s reasoning from positive evidence (e.g., evidence of other birds with hollow bones). The present study examined the significance of negative evidence (e.g., evidence of animals that do not have hollow bones). Three-, 4-, and 5-year-olds (N=98) were asked to generalize from samples with negative evidence and samples with positive evidence that were selected either deliberately or incidentally. All children made a higher rate of generalizations from samples that included negative evidence than samples that included positive evidence, but only when evidence was selected deliberately by the experimenter. Furthermore, 5-year-olds generalized from samples in which negative evidence presented either an explicit contrast with the category in question (e.g., sheep do not have hollow bones) or an implicit contrast with the category in question (e.g., sheep have dense bones). Three- and four-year-olds generalized only when samples presented explicit contrasts. These results are discussed in light of other work on inductive reasoning that emphasizes the role of dyadic factors on generalization, such as the expectation that informants intend to share relevant information.

Accentuate the negative: Expectations about sampling procedures determine the impact of negative evidence on children’s inductive judgments

We investigate the early emergence of children’s information-search competence using a simplified version of Lindow’s (2021) finding-presents game. Children (n = 86, 30- to 48-months old) had to find a present in one of three closed boxes. All boxes were identical but for one feature (e.g., all boxes were blue and had a flower icon, but one box was round, one heart-shaped, and one squared). Children received three information cards revealing one feature of the target box (i.e., its color, shape, or icon). As the boxes differed in only one feature, only one information card contained the relevant information to the decision. Children could flip one information card to learn about one particular feature before deciding which box to open. We find that children as young as 2.5 years can efficiently search for information to guide their decisions and underline the importance of using age-appropriate paradigms.


Preschoolers select the relevant information when looking for a hidden present

The current study investigates the effect of constraints in well-structured problem-solving on ill-structured problem-solving by asking people to solve variants of Raven’s advanced progressive matrices (APM) and to create an APM-like puzzle using the creative reasoning task (CRT). Using traditional APM, we created a novel version of APM with comparatively lesser constraints available to solve the puzzle, called creative APM (cAPM). The cAPM task was designed to induce divergent thinking along with convergent thinking by enabling our participants to create new rules, if possible, to complete the puzzle. It is assumed that the change in constraints or availability of rules to deduce reasoning changes the nature of the problem space in solving APM and cAPM and may differently affect the following creative reasoning task. We randomly assigned 50 participants to perform APM or the variant of the APM task, i.e. cAPM, followed by the CRT, in a fixed order. We observed a significant effect of constraints available to solve well-structured problems on ill-structured problem-solving. The current result shows higher CRT scores when CRT preceded cAPM (Median = 79.25) than APM (Median =53.00), suggesting that the lesser constraints could induce divergent thinking required for a better creative reasoning task performance.

Do constraints in APM solving affect APM-like puzzle creation?

Research on how individuals process
information in politics has provided evidence for the selective
processing of information. This has often been attributed to
“motivated reasoning” (MR) , which is targeted towards 
partisan goals as opposed to ‘rational’ reasoning, which tries 
to achieve accuracy goals. We propose that political reasoning is
asymmetrical and MR is only triggered when belief-challenging 
information is presented and not when the information is
belief-conforming (congruent).

To test these claims we performed an experiment and found
that for congruent information, the initial polarization
of the subject did not significantly influence the trust rating for
the information item. But the evaluation did affect the belief
update. In contrast, for incongruent information the polariza-
tion of the subject influenced the trust rating but there was no
significant effect of the evaluation on the belief update. The
finding is consistent with behavior that tries to reduce cogni-
tive dissonance.

Premium content

Measuring Collaborative Problem Solving Capability Using Peer Assessment

Next from CogSci 2023

Do caregivers’ communicative adjustments enhance 4- and 5-year-olds' word learning? Testing the generalizability of the fine-tuning hypothesis to naturalistic shared reading interactions

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES