FROMANNUAL REVIEWS

CogSci 2025

•

August 01, 2025

•

San Francisco, United States

keywords:

sociology

social cognition

psychology

artificial intelligence

As Large Language Models (LLMs) become more prevalent, concerns about their safety, ethics, and potential biases have risen. Systematically evaluating LLMs' risk decision-making tendencies, particularly in the ethical domain, has become crucial. This study innovatively applies the Domain-Specific Risk-Taking (DOSPERT) scale from cognitive science to LLMs and proposes a novel Ethical Decision-Making Risk Attitude Scale (EDRAS) to assess LLMs' ethical risk attitudes in depth. We further propose a novel approach integrating risk scales and role-playing to quantitatively evaluate systematic biases in LLMs. Through systematic evaluation of multiple mainstream LLMs, we assessed the "risk personalities" of LLMs across multiple domains, with a particular focus on the ethical domain, and revealed and quantified LLMs' systematic biases towards different groups. This helps understand LLMs' risk decision-making and ensure their safe and reliable application. Our approach provides a tool for identifying biases, contributing to fairer and more trustworthy AI systems.

Downloads

PaperTranscript English (automatic)

Next from CogSci 2025

Improving Cognitive Capability of Large Language Model: A Multi-Step Symbolic Reasoning Approach
poster

Improving Cognitive Capability of Large Language Model: A Multi-Step Symbolic Reasoning Approach

CogSci 2025

+2
Jinkun Zhai and 4 other authors

01 August 2025

Similar lecture

Walking a Tightrope -- Evaluating Large Language Models in High-Risk Domains
workshop paper

Walking a Tightrope -- Evaluating Large Language Models in High-Risk Domains

EMNLP 2023

Chia-Chien Hung
Wiem Ben Rim
+2
Chia-Chien Hung and 4 other authors

06 December 2023

Stay up to date with the latest Underline news!

Select topic of interest (you can select more than one)

PRESENTATIONS

  • All Presentations
  • For Librarians
  • Resource Center
  • Free Trial
Underline Science, Inc.
1216 Broadway, 2nd Floor, New York, NY 10001, USA

© 2026 Underline - All rights reserved

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.