FROMANNUAL REVIEWS

EMNLP 2026

•

October 25, 2026

•

Budapest, Hungary

Speech is essential for realistic role-playing, yet existing work on role-playing agents largely centers on text, leaving Speech Role-Playing Agents (SRPAs) underexplored and without systematic evaluation. We introduce SpeechRole, a unified framework for developing and assessing SRPAs. SpeechRole-Data contains 98 roles and 111k speech-to-speech conversations with rich timbre and prosodic variation, providing large-scale resources for training SRPAs. SpeechRole-Eval offers a multidimensional benchmark that directly evaluates generated speech, preserving paralinguistic cues and measuring interaction ability, speech expressiveness, and role-playing fidelity. Experiments show that end-to-end SRPAs such as GPT-4o Audio achieve strong fluency and naturalness, but remain limited in prosody consistency and emotion appropriateness. Current open-source end-to-end models exhibit clear performance gaps, particularly in interaction ability and role-playing fidelity, while several cascaded systems achieve relatively stable performance on these dimensions. Furthermore, role-specific training can further improve the role-playing capabilities of end-to-end SRPAs.

Downloads

PaperTranscript English (automatic)

Next from EMNLP 2026

On the Value of Open Research in Language Modeling - An Adversarial Dialog
keynote

On the Value of Open Research in Language Modeling - An Adversarial Dialog

EMNLP 2026

Graham Neubig
Graham Neubig

26 October 2026

Similar lecture

Reasoning Does Not Necessarily Improve Role-Playing Ability
poster

Reasoning Does Not Necessarily Improve Role-Playing Ability

ACL 2025

Xiachong Feng
Xiachong Feng and 2 other authors

29 July 2025

Stay up to date with the latest Underline news!

Select topic of interest (you can select more than one)

PRESENTATIONS

  • All Presentations
  • For Librarians
  • Resource Center
  • Free Trial
Underline Science, Inc.
1216 Broadway, 2nd Floor, New York, NY 10001, USA

© 2026 Underline - All rights reserved

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.