EMNLP 2025

November 07, 2025

Suzhou, China

Would you like to see your presentation here, made available to a global audience of researchers?
Add your own presentation or have us affordably record your next conference.

Open-ended text generation faces a critical challenge: balancing coherence with diversity in LLM outputs. While contrastive search-based decoding strategies have emerged to address this trade-off, their practical utility is often limited by hyperparameter dependence and high computational costs. We introduce GUARD, a hyperparameter-free decoding method that effectively balances these competing objectives through a novel "Glocal" uncertainty-driven framework. This approach combines Global Entropy estimates with local entropy deviations to integrate both long-term and short-term uncertainty signals. We show that our proposed Global Entropy formulation mitigates abrupt variations in uncertainty, such as sudden overconfidence or high entropy spikes, with theoretical guarantees of unbiasedness and consistency. To reduce computational overhead, we incorporate a straightforward but effective token count-based penalty. Experimental results demonstrate that GUARD achieves significant improvements in text diversity and coherence. Furthermore, both human and LLM evaluations confirm GUARD's strong performance across multiple dimensions: semantic coherence, fluency, factuality, informativeness, interestingness, and story development. Our code, datasets, and results are publicly available https://anonymous.4open.science/r/GUARD/README.md.

Downloads

SlidesPaperTranscript English (automatic)

Next from EMNLP 2025

FM2DS: Few-Shot Multimodal Multihop Data Synthesis with Knowledge Distillation for Question Answering
poster

FM2DS: Few-Shot Multimodal Multihop Data Synthesis with Knowledge Distillation for Question Answering

EMNLP 2025

+1Giuseppe CareniniAmirhossein Abaskohi
Amirhossein Abaskohi and 3 other authors

07 November 2025

Stay up to date with the latest Underline news!

Select topic of interest (you can select more than one)

PRESENTATIONS

  • All Presentations
  • For Librarians
  • Resource Center
  • Free Trial
Underline Science, Inc.
1216 Broadway, 2nd Floor, New York, NY 10001, USA

© 2025 Underline - All rights reserved