Lecture image placeholder

Premium content

Access to this content requires a subscription. You must be a premium user to view this content.

Monthly subscription - $9.99Pay per view - $4.99Access through your institutionLogin with Underline account
Need help?
Contact us
Lecture placeholder background
VIDEO DOI: https://doi.org/10.48448/cc1r-6x16

poster

ACL 2024

August 12, 2024

Bangkok, Thailand

CIDAR: Culturally Relevant Instruction Dataset For Arabic

keywords:

arabic culture

finetuning llm

cultural alignment

instruction tuning

Instruction tuning has emerged as a prominent methodology for teaching Large Language Models (LLMs) to follow instructions. However, current instruction datasets predominantly cater to English or are derived from English-dominated LLMs, leading to inherent biases toward Western culture. This bias negatively impacts non-English languages such as Arabic and the unique culture of the Arab region. This paper addresses this limitation by introducing CIDAR, the first open Arabic instruction-tuning dataset culturally aligned by native Arabic speakers. CIDAR contains 10,000 instruction and output pairs that represent the Arab region. We discuss the cultural relevance of CIDAR via the analysis and comparison to a few models fine-tuned on other datasets. Our experiments indicate that models fine-tuned on CIDAR achieve better cultural alignment compared to those fine-tuned on 30x more data.

Downloads

SlidesTranscript English (automatic)

Next from ACL 2024

Selective “Selective Prediction”: Reducing Unnecessary Abstention in Vision-Language Reasoning
poster

Selective “Selective Prediction”: Reducing Unnecessary Abstention in Vision-Language Reasoning

ACL 2024

+4Yejin ChoiKhyathi Raghavi Chandu
Tejas Srinivasan and 6 other authors

12 August 2024

Stay up to date with the latest Underline news!

Select topic of interest (you can select more than one)

PRESENTATIONS

  • All Lectures
  • For Librarians
  • Resource Center
  • Free Trial
Underline Science, Inc.
1216 Broadway, 2nd Floor, New York, NY 10001, USA

© 2023 Underline - All rights reserved