To address the limitations of current hate speech detection models, we introduce SGHateCheck, a novel framework designed for the linguistic and cultural context of Singapore and Southeast Asia. It extends the functional testing approach of HateCheck and MHC, employing large language models for translation and paraphrasing into Singapore's main languages, and refining these with native annotators. SGHateCheck reveals critical flaws in state-of-the-art models, highlighting their inadequacy in sensitive content moderation. This work aims to foster the development of more effective hate speech detection tools for diverse linguistic environments, particularly for Singapore and Southeast Asia contexts.

SGHateCheck: Functional Tests for Detecting Hate Speech in Low-Resource Languages of Singapore

Large language models (LLMs) like GPT and
PALM have excelled in numerous natural language
processing (NLP) tasks such as text generation,
question answering, and translation.
However, they are also found to have inherent
social biases. To address this, recent studies
have proposed debiasing techniques like iterative
nullspace projection (INLP) and Counterfactual
Data Augmentation (CDA). Additionally,
there’s growing interest in understanding
the intricacies of these models. Some
researchers focus on individual neural units,
while others examine specific layers. In our
study, we benchmark newly released models,
assess the impact of debiasing methods, and
investigate how biases are linked to different
transformer layers using a method called Logit
Lens. Specifically, we evaluate three modern
LLMs: OPT, LLaMA, and LLaMA2, and their
debiased versions. Our experiments are based
on two popular bias evaluation datasets, StereoSet
and CrowS-Pairs, and we perform a layerby-
layer analysis using the Logit Lens.

Layered Bias: Interpreting Bias in Pretrained Large Language Models

<head>
	<style>
		.b1 {
			color: #ffffff;
			background-color: #5b1cf4;
			font-size: 19px;
			font-family: system-ui, sans-serif;
			border-radius: 15px;
			padding: 8px 40px;
			cursor: pointer
		}
		.b1:hover {
			color: #5b1cf4;
			background-color: #ffffff;
		}
	</style>
</head>
<button name="button" class="b1" onclick="window.open('https://us06web.zoom.us/rec/share/9L3bjkxEATmacwrCSHFkKv--9Qj3pfW421-LU5MRDW-RWrHg9LLNIW1bpxf9tKEV.MpYRBA7uN_MA_MMP')">Live Session Recording</button>
 

**This workshop is sponsored by:** 
![](https://assets.underline.io/markdown_image/1/image/9930cd8119e86600f955f66e25a7a870.png)
&nbsp&nbsp&nbsp&nbsp
![](https://assets.underline.io/markdown_image/1/image/c0eb62676c8bf505a36d8ab2efaf4b22.png) 
**About this workshop:** The special theme for this year is Online Harms in the Age of Large Language Models [**Read more**](https://www.workshopononlineabuse.com/) [**Schedule**](https://www.workshopononlineabuse.com/)

W8: The 8th Workshop on Online Abuse and Harms (WOAH 2024) (WOAH)

workshop paper

## Welcome to 2024 Annual Conference of the North American Chapter of the Association for Computational Linguistics!
This year, the conference is in Mexico City. NAACL was actually already planned for Mexico City in 2021, but due to the pandemic the entire conference was moved online. This year, finally, we get to go! So it is my sincere pleasure to welcome you to Mexico City, whether in person or virtually. Having the conference in Mexico City is a good opportunity to emphasize that NAACL is our flagship conference for ACL members not only in North America but also in Central and South America, even though NAACL has been bearing “North” in its name. At this year’s conference, we have a theme to match, with a theme track on the Languages of Latin America to showcase the linguistic diversity of the region.
 
The opportunity to present at NAACL should not depend on a researcher’s travel budget, or their family status. This is why it is so important to make virtual participation at NAACL as good an experience as possible – but we want to also provide a good experience for in-person participants. As a community, we are still working out the best way to do that. This year at NAACL, we are trying out a big virtual poster session ahead of the conference, with the hope that this will make make for a lively and interactive experience. At the same time, we are reducing virtual oral presentations, which seem to be particularly tricky to make to work well. A big thanks to the NAACL program chairs and to Luciana Benotti for all their ideas and work to improve the virtual experience. And participants, virtual as well as in-person: Please let us know what worked for you and what didn’t, so we can continue to improve hybrid conferences. 
 
I have been lucky to work with many amazing people. Without their insight, dedication and patience, and without the many hours of work they put in, NAACL would not have been possible. A huge thank you to the program chairs Helena Gomez, Kevin Duh, and Steve Bethard – you are the best! 
 
Finally, I would like to thank all authors, invited speakers and panelists, area chairs and reviewers, the volunteers organizing and chairing sessions, and all attendees, in-person and virtual. Thank you for helping us make NAACL 2024 come to life. 
 
Welcome and hope you all enjoy the conference! 
Katrin Erk 
The University of Texas at Austin 
NAACL-2024 General Chair 
*You can read the full Welcome message in the [Conference Handbook (downloadable)](https://drive.google.com/file/d/1H1NvW0VASQjkSCYgw3mr-3l4yYDSxz6B/view?usp=sharing)*

To access the event page you need to register [**here.**](http://acl.swoogo.com/naacl2024) 
Your access to the event page is limited based on your registration type. If you registered for workshops only, you will gain access to full workshops content on the day of the workshops program.

Please register!

NAACL 2024

2024 Annual Conference of the North American Chapter of the Association for Computational Linguistics

**Workshop Organizers:** ‎‎Najoung Kim, Yiding Hao, Jaap Jumelet, Hosein Mohebbi, Yonatan Belinkov and Arya D. McCarthy
 *Coffee Break 10:30 am* 
*Lunch Break 12:30 pm* 
*Coffee Break 3:30 pm* [**Workshop Website**](https://blackboxnlp.github.io/) The goal of this workshop is to bring together researchers focused on interpreting and explaining NLP models by taking inspiration from fields such as machine learning, psychology, linguistics, and neuroscience. We hope the workshop will serve as an interdisciplinary meetup that allows for cross-collaboration. [**Invited Speakers**](https://blackboxnlp.github.io/)
 [**Go to Gather**](https://app.gather.town/app/ROH1myZvp9ba7a3C/EMNLP2023?spawnToken=aK5bTdG4Q_S9rpKXfq1O)

W14: BlackboxNLP 2023: The 6th Workshop on Analysing and Interpreting Neural Networks for NLP

**Welcome to EMNLP 2023!**

On behalf of the EMNLP 2023 Organizing Committee, I extend a warm and heartfelt welcome to all of you to the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP). It is with immense pleasure and excitement that we gather here in Singapore, a vibrant hub of innovation and technological advancement.

The conference program is packed with insightful presentations, thought-provoking workshops, and engaging networking opportunities. In addition to the technical sessions, we have also planned several social events that will provide you with the opportunity to connect with your colleagues.

The conference is held in person at the Resorts World Convention Centre in Singapore, and available on-line with the help of Underline.

For those in Singapore, I hope that you will find time to explore the exciting Sentosa Island, Gardens by the Bay, Singapore Botanic Gardens and the many other attractions unique to Singapore.

Of course, we are grateful to our sponsors and partners for their generous support of EMNLP 2023, whose contributions make it possible for us to host this world-class event.

Yuji Matsumoto (RIKEN AIP) 
EMNLP 2023 General Chair

To access the **EMNLP 2023** event page on Underline, you need to register for the Conference. 
Please follow **[this link](https://2023.emnlp.org/registration/)** for more details.

Nirmalendu Prakash

2

SHORT BIO

Presentations

SGHateCheck: Functional Tests for Detecting Hate Speech in Low-Resource Languages of Singapore

Layered Bias: Interpreting Bias in Pretrained Large Language Models

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES