To make content moderation more culturally sensitive, it is important to create appropriate datasets.
We present AustroTox, a dataset annotated for offensiveness on the token- and post-level.
It comprises 4,562 comments in Austrian German and additionally 1,799 English comments.
AustroTox contains post-level annotations for offensive language and token-level annotations for targets of offensive statements and vulgar language.
An evaluation indicates that GPT-4 performs best in classifying offensiveness on the German part of AustroTox compared to other models. Except for German offensiveness classification, the smaller fine-tuned language models we test excel in classifying offensive comments, detecting vulgar language, and detecting the targets of offensive statements compared to the large language models we prompt in a few-shot fashion.

AustroTox: A Dataset for Target-Based Austrian German and English Offensive Language Detection

The widespread popularity of social media has led to an increase in hateful, abusive, and sexist language, motivating methods for the automatic detection of such phenomena. The goal of the SemEval shared task Towards Explainable Detection of Online Sexism (EDOS 2023) is to detect sexism in English social media posts (subtask A), and to categorize such posts into four coarse-grained sexism categories (subtask B), and eleven fine-grained subcategories (subtask C). In this paper, we present our submitted systems for all three subtasks, based on a multi-task model that has been fine-tuned on a range of related tasks and datasets before being fine-tuned on the specific EDOS subtasks. We implement multi-task learning by formulating each task as binary pairwise text classification, where the dataset and label descriptions are given along with the input text. The results show clear improvements over a fine-tuned DeBERTa-V3 serving as a baseline leading to F1-scores of 85.9% in subtask A (rank 13/84), 64.8% in subtask B (rank 19/69), and 44.9% in subtask C (26/63).

CL-UZH at SemEval-2023 Task 10: Sexism Detection through Incremental Fine-Tuning and Multi-Task Learning with Label Descriptions

Most research on hate speech detection has focused on English where a sizeable amount of labeled training data is available. However, to expand hate speech detection into more languages, approaches that require minimal training data are needed. In this paper, we test whether natural language inference (NLI) models which perform well in zero- and few-shot settings can benefit hate speech detection performance in scenarios where only a limited amount of labeled data is available in the target language. Our evaluation on five languages demonstrates large performance improvements of NLI fine-tuning over direct fine-tuning in the target language. However, the effectiveness of previous work that proposed intermediate fine-tuning on English data is hard to match. Only in settings where the English training data does not match the test domain, can our customised NLI-formulation outperform intermediate fine-tuning on English. Based on our extensive experiments, we propose a set of recommendations for hate speech detection in languages where minimal labeled training data is available.

Evaluating the Effectiveness of Natural Language Inference for Hate Speech Detection in Languages with Limited Labeled Data

Standard approaches to hate speech detection rely on sufficient available hate speech annotations. Extending previous work that repurposes natural language inference (NLI) models for zero-shot text classification, we propose a simple approach that combines multiple hypotheses to improve English NLI-based zero-shot hate speech detection. We first conduct an error analysis for vanilla NLI-based zero-shot hate speech detection and then develop four strategies based on this analysis. The strategies use multiple hypotheses to predict various aspects of an input text and combine these predictions into a final verdict. We find that the zero-shot baseline used for the initial error analysis already outperforms commercial systems and fine-tuned BERT-based hate speech detection models on HateCheck. The combination of the proposed strategies further increases the zero-shot accuracy of 79.4% on HateCheck by 7.9 percentage points (pp), and the accuracy of 69.6% on ETHOS by 10.0pp.

Hypothesis Engineering for Zero-Shot and Few-Shot Hate Speech Detection

<head>
	<style>
		.b1 {
			color: #ffffff;
			background-color: #5b1cf4;
			font-size: 19px;
			font-family: system-ui, sans-serif;
			border-radius: 15px;
			padding: 8px 40px;
			cursor: pointer
		}
		.b1:hover {
			color: #5b1cf4;
			background-color: #ffffff;
		}
	</style>
</head>
<button name="button" class="b1" onclick="window.open('https://us06web.zoom.us/rec/share/9L3bjkxEATmacwrCSHFkKv--9Qj3pfW421-LU5MRDW-RWrHg9LLNIW1bpxf9tKEV.MpYRBA7uN_MA_MMP')">Live Session Recording</button>
 

**This workshop is sponsored by:** 
![](https://assets.underline.io/markdown_image/1/image/9930cd8119e86600f955f66e25a7a870.png)
&nbsp&nbsp&nbsp&nbsp
![](https://assets.underline.io/markdown_image/1/image/c0eb62676c8bf505a36d8ab2efaf4b22.png) 
**About this workshop:** The special theme for this year is Online Harms in the Age of Large Language Models [**Read more**](https://www.workshopononlineabuse.com/) [**Schedule**](https://www.workshopononlineabuse.com/)

W8: The 8th Workshop on Online Abuse and Harms (WOAH 2024) (WOAH)

workshop paper

## Welcome to 2024 Annual Conference of the North American Chapter of the Association for Computational Linguistics!
This year, the conference is in Mexico City. NAACL was actually already planned for Mexico City in 2021, but due to the pandemic the entire conference was moved online. This year, finally, we get to go! So it is my sincere pleasure to welcome you to Mexico City, whether in person or virtually. Having the conference in Mexico City is a good opportunity to emphasize that NAACL is our flagship conference for ACL members not only in North America but also in Central and South America, even though NAACL has been bearing “North” in its name. At this year’s conference, we have a theme to match, with a theme track on the Languages of Latin America to showcase the linguistic diversity of the region.
 
The opportunity to present at NAACL should not depend on a researcher’s travel budget, or their family status. This is why it is so important to make virtual participation at NAACL as good an experience as possible – but we want to also provide a good experience for in-person participants. As a community, we are still working out the best way to do that. This year at NAACL, we are trying out a big virtual poster session ahead of the conference, with the hope that this will make make for a lively and interactive experience. At the same time, we are reducing virtual oral presentations, which seem to be particularly tricky to make to work well. A big thanks to the NAACL program chairs and to Luciana Benotti for all their ideas and work to improve the virtual experience. And participants, virtual as well as in-person: Please let us know what worked for you and what didn’t, so we can continue to improve hybrid conferences. 
 
I have been lucky to work with many amazing people. Without their insight, dedication and patience, and without the many hours of work they put in, NAACL would not have been possible. A huge thank you to the program chairs Helena Gomez, Kevin Duh, and Steve Bethard – you are the best! 
 
Finally, I would like to thank all authors, invited speakers and panelists, area chairs and reviewers, the volunteers organizing and chairing sessions, and all attendees, in-person and virtual. Thank you for helping us make NAACL 2024 come to life. 
 
Welcome and hope you all enjoy the conference! 
Katrin Erk 
The University of Texas at Austin 
NAACL-2024 General Chair 
*You can read the full Welcome message in the [Conference Handbook (downloadable)](https://drive.google.com/file/d/1H1NvW0VASQjkSCYgw3mr-3l4yYDSxz6B/view?usp=sharing)*

To access the event page you need to register [**here.**](http://acl.swoogo.com/naacl2024) 
Your access to the event page is limited based on your registration type. If you registered for workshops only, you will gain access to full workshops content on the day of the workshops program.

Please register!

NAACL 2024

2024 Annual Conference of the North American Chapter of the Association for Computational Linguistics

To view Day 2 Live Session Recording click [**here**](https://underline.io/events/395/sessions?eventSessionId=15300&searchGroup=lecture) SemEval is a series of international natural language processing (NLP) research workshops whose mission is to advance the current state of the art in semantic analysis and to help create high-quality annotated datasets in a range of increasingly challenging problems in natural language semantics. Each year's workshop features a collection of shared tasks in which computational semantic analysis systems designed by different teams are presented and compared.

SemEval is sponsored by the SIGLEX Special Interest Group on the Lexicon of the Association for Computational Linguistics. For more information on SemEval and its history, please see http://en.wikipedia.org/wiki/SemEval.
 For more details visit our workshop website: https://semeval.github.io/SemEval2023/
#### [Visit GatherTown](https://app.gather.town/app/5OscLswEEuYf2Psb/ACL2023)

W1: The 17th International Workshop on Semantic Evaluation (SemEval)_Day 1

### Welcome to ACL 2023, the 61st Annual Meeting of the Association for Computational Linguistics! 
 The conference will be held in Toronto, Canada, July 9-14, 2023. 
Following the succession of the recent conferences in our field, ACL 2023 will adopt a hybrid format.
While the impact of Covid has considerably diminished in terms of traveling, obtaining visas to Canada
entails a very long process. Moreover, the global economic conditions pose challenges for many individuals to travel to conferences. Recognizing these circumstances, we know many participants may not be
able to attend the conference in person. Therefore, we are committed to providing a great virtual platform
so everyone has the opportunity to interact with other participants and enjoy the conference. Based on the
current registered participants, approxiately 30% have chosen to attend the conference virtually. Whether
you join us in person or virtually, we sincerely hope everyone has a remarkable conference experience. 
This General Chair’s message is where I express my gratitude to the many individuals who have made
enormous contributions to the conference over the past year.

Read [**ACL 2023 General Chair's message**](https://docs.google.com/document/d/1WobYM7norbG4dI48s75HfJoD89qgX5a_F-6U8AteLSA/edit?usp=sharing/) in full.

##### **[Conference Handbook](https://2023.aclweb.org/downloads/acl2023-handbook.pdf)**

ACL 2023

The Association for Computational Linguistics (ACL) is the premier international scientific and professional society for people working on computational problems involving human language, a field often referred to as either computational linguistics or natural language processing.

The goal of The Workshop on Online Abuse and Harms (WOAH) is to advance research that develops, interrogates and applies computational methods for detecting, classifying and modelling online abuse. For more details visit our workshop website: https://www.workshopononlineabuse.com/
#### [Visit GatherTown](https://app.gather.town/app/5OscLswEEuYf2Psb/ACL2023)

W9: The 7th Workshop on Online Abuse and Harms (WOAH)

Click on the Live Session Recording to view the session 
[Live Session Recording Part 1](https://us06web.zoom.us/rec/share/Z4xEmbbPsXx6eJgKSMJkOnBRIhJSmJFeLALAW1y-dYcRRx2HOQFmpeD1fmGrT2D4.1AgCmC4RbhZi3eID?startTime=1665962332000) [Live Session Recording Part 2](https://us06web.zoom.us/rec/share/Z4xEmbbPsXx6eJgKSMJkOnBRIhJSmJFeLALAW1y-dYcRRx2HOQFmpeD1fmGrT2D4.1AgCmC4RbhZi3eID?startTime=1665990851000)
 
**Workshop overview:** As in the earlier editions, TRAC will focus on the applications of NLP, ML and pragmatic studies on aggression and impoliteness to tackle these issues. We invite long (8 pages) and short papers (4 pages) as well as position papers and opinion pieces (5 - 20 pages) based on, but not limited to, any of the following themes from academic researchers, industry and any other group / team working in the area. 

* Theories and models of aggression and conflict in language. 

* Cyberbullying, threatening, hateful, aggressive and abusive language on the web.

* Multilingualism and aggression.

* Resource Development - Corpora, Annotation Guidelines and Best Practices for threat and aggression detection.

* Computational Models and Methods for aggression, hate speech and offensive language detection in text and speech.

Detection of threats and bullying on the web.

Automatic censorship and moderation: ethical, legal and technological issues and challenges. [**Read more.**](https://sites.google.com/view/trac2022/) Our detailed schedule can be viewed [**here.**](https://sites.google.com/view/trac2022/schedule)

W12 Third Workshop on Threat, Aggression and Cyberbullying (TRAC-2022)

[![](https://assets.underline.io/uploads/markdown_image/1/image/81a3c0317d24f663b49b996875024d45.png)](https://aclanthology.org/volumes/2022.coling-1/)



### THE CONFERENCE WE KNOW AND WE WANT.
**COLING**, the International Conference on Computational Linguistics, is one of the premier conferences for the natural language processing and computational linguistics.

First established in 1965, the biennial COLING conference is held in diverse parts of the globe and attracts participants from both top-ranked research centers and emerging countries. Today, the most important developments in our field are taking place not only in universities and academic research institutes but also in industrial research departments including tech-startups. COLING provides opportunities for all these communities to showcase their exciting discovery.

In fall of 2022, COLING will be held in Gyeongju in a hybrid format. All participants can either present at the venue site or join virtually. As more people get vaccinated, we are happy to provide safer environments for our colleagues. We believe that COLING 2022 will be one of the conferences, free from the pandemic. The hybrid format gives presenters and sponsors a valuable opportunity to promote their companies in both an online and in-person venue. For the first time in a long time, customers can interact with their sponsor's products first-hand. The online venue, too, gives sponsors the chance to network with those unable to attend the in-person session.

The hybrid format ultimately lends itself to greater exposure for our sponsors: COLING2022 will let you reach more potential partners and customers than ever before!

To gain access to this event page you are required to register. Find more information and pay the registration fee on event the organizer’s website **[https://coling2022.org/reg](https://coling2022.org/reg)**

COLING 2022

COLING, the International Conference on Computational Linguistics, is one of the premier conferences for the natural language processing and computational linguistics.

Janis Marc Goldzycher

4

4

SHORT BIO

Presentations

AustroTox: A Dataset for Target-Based Austrian German and English Offensive Language Detection

CL-UZH at SemEval-2023 Task 10: Sexism Detection through Incremental Fine-Tuning and Multi-Task Learning with Label Descriptions

Evaluating the Effectiveness of Natural Language Inference for Hate Speech Detection in Languages with Limited Labeled Data

Hypothesis Engineering for Zero-Shot and Few-Shot Hate Speech Detection

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES