Transfer learning is one of the prevailing approaches towards training language-specific BERT models. However, some languages have uncommon features that may prove to be challenging to more domain-general models but not domain-specific models. Comparing the performance of BERTić, a Bosnian-Croatian-Montenegrin-Serbian model, and Multilingual BERT on a Named-Entity Recognition (NER) task and Masked Language Modelling (MLM) task based around a rare phenomenon of indeclinable female foreign names in Serbian reveals how the different training approaches impacts their performance. Multilingual BERT is shown to perform better than BERTić in the NER task, but BERTić greatly exceeds in the MLM task. Thus, there are applications both for domain-general training and domain-specific training depending on the tasks at hand.

Comparing domain-specific and domain-general BERT variants for inferred real-world knowledge through rare grammatical features in Serbian

**Organizers:** 
Jakub Piskorski, Polish Academy of Sciences, Poland
Bogdan Babych, Heidelberg University, Germany
Michał Marcińczuk, Wroclaw University of Science and Technology, Samurai Labs, Poland
Preslav Nakov, Mohamed bin Zayed University of Artificial Intelligence, United Arab Emirates
Maciej Ogrodniczuk, Polish Academy of Sciences, Poland
Senja Pollak, Jožef Stefan Institute, Slovenia
Pavel Přibáň, University of West Bohemia, Plzeň, Czech Republic
Josef Steinberger, University of West Bohemia, Plzeň, Czech Republic
Roman Yangarber, University of Helsinki, Finland
Piotr Rybak, Polish Academy of Sciences, Poland For more details, please visit our [workshop website](http://bsnlp.cs.helsinki.fi/index.html))

SlavNLP-2023: The 9th Biennial Workshop on Slavic NLP

workshop paper

### Welcome to the 17th Conference of the European Chapter of the Association for Computational Linguistics (EACL) 
Continuing its mission of expanding and involving the science community of all European countries, EACL had selected the Ukrainian community for the 16th EACL, which took place online due to the COVID pandemic. Unfortunately, the ongoing war made the organisation in Kyiv impossible. Considering the importance of physical interaction among researchers, especially after the restrictions imposed by the COVID pandemic, in addition to an online mode, the conference will be held in Dubrovnik, Croatia, from 2 to 6 of May, 2023. The original aim of strengthening the connection with the Ukrainian community will not change as our program will feature a dedicated session and a workshop to highlight work on Ukrainian language technologies. As the flagship European conference in the field of computational linguistics, EACL welcomes European and international researchers covering a broad spectrum of research areas that are concerned with computational approaches to natural language.

You need to register for the conference in order to access this site. Please visit https://2023.eacl.org/registration for more information.

EACL 2023

As the flagship European conference in the field of computational linguistics, EACL welcomes European and international researchers covering a broad spectrum of research areas that are concerned with computational approaches to natural language.

Sofia Lee

1

SHORT BIO

Presentations

Comparing domain-specific and domain-general BERT variants for inferred real-world knowledge through rare grammatical features in Serbian

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES