Ireland

This paper presents our winning solution for the Shared Task on Detecting Signs of Depression from Social Media Text at LT-EDI-ACL2022. The task was to create a system that, given social media posts in English, should detect the level of depression as ‘not depressed’, ‘moderately depressed’ or ‘severely depressed’. We based our solution on transformer-based language models. We fine-tuned selected models: BERT, RoBERTa, XLNet, of which the best results were obtained for RoBERTa. Then, using the prepared corpus, we trained our own language model called DepRoBERTa (RoBERTa for Depression Detection). Fine-tuning of this model improved the results. The third solution was to use the ensemble averaging, which turned out to be the best solution. It achieved a macro-averaged F1-score of 0.583. The source code of prepared solution is available at https://github.com/rafalposwiata/depression-detection-lt-edi-2022.

ACL 2022

Detecting Signs of Depression from Social Media Text using RoBERTa Pre-trained Language Models

deproberta

depression detection

roberta

# Welcome everyone to ACL 2022!

The 60th Annual Meeting of the Association for Computational Linguistics is taking place May 22-27, 2022 as a hybrid event, in Dublin and online. We are happy to welcome all of you to this anniversary edition with an almost 50-50 in-person and virtual participation. 
The main conference program features oral presentations, in-person and virtual posters and demo sessions, a plenary session for our best paper presentations and awards, three amazing keynote events and two new initiatives of invited talks: Spotlight Talks for Young Rising Stars (STIRS) and The Next Big Idea Talks. Posters (including Findings of ACL 2022) and demos are grouped by areas for both the in-person and the virtual sessions. For the virtual component, the talks will be on Zoom and the posters and the demos will be in GatherTown. The Student Research Workshop will have an oral session and a poster session as part of Poster Session 1. The program also features eight Tutorials and 28 Workshops. 

 
We wish you a wonderful conference! 
[**The ACL 2022 Organizing Committee**](https://www.2022.aclweb.org/organisers)
 
[**Conference Handbook**](https://drive.google.com/file/d/1_BUCMfhMVrjG9E2e71aHdHeE28KSje0l/view?usp=sharing) 
[**Mini Handbook**](https://drive.google.com/file/d/1qlBKl0wzmlVF1oCeMQl3BahLd9nLP5Ce/view?usp=sharing) 
[**Posters and Demo guides**](https://drive.google.com/file/d/1UucMAoCNncIOaH1rMMDa0owuG9qgvJTG/view?usp=sharing)

The Association for Computational Linguistics (ACL) is the premier international scientific and professional society for people working on computational problems involving human language, a field often referred to as either computational linguistics or natural language processing (NLP). 

workshop paper

Depression is a common mental disorder that severely affects the quality of life, and can lead to suicide. When diagnosed in time, however, mild, moderate, and even severe depression can be treated. This is why it is vital to detect signs of depression in time. One possibility for this is the use of text classification models on social media posts. Transformers have achieved state-of-the-art performance on a variety of similar text classification tasks. One drawback, however, is that when the dataset is imbalanced, the performance of these models may be negatively affected. Because of this, in this paper, we examine the effect of balancing a depression detection dataset using data augmentation. In particular, we use abstractive summarization techniques for data augmentation. We examine the effect of this method on the LT-EDI-ACL2022task. Our results show that when increasing the multiplicity of the minority classes to the right degree, this data augmentation method can in fact improve classification scores on the task.

Detecting signs of Depression from Social Media: Examining the use of summarization methods as data augmentation for text classification

This paper describes the system submitted by our team for the homophobia/transphobia detection in social media comments shared task. A machine learning-based model has been designed and integrated with TF/IDF as a vector space model. SVM has been used to develop the proposed model and our submission reported 0.91, 0.92, and 0.88 weighted f1-score for English, Tamil, and Tamil-English datasets respectively.

Homophobia/Transphobia Detection for Equality, Diversity, and Inclusion using SVM

The 2022 edition of LT-EDI proposed two tasks in various languages. Task Hope Speech Detection required models for the automatic identification of hopeful comments for equality, diversity, and inclusion. Task Homophobia/Transphobia Detection focused on the identification of homophobic and transphobic comments. We targeted both tasks in English by using reinforced BERT-based approaches. Our core strategy aimed at exploiting the data available for each given task to augment the amount of supervised instances in the other. On the basis of an active learning process, we trained a model on the dataset for Task~i and applied it to the dataset for Task~j to iteratively integrate new silver data for Task~i. Our official submissions to the shared task obtained a macro-averaged F1_score of 0.53 for Task_hope and 0.46 for Task_antiLGBT, placing our team in the third and fourth positions out of 11 and 12 participating teams respectively.

When Hope and Hate Collide

A person feeling unimportant, useless, or unhappy may be a sign of depression. Depression is one of the most severe mental health conditions which may be unnoticed, undiagnosed and untreated in many cases. People worldwide suffer from depression and the affected person may operate poorly at work, studies, and in the community.
Knowingly or unknowingly the behavior of a person will be reflected in the comments she/he posts on social media. Social media users who are usually in depression try to seek the attention and sympathy of others by posting negative and disturbing messages or requesting help.
However, as analyzing the increasing amount of social media data manually in laborious and error-prone, automated tools have to be developed for the same.
To address the issue of detecting the sign of depression content on social media, in this paper, we - team MUCS, describe an Ensemble of Machine Learning (ML) models and a Transfer Learning (TL) model submitted to "Detecting Signs of Depression from Social Media Text-LT-EDI@ACL 2022" (DepSign-LT-EDI@ACL-2022) shared task at Association for Computational Linguistics (ACL) 2022.

Detecting Sign of Depression from Social Media Text using Supervised Learning Approach

Social media is considered as a platform where users express themselves. The rise of social media as one of humanity’s most important public communication platforms presents a potential prospect for early identification and management of mental illness. Depression is one such illness that can lead to a variety of emotional and physical problems. It is necessary to measure the level of depression from the social media text to treat them and to avoid the negative consequences. Detecting levels of depression is a challenging task since it involves the mindset of the people, which can change periodically. The aim of the DepSign-LT-EDI@ACL-2022 shared task is to classify the social media text into three levels of depression namely “Not Depressed”, “Moderately Depressed”, and “Severely Depressed”. This overview presents a description of the task, the data set, methodologies used and an analysis on the results of the submissions. The models that were submitted as a part of the shared task had used a variety of technologies from traditional machine learning algorithms to deep learning models. It could be observed from the result that the transformer based models have outperformed the other models. Among the 32 teams who had submitted their results for the shared task, the best macro F1-score of 0.583 was obtained using a transformer based model.

Findings of the Shared Task on Detecting Signs of Depression from Social Media

This paper illustrates the overview of the shared
task on automatic speech recognition in the
Tamil language. In the shared task, spontaneous
Tamil speech data gathered from elderly
and transgender people was given for recognition
and evaluation. These utterances were collected
from people when they communicated
in the public locations such as hospitals, markets,
vegetable shop, etc. The speech corpus
includes utterances of male, female, and transgender
and was split into training and testing
data. The given task was evaluated using WER
(Word Error Rate). The participants used the
transformer-based model for automatic speech
recognition. Different results using different
pre-trained transformer models are discussed
in this overview paper.

Findings of the Shared Task on Speech Recognition for Vulnerable Individuals in Tamil

Social media platforms have been provoking masses of people. The individual comments affect a prevalent way of thinking by moving away from preoccupation with discrimination, loneliness, or influence in building confidence, support, and good qualities. This paper aims to identify hope in these social media posts. Hope significantly impacts the well-being of people, as suggested by health professionals. It reflects the belief to achieve an objective, discovers a new path, or become motivated to formulate pathways.
In this paper we classify given a social media post, hope speech or not hope speech, using ensembled voting of BERT, ERNIE 2.0 and RoBERTa for English language with 0.54 macro F1-score ($2^{st}$ rank). For non-English languages Malayalam, Spanish and Tamil we utilized XLM RoBERTA with 0.50, 0.81, 0.3 macro F1 score ($1^{st}$, $1^{st}$,$3^{rd}$ rank) respectively. For Kannada, we use Multilingual BERT with 0.32 F1 score($5^{th}$)position. We release our code-base here https://github.com/Muskaan-Singh/Hate-Speech-detection.git.

Hope Speech Detection for Equality, Diversity and Inclusion

The increased expansion of abusive content on social media platforms negatively affects online users. Transphobic/homophobic content indicates hatred comments for lesbian, gay, transgender, or bisexual people. It leads to offensive speech and causes severe social problems that can make online platforms toxic and unpleasant to LGBT+people, endeavoring to eliminate equality, diversity, and inclusion. 
In this paper, we present our classification system; given comments, it predicts whether or not it contains any form of homophobia/transphobia with a Zero-Shot learning framework. Our system submission achieved 0.40, 0.85, 0.89 F1-score for Tamil and Tamil-English, English with ($1^{st}$, $1^{st}$,$8^{th}$) ranks respectively. We release our codebase here https://github.com/Muskaan-Singh/Homophobia-and-Transphobia-ACL-Submission.git.

Homophobia/Transphobia Detection in social media comments

Depression is a common illness involving sadness and lack of interest in all day-to-day activities. It is important to detect depression at an early stage as it is treated at an early stage to avoid consequences. In this paper, we present our system submission for DepSign-LT-EDI@ACL-2022. We aim to detect the signs of depression of a person from their social media postings wherein people share their feelings and emotions. The proposed system is an ensembled voting model with fine-tuned BERT, RoBERTa, and XLNet. Given social media postings in English, the submitted system classify the signs of depression into three labels, namely “not depressed,” “moderately depressed,” and “severely depressed.” Our best model is ranked $3^{rd}$ position with 0.54\% accuracy . We make our codebase accessible here https://github.com/Muskaan-Singh/Depression-Detection.git.

Detecting Signs of Depression from Social Media Text

Homophobia and Transphobia Detection is the task of identifying homophobia, transphobia, and non-anti-LGBT+ content from the given corpus. Homophobia and transphobia are both toxic languages directed at LGBTQ+ individuals that are described as hate speech. This paper summarizes our findings on the "Homophobia and Transphobia Detection in social media comments" shared task held at LT-EDI 2022 - ACL 2022. This shared task focused on three sub-tasks for Tamil, English, and Tamil-English (code-mixed) languages. It received 10 systems for Tamil, 13 systems for English, and 11 systems for Tamil-English. The best systems for Tamil, English, and Tamil-English scored 0.570, 0.870, and 0.610, respectively, on average macro F1-score.

Detecting Signs of Depression from Social Media Text using RoBERTa Pre-trained Language Models

Downloads

Next from ACL 2022

Detecting signs of Depression from Social Media: Examining the use of summarization methods as data augmentation for text classification

Similar lecture

Detecting Signs of Depression from Social Media Text

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES