Brazil

In this work, we carried out a study about the use of attention-based algorithms to automate the categorization of Brazilian case law documents. We used data from the Kollemata Project to produce two distinct datasets with adequate class systems. Then, we implemented a multi-class and multi-label version of BERT and fine-tuned different BERT models with the produced datasets. We evaluated several metrics, adopting the micro-averaged F1-Score as our main metric for witch we obtained a performance value of F1=0.72, corresponding to significative gains over the tested statistical baseline.

BRACIS 2021

verBERT: Automating Brazilian Case Law Document Multi-label Categorization Using BERT

case law documents

categorization

bert

stages 

COLING, the International Conference on Computational Linguistics, is one of the premier conferences for natural language processing and computational linguistics. Often grouped within the field of artificial intelligence, but actually pre-dating the development of artificial intelligence, advances in computational linguistics and natural language processing are now some of the major drivers behind the use of artificial intelligence for commercial and social applications – for example, on-line search, machine translation and with voice-assisted conversational devices.

First established in 1965, the biennial COLING conference is held in diverse parts of the globe and attracts participants from both top-ranked research centers and emerging countries. Today, the most important developments in our field are taking place not only in universities and academic research institutes, but also in industrial research departments and in technological startups. COLING conferences provide opportunities for all these communities to showcase their exciting developments.

COLING 2020

COLING, the International Conference on Computational Linguistics, is one of the premier conferences for natural language processing and computational linguistics. Often grouped within the field of artificial intelligence, but actually pre-dating the development of artificial intelligence, advances in computational linguistics and natural language processing are now some of the major drivers behind the use of artificial intelligence for commercial and social applications – for example, on-line search, machine translation and with voice-assisted conversational devices.

technical paper

**BRACIS** originated from the combination of the two most important scientific events in Brazil in Artificial Intelligence (AI) and Computational Intelligence (CI): the Brazilian Symposium on Artificial Intelligence – **SBIA** (22 editions), and the Brazilian Symposium on Neural Networks – **SBRN** (13 editions). **ENIAC** is a national forum for researchers, practitioners, educators and students to present and discuss innovations, trends, experiences, developments and work in progress in the fields of Artificial and Computational Intelligence. **STIL** is the bi-annual Language Technology event.
All events are supported by the Brazilian Computer Society – Special Interest Groups: **CE-IA**, **CE-IC** and **CE-PLN**.

To access the 10th Brazilian Conference on Intelligent Systems (**BRACIS**), you need to register for the conference.  Please visit the Conference official site to register

[Register now](http://c4ai.inova.usp.br/bracis2021/)

Register now

BRACIS originated from the combination of the two most important scientific events in Brazil in Artificial Intelligence (AI) and Computational Intelligence (CI): the Brazilian Symposium on Artificial Intelligence – SBIA (22 editions), and the Brazilian Symposium on Neural Networks – SBRN (13 editions). 
ENIAC is a national forum for researchers, practitioners, educators and students to present and discuss innovations, trends, experiences, developments and work in progress in the fields of Artificial and Computational Intelligence. 
STIL is the bi-annual Language Technology event.
All events are supported by the Brazilian Computer Society – Special Interest Groups: CE-IA, CE-IC and CE-PLN

This work explores speech as a biomarker and investigates the detection of respiratory insufficiency (RI) by analyzing speech samples. 
Previous work constructed a dataset of respiratory insufficiency COVID-19 patient utterances and analyzed it by means of a convolutional neural network achieving an accuracy of $87.04\%$, validating the hypothesis that one can detect RI through speech. 
Here, we study how Transformer neural network architectures can improve the performance on RI detection. 
This approach enables construction of an acoustic model. By choosing the correct pretraining technique, we generate a self-supervised acoustic model, leading to improved performance ($96.53\%$) of Transformers for RI detection.

Audio MFCC-gram Transformers for respiratory insufficiency detection in COVID-19 disease

Depression is a psychological disorder that affects millions of people in the world, regardless of their age, social class, or nationality. Different techniques have been studied to analyze and recognize this disease in the literature, such as Natural Language Processing, Sentiment Analysis, and Machine Learning. However, in Brazilian Portuguese, only a few studies have been focused on creating a dataset to classify symptoms of depression. In this paper, we propose a novel text dataset composed of sentences that refer to the main symptoms of depression: behavioral, physiological, and psychological. Initial experiments exploring different machine learning algorithms in the dataset obtained high accurate performance values, which shows that the study is promising to encourage research in this area.

DP-Symptom-Identifier: uma estratégia para classificar sintomas de depressão utilizando um conjunto de dados textuais na língua portuguesa

A depressão é uma das questões de saúde mental mais preocupantes da atualidade. No Brasil, em 2019, 10,2% da população adulta relatou ter sido diagnosticada com depressão segundo dados da Pesquisa Nacional de Saúde. Identificar pessoas com perfil possivelmente depressivo permite um acompanhamento adequado por parte dos profissionais de saúde mental. Nesse sentido, as redes sociais online, como o Twitter, podem ser importantes aliadas. Este artigo apresenta experimentos realizados para a classificação automática de postagens (e não usuários) do Twitter contendo conteúdo que denota algum sintoma de depressão. A classificação com regressão logística apresentou os melhores resultados (F1 média de 57\%) entre os algoritmos investigados.

Identificando sintomas de depressão em postagens do Twitter em português do Brasil

Os danos causados por notícias falsas ou enganosas têm se potencializado graças à facilidade com que as informações são disseminadas em redes sociais. Durante a pandemia do Covid-19, iniciada em 2020, tais notícias foram capazes de gerar pânico na população, além de instruir erroneamente as pessoas sobre a prevenção da doença. O presente trabalho introduz um novo corpus a partir de postagens no Twitter na língua portuguesa com desinformações sobre a Covid-19. Além do novo corpus, o trabalho avalia diferentes abordagens de representações textuais e algoritmos de aprendizagem na tarefa de detecção de mensagens contendo desinformação. O melhor resultado obtido alcançou F1-score de 89% no modelo de classificação SVM com a representação textual TF-IDF.

Detecção de desinformação sobre Covid-19 no Twitter

Automatic text summarization aims at condensing the contents of a text into a simple and descriptive summary. Summarization techniques drastically benefited from the recent advances in Deep Learning. Nevertheless, these techniques are still unable to properly deal with long texts. In this work, we investigate whether the combination of summaries extracted from multiple sections of long scientific texts may enhance the quality of the summary for the whole document. We conduct experiments on real world corpus to assess the effectiveness of our proposal. The results show that our multi-section proposal are as good as summaries generated using the entire text as input and twice as good as single section.

A Long Texts Summarization Approach to Scientific Articles

In recent years, researchers in the area of Computational Creativity have studied the human creative process proposing different approaches to reproduce it with a formal procedure. We introduce a model for the generation of literary rhymes in Spanish, combining structures of language and neural network models Word2vec, into a structure for semantic assimilation. The results obtained with a manual evaluation of the texts generated by our algorithm are encouraging

A Preliminary Study for Literary Rhyme Generation based on Neuronal Representation, Semantics Resources and Shallow Parsing

The production of fake news is a problem nowadays. With social networks, fake news spread in easier and less costly ways, having the power to reach a large number of people in a short time. In this paper, we investigate graph-based approaches for fake news characterization and detection, taking into account widely used measures of graphs and complex networks. Our results show that some network measures are useful for structurally characterizing fake and true news and that machine learning-based solutions over this kind of feature produce promising results.

Structural Characterization and Graph-based Detection of Fake News in Portuguese

Professional fact-checking tends to be costly and scalability challenges. For this reason, a series of methods to automate this process has been emerging. However, these methods have been created with monolithic architectures, not making use of pre-built parts, and are harder to be understood by others. This work aims to propose a framework, where the development of methods can be done in a modular manner, creating workflows based on key steps that can be linked together to generate the input classification. The framework makes use of a proposed data traceability ontology to map all generated data during execution under a unified vocabulary, which facilitates communication between these independent components.

ReVera Framework: Um Framwork para rastreabilidade em fact-checking automático

In this presentation we show an empirical study of document retrieval and reader for automatically answering conceptual student questions about technology and management courses in an online education platform.

An Empirical Study of Information Retrieval and Machine Reading Comprehension Algorithms for an Online Education Platform

The main purpose of stemming is to reduce the inflected words into its root form or stem. Thus, words can be mapped to the same concept, improving the process of information retrieval, regarding its ability to index documents and to reduce data dimensionality. However, the efficiency of those algorithms varies according to different aspects. Also, studies in the field area reached contrasting conclusions. This work assesses the use of stemmers in the retrieval of legislative documents written in Portuguese. Four stemmers together with BM25 were evaluated in two legislative corpora from the Brazilian Chamber of Deputies. RSLP-S and Savoy stemmers showed the best improvements in the information retrieval pipeline.

Premium content

verBERT: Automating Brazilian Case Law Document Multi-label Categorization Using BERT

Downloads

Next from BRACIS 2021

Audio MFCC-gram Transformers for respiratory insufficiency detection in COVID-19 disease

Similar lecture

Incorporating Noisy Length Constraints into Transformer with Length-aware Positional Encodings

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES