Brazil

In the hospital environment, the incidence of adverse events (unforeseen incidents that cause harm to patients) is the primary concern of risk management teams. The use of machine learning techniques may help healthcare professional to identify and mitigate adverse events. This thesis develops two experiments to evaluate machine learning approaches to identify two major adverse events in electronic health records. In this extended abstract we cover the algorithm created to identify fall events in clinical notes, as they are closely related to the processing of portuguese language. We annotated 1,402 clinical sentences with fall events to train a Token Classifier (TkC) to detect words within the context of falls. The TkC was able to correctly identify 85% of the sentences with fall events.

PROPOR 2022

Applying Machine Learning to Electronic Health Records: a Study on Two Adverse Events

electronic health records

adverse events

supervised learning

machine learning

unsupervised learning

### Looking for Cogsci 2023? Please [click here](https://underline.io/events/405/reception) to switch to 2023 edition.


**Dear Colleagues,**

Welcome to the 43rd Annual Conference of the Cognitive Science Society! 

This year’s conference brings together the latest research from all Cognitive Science and also highlights this year’s theme **Comparative Cognition: Animal Minds.** 

The program features four plenary speakers: Friederike Range (University of Veterinary Medicine, Vienna), Onur Güntürkün (Ruhr University Bochum), Julia Fischer (University of Göttingen), and Erich Jarvis (The Rockefeller University). The keynotes and invited symposia showcase the broad spectrum of ideas that encompass the conference theme of comparative cognition. 

Further, the program includes the Rumelhart Prize keynote presentation by Susan Goldin-Meadow (University of Chicago), and symposia to celebrate the winner of the Elman Prize: Wei Ji Ma (New York University), the Heineken Award winner Robert Zatorre (McGill University), and the Robert J. Glushko Dissertation Prizes session.

The program committee for CogSci 2021 received 1,025 submissions, including 710 full papers, 275 member abstracts, 8 publication-based talks, as well as 15 proposals for symposia, and 17 for workshops and tutorials. After a rigorous review process, the committee selected 152 papers for oral presentation and inclusion in the conference proceedings (14.8%), 332 papers for poster presentation and inclusion in the proceedings (32.4%), and 175 papers for poster presentation with inclusion of abstracts in the proceedings (17.1%) We also selected 275 submitted member abstracts. In addition, we accepted 6 publication-based talks, 12 symposia, and 9 workshops and tutorials to make for an exciting and inclusive program.

We hope that you enjoy the conference this year!<br><br>

**Your Program Chairs,**
![](https://assets.underline.io/uploads/markdown_image/1/image/99984908caba5e6453e5fc5ba34f3507.jpg)

**Learn more about the Vienna Cognitive Science Hub at the University of Vienna, hosts of CogSci 2021**

<iframe width="560" height="315" src="https://www.youtube.com/embed/464h1m3iU68" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowfullscreen></iframe>

To review the proceedings for the conference or review the searchable program, please visit the [website](https://cognitivesciencesociety.org/program/).


CogSci 2021

The Cognitive Science Society brings together researchers from around the world who hold a common goal: understanding the nature of the human mind. The mission of the Society is to promote Cognitive Science as a discipline, and to foster scientific interchange among researchers in various areas of study, including Artificial Intelligence, Linguistics, Anthropology, Psychology, Neuroscience, Philosophy, and Education. The Society is a non-profit professional organization and its activities include sponsoring an annual conference and publishing the journals Cognitive Science and TopiCS.

poster

The International Conference on Computational Processing of Portuguese (PROPOR) is the main event in the area of human language processing that is focused on theoretical and technological issues of written and spoken Portuguese and Galician. The meeting has been a very rich forum for the exchange of ideas and partnerships for the research and industry communities dedicated to the automated processing of Portuguese, promoting the development of methodologies, resources and projects that can be shared among researchers and practitioners in the field.

Find more information and pay the registration fee on [event organizer’s website](https://sites.universidadedefortaleza.com/propor2022/?page_id=401)

The International Conference on Computational Processing of Portuguese (PROPOR) is the main event in the area of human language processing that is focused on theoretical and technological issues of written and spoken Portuguese and Galician.

We compiled a set of patterns that denote lexico-semantic relations in Portuguese, created templates where one argument is fixed and the other is replaced by a mask, and then used BERT for predicting the latter. For most relations and measures, when assessed in a test of lexico-semantic analogies, BERT predictions outperformed those of earlier methods computed from static word embeddings, either with a pattern alone or with a combination of patterns. There is still a large margin of progression, but this suggests that BERT can be used as a source of lexico-semantic knowledge in Portuguese.

Drilling Lexico-Semantic Knowledge in Portuguese from BERT

Named Entity Recognition (NER) is the task of identifying textual elements and categorizing them into predefined classes, such as names of people, locations, organizations, and others. Recently, NER systems based on neural networks have obtained state-of-the-art results. One of the main components of this kind of system is the word embeddings representation adopted that can be static (traditional) or contextual trained in language models. This work analyzes the strategy of combining traditional and contextual embeddings to obtain richer representations for Portuguese NER. We adopt a Bidirectional Long ShortTerm Memory (BiLSTM) as a classification model integrated with the Conditional Random Fields (CRF) algorithm. Experiments were carried out in different corpora, and the results obtained demonstrate that the combination strategy of word embeddings models is viable and led to results comparable with state-of-the-art NER systems in Portuguese.

Combining Word Embeddings for Portuguese Named Entity Recognition

Traditional text classification approaches often require a good amount of labeled data, which is difficult to obtain, especially in restricted domains or less widespread languages. This lack of labeled data has led to the rise of low-resource methods, that assume low data availability in natural language processing. Among them, zero-shot learning stands out, which consists of learning a classifier without any previously labeled data. The best results reported with this approach use language models such as Transformers, but fall into two problems: high execution time and inability to handle long texts as input. This paper proposes a new model, ZeroBERTo, which leverages an unsupervised clustering step to obtain a compressed data representation before the classification task. We show that ZeroBERTo has better performance for long inputs and shorter execution time, outperforming XLM-R by about 12% in the F1 score in the FolhaUOL dataset.

ZeroBERTo - Leveraging Zero-Shot Text Classification by Topic Modeling

Our contribution presents the first ever stance and sentiment annotated corpus in Portuguese. Using data from Twitter, we annotated a data set with over 15,000 tweets. In building the corpus, we made both random and supervised searches to maximize balance. Using four annotators, we have classified each tweet on four categories: support, against, neutral or inconclusive. Furthermore, we have annotated each tweet for sentiment: positive, negative, neutral, sarcasm or inconclusive. Our annotators yield strong inter-annotator agreement. In addition, we test a baseline model using a pre-trained BERT model for Portuguese. Results suggest that our data set is in line with its counterparts in other languages.

SS-PT: A Stance and Sentiment data set from Portuguese quoted tweets

This paper presents a targeted syntactic evaluation of Transformer models for Galician-Portuguese. We defined three experiments that allow to explore how these models, trained with a masked language modeling objective, encode syntactic knowledge. To do so, we created a new dataset including test instances of number (subject-verb), gender (subject-predicative adjective), and person (subject-inflected infinitive) agreement. This dataset was used to evaluate monolingual and multilingual BERT models, controlling for various aspects such as the presence of attractors or the distance between the dependent elements. The results show that Transformer models perform competently in many cases, but they are generally confounded by the presence of attractors in long-distance dependencies. Moreover, the different behavior of monolingual models trained with the same corpora reinforces the need for a deep exploration of the network architectures and their learning process.

A Targeted Assessment of the Syntactic Abilities of Transformer Models for Galician-Portuguese

This paper describes the development of the first test suite for the language direction Portuguese-English. Designed for fine-grained linguistic analysis, the test suite comprises 330 test sentences for 66 linguistic phenomena and 14 linguistic categories. Eight different MT systems were compared using quantitative and qualitative methods via the test suite: DeepL, Google Sheets, Google Translator, Microsoft Translator, Reverso, Systran, Yandex and an internally built NMT system
trained over 30 hours on 2,5M sentences. It was found that ambiguity, named entity & terminology and verb valency are the categories where MT systems struggle most. Negation, pronouns, subordination, verb tense/aspect/mood and false friends are the categories where MT systems perform best.

A test-suite for the evaluation of Portuguese-English machine translations

This work focuses on the enrichment of existing Portuguese word embeddings with visual information. The combined text-image embeddings were tested against their text-only counterparts in common NLP tasks. The new embeddings were tested in two different domains - general news and a geosciences. The results show an increase in performance for several tasks, which indicates that visual information fusion for word embeddings can be useful for certain tasks.

Enriching Portuguese Word Embeddings with Visual Information

Abstract Meaning Representation (AMR) is a semantic formalism that has been widely adopted in the area of semantic parsing. We present in this paper our contribution to the task for Portuguese. We investigated semantic parsing methods of different paradigms, producing state-of-the-art results for this language. We also introduced the first AMR-annotated corpus for Portuguese, a novel and better semantic parsing evaluation measure, and a new AMR-based alignment method.

Abstract Meaning Representation Parsing for the Brazilian Portuguese Language

Languages evolve internally and externally in relation to themselves and to others. It is for this reason that the automatic calculation of the historical and current distance between languages from corpora is an interesting challenge. In this thesis we have developed a methodology for calculating this distance from perplexity, a metric that has also proved to be suitable for automatic identification between languages. We have also tested the role that orthography plays in the distance between languages. Finally, we have created an adhoc corpus called Carvalho in orthographies as close as possible to the original ones, where we have carried out our experiments.

Corpus-based measures of distance between languages and variants. Application to the historical linguistics of Galician, Portuguese, Spanish and English

In the legal domain, documents have peculiarities related to their length, specialized use, and vocabulary. Recent neural network-based approaches can generate high-quality summaries. However, these approaches have been used mostly for creating concise abstracts for news articles in English and suffer from the "hallucination", i.e. the inclusion of extraneous material that is not supported by the original text. 
In this work, we propose LegalSumm, a method for summarizing legal texts in Portuguese. Our solution relies on Transformers and textual entailment is used to reduce hallucinations. To cope with long documents, we propose different chunking strategies. We compared LegalSumm to strong extractive and abstractive summarization baselines and collected the opinion of legal experts on the automatically generated summaries. The results show that LegalSumm outperforms existing summarization methods.

Premium content

Downloads

Next from PROPOR 2022

Drilling Lexico-Semantic Knowledge in Portuguese from BERT

Similar lecture

Possibility judgments may depend on assessments of similarity to known events

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES