Brazil

Determining the author’s intent in a social media post is a challeng-ing multimodal task and requires identifying complex relationshipsbetween image and text in the post. For example, the post imagecan represent an object, person, product, or company, while thetext can be an ironic message about the image content. Similarly, atext can be a news headline, while the image represents a provoca-tion, meme, or satire about the news. Existing approaches proposeintent classification techniques combining both modalities. How-ever, some posts may have missing textual annotations. Hence, weinvestigate a graph-based approach that propagates available textembedding data from complete multimodal posts to incompleteones. This paper presents a text embedding propagation method,which transfers embeddings from BERT neural language modelsto image-only posts (i.e., posts with incomplete modality) consid-ering the topology of a graph constructed from both visual andtextual modalities available during the training step. By using thisinference approach, our method provides competitive results whentextual modality is available at different completeness levels, evencompared to reference methods that require complete modalities.

WebMedia 2021

Multimodal intent classification with incomplete modalities using text embedding propagation

network embedding

social networks

multimodal learning

The 9th Brazilian Conference on Intelligent Systems (BRACIS), the 16h Encontro Nacional de Inteligência Artificial e Computacional (ENIAC), and the 12th Concurso de Teses e Dissertações em Inteligência Artificial e Computacional (CTDIAC) was held from 20 to 23 October, 2020.

BRACIS originated from the combination of the two most important scientific events in Brazil in Artificial Intelligence (AI) and Computational Intelligence (CI): the Brazilian Symposium on Artificial Intelligence - SBIA (22 editions), and the Brazilian Symposium on Neural Networks - SBRN (13 editions). ENIAC is a national forum for researchers, practitioners, educators and students to present and discuss innovations, trends, experiences, developments and work in progress in the fields of Artificial and Computational Intelligence. CTDIAC is a satellite event whose goals are to disseminate and award the best dissertations and theses (MSc and PhDs concluded in Brazilian universities from June 2018 to May 2020) in Artificial and Computational Intelligence areas.

In this year, the Symposium on Knowledge Discovery, Mining and Learning (KDMiLe) will be held in conjunction with BRACIS 2020. This sysposium aims at integrating researchers, practitioners, developers, students and users to present their research results, to discuss ideas, and to exchange techniques, tools, and practical experiences – related to the Data Mining and Machine Learning areas.

BRACIS 2020

technical paper

### Welcome to the Brazilian Symposium on Multimedia Systems and Web 
Promoted annually by the Brazilian Computer Society (SBC), the Brazilian Symposium on Multimedia Systems and Web (WebMedia) is the main event on the subject in Brazil and an excellent opportunity for scientific and technical exchanges between students, researchers and professionals in the areas of Multimedia, Hypermedia and Web. This year, we will be celebrating the 27th edition of WebMedia, to be held from **November 5th to 12th, 2021**, organized by the Federal University of Minas Gerais and Federal University of São João Del Rei. For the second time in its history, the event will be held online, with interaction between the participants being done through tools and web platforms.
 <iframe width="560" height="315" src="https://www.youtube.com/embed/2GvWKRUDtAY" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowfullscreen></iframe> 
The Webmedia 2021 schedule will feature:
 
* Technical sessions for the presentation of scientific articles.
* National and international lectures
* Panel with Companies
* Workshops
* Short courses
* Project meetings open to the community
 

The topics of interest for paper submission are:
 
* Web and Social Networks
* Multimedia
* Digital TV, Ubiquitous and Mobile Computing
 

In addition to the main track, WebMedia 2021 will feature the Tools and Applications Workshop, the Scientific Initiation Papers Contest, the Theses and Dissertations Contest, the RNP CT-Video Workshop.
 
The organization of WebMedia 2021 is under the responsibility of the [Department of Computer Science at UFMG (DCC/UFMG)](http://dcc.ufmg.br/) and [Department of Computer Science at UFSJ (DCOMP/UFSJ)](https://dcomp.ufsj.edu.br/)
 
**#PartiuWebMedia2021 #WebMedia2021**

The Brazilian Symposium on Multimedia Systems and Web (WebMedia) is the main event on the subject in Brazil and an excellent opportunity for scientific and technical exchanges between students, researchers and professionals in the areas of Multimedia, Hypermedia and Web.

Towards a Pragmatic Interoperability on the MIDAS Middleware

The IoT's widely distributed nature has promoted demands for Over-The-Air (OTA) upgrading of embedded systems. This paper presents the conception of a new approach, called iOTA, which meets the security requirements of the SUIT specification of the Internet Engineering Task Force (IETF). The partial evaluation of the proposal points to the continuation of the research and showed that iOTA stands out in terms of security in relation to the other approaches proposed by the literature, offering protection against attacks to which a remote update of an embedded system is usually exposed.

iOTA: An Approach to Secure Over-The-Air Updates on the Internet of Things Scenario

In smart city scenarios, a plethora of data is generated from multiple, decentralized sources, e.g., systems, applications, citizen devices, sensors, etc. However, these data may be not readily available for use due to the high heterogeneity of types, formats, and protocols, thereby giving rise to vertical silos that hamper sharing, integrating, and exploiting these data. This paper introduces Aquedücte, a data integration service for smart cities. Aquedücte offers functionalities for (i) handling data from heterogeneous sources such as files, Web services, systems, etc., (ii) converting these data to a common protocol, and (iii) making them further available to platforms aimed to support the development of smart city applications.

Aquedücte: A Data Integration Service for Smart Cities

Aprendizado de máquina para precaching de conteúdo

Em 2012, 56% das crianças entre 10 e 13 tinham um smartphone, atualmente, uma grande quantidade de dados são compartilhados a cada minuto na internet, inclusive em chats, isso acentua a necessidade de métodos automatizados de moderação de contaúdo. Esse trabalho propôe uma abordagem para controle parental tendo em mente a privacidade dos protegidos enquanto utiliza métodos com deep learning para detectar conteúdo sensível automaticamente.

Should I See or Should I Go?: Automatic Detection of Sensitive Media in Messaging Apps

Fake news can rapidly spread through internet users. Approaches proposed in the literature for content classification usually learn models considering textual and contextual features from real and fake news to minimize the spread of disinformation. One of the prominent approaches to detect fake news is One-Class Learning (OCL), as it minimizes the data labeling effort, requiring only the labeling of fake news documents. The performance of these algorithms depends on the structured representation of the documents used in the learning process. Generally, a textual-based unimodal representation is used, such as bag-of-words or representations based on linguistic categories. We propose MVAE-FakeNews, a multimodal representation method to detect fake news in OCL. The proposed approach uses a Multimodal Variational Autoencoder, learns a new representation from the combination of two modalities considered promising for fake news detection: text embeddings and topic information. In the experiments, we used three datasets considering Portuguese and English languages. Results show that the MVAE-FakeNews obtained a better F1-Score for the class of interest, outperforming another nine methods in ten of twelve evaluated scenarios. MVAE-FakeNews presented a better average ranking and statistical difference from other representation models. The proposed method proved to be promising to represent the texts in the OCL scenario to detect fake news.

Learning Textual Representations from Multiple Modalities to Detect Fake News Through One-Class Learning

The dissemination of news through digital media has amplified Fake News proliferation. In the face of this scenario, sentiment-based methods have presented promising results in Fake News detection. Although sentiment-based methods can extract sentiment (i.e., po- larity and/or emotion) from either texts or images available in news, the ones applied to Portuguese-written news have considered sen- timent exclusively extracted from texts. Thus, this study proposes a multimodal method that, besides the polarity and emotions ex- tracted from texts, also considers sentiment extracted from news’ images in order to detect Fake News written in Portuguese. The proposed method showed promising results in experimental data, overcoming the baseline methods in 8 p.p.

A Sentiment-Based Multimodal Method to Detect Fake News

A crucial task to overall video understanding is the recognition and localisation in time of different actions or events that are present along the scenes. To address this problem, action segmentation must be achieved. Action segmentation consists of temporally segmenting a video by labeling each frame with a specific action. In this work, we propose a novel action segmentation method that requires no prior video analysis and no annotated data. Our method involves extracting spatio-temporal features from videos using a pre-trained deep network. Data is then transformed using a positional encoder and finally a clustering algorithm is applied with the use of a silhouette score to find the optimal number of clusters where each cluster presumably corresponds to a different single and distinguishable action. In experiments, we show that our method produces competitive results on Breakfast and Inria Instructional Videos dataset benchmarks.

A Cluster-Based Method for Action Segmentation Using Spatio-Temporal and Positional Encoded Embeddings

Human pose estimation is an important field of Computer Vision that aims to predict poses of individuals from videos and images. It has been used in many different areas including human-computer interaction, motion analysis, surveillance, action prediction, action correction, augmented reality, virtual reality, and healthcare. This review is focused on the most significant contributions in human pose estimation for training assistance. Executing movements correctly is crucial in all kinds of physical activities, both to increase performance and reduce risk of injury. Human pose estimation is poised to help athletes better analyse the quality of their movements. 
The systematic review study was conducted in five databases including articles from January 2011 to March 2021. The initial search resulted in 129 articles, of which 8 were selected after applying the filtering criteria. Moreover this study presents the challenges related to pose estimation, which pose estimation methods have been used in recent years, in which specific activities the selected articles have focused on, and a taxonomy of human pose estimation methods.

Human Pose Estimation for Training Assistance: a Systematic Literature Review

Proposição de uma base de dados e um método de reconstrução de áudios temporalmente degradados.

Multimodal intent classification with incomplete modalities using text embedding propagation

Downloads

Next from WebMedia 2021

Towards a Pragmatic Interoperability on the MIDAS Middleware

Similar lecture

Quantifying Temporal Novelty in Social Networks using Time-Varying Graphs and Concept Drift Detection

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES

Multimodal intent classification with incomplete modalities using text embedding propagation

.css-70qvj9{display:-webkit-box;display:-webkit-flex;display:-ms-flexbox;display:flex;-webkit-align-items:center;-webkit-box-align:center;-ms-flex-align:center;align-items:center;}Downloads

Next from WebMedia 2021

Towards a Pragmatic Interoperability on the MIDAS Middleware

Similar lecture

Quantifying Temporal Novelty in Social Networks using Time-Varying Graphs and Concept Drift Detection

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES

Downloads