Spain

Recent advances in language model (LM) pre-training from large- scale corpora have shown to improve various natural language processing tasks. They achieve performances comparable to non-expert humans on the GLUE benchmark for natural language understanding (NLU). While the improvement of the different contextualized representations comes from (i) the usage of more and more data, (ii) changing the types of lexical pre-training tasks or (iii) increasing the model size, NLU is more than memorizing word co-occurrences. But how much world knowledge and common sense can those language model capture? How much can those models infer from just the lexical information? To overcome this problem, some approaches include semantic information in the training process. We highlight existing approaches to combine different types of semantics with language models during the pre-training or fine-tuning phase

ECAI 2020

Enriching Language Models with Semantics

language model

natural language processing

natural language understanding

# Welcome everyone to ACL 2022!

The 60th Annual Meeting of the Association for Computational Linguistics is taking place May 22-27, 2022 as a hybrid event, in Dublin and online. We are happy to welcome all of you to this anniversary edition with an almost 50-50 in-person and virtual participation. 
The main conference program features oral presentations, in-person and virtual posters and demo sessions, a plenary session for our best paper presentations and awards, three amazing keynote events and two new initiatives of invited talks: Spotlight Talks for Young Rising Stars (STIRS) and The Next Big Idea Talks. Posters (including Findings of ACL 2022) and demos are grouped by areas for both the in-person and the virtual sessions. For the virtual component, the talks will be on Zoom and the posters and the demos will be in GatherTown. The Student Research Workshop will have an oral session and a poster session as part of Poster Session 1. The program also features eight Tutorials and 28 Workshops. 

 
We wish you a wonderful conference! 
[**The ACL 2022 Organizing Committee**](https://www.2022.aclweb.org/organisers)
 
[**Conference Handbook**](https://drive.google.com/file/d/1_BUCMfhMVrjG9E2e71aHdHeE28KSje0l/view?usp=sharing) 
[**Mini Handbook**](https://drive.google.com/file/d/1qlBKl0wzmlVF1oCeMQl3BahLd9nLP5Ce/view?usp=sharing) 
[**Posters and Demo guides**](https://drive.google.com/file/d/1UucMAoCNncIOaH1rMMDa0owuG9qgvJTG/view?usp=sharing)

ACL 2022

The Association for Computational Linguistics (ACL) is the premier international scientific and professional society for people working on computational problems involving human language, a field often referred to as either computational linguistics or natural language processing (NLP). 

poster

ECAI2020 featured a full programme of technical papers, as well as many AI-related events of interest for researchers, students and all attendants who are interested on contemporary AI, including:




**An extensive programme of workshops, tutorials, and invited speakers**

**The Prestigious Applications of Intelligent Systems conference (PAIS)**

**The Frontiers in AI track sessions**

**The Lab To Market event**

**The Women in AI time**

**The EU Challenges forum**

… and many more!

ECAI 2020 featured a full programme of technical papers, as well as many AI-related events of interest for researchers, students and all attendants who are interested on contemporary AI.

Lifted algorithms use representatives for groups of indistinguishable objects to efficiently perform inference. Standard lifted algorithms like first-order variable elimination or first-order knowledge compilation, compute answers to marginal queries of single random variables or events in a lifted way using representatives. But, queries containing a set of indistinguishable random variables may lead to groundings, something that lifting tries to avoid. This paper presents parameterised queries as a means to avoid groundings, applying the lifting idea to queries. Parameterised queries enable lifted algorithms to compute answers faster, while compactly representing queries and answers.

Lifting Queries for Lifted Inference

Agent-Based Models (ABMs) can be used to numerically simulate highly non-linear phenomena that emerge from local interactions of multiple, independent entities. ABMs are often used to understand dynamic processes such as tissue regeneration in biomedicine, in which group-level patterns and space-time constraints are of interest. High fidelity ABMs, especially those in biomedical applications, usually have a large number of parameters, creating substantial uncertainty and high dimensionality at both local and global levels. Uncertainty
 analysis (output variance estimation) and sensitivity analysis are essential steps in investigating model robustness. In addition to allocating uncertainty to each parameter, sensitivity analysis can also be used to reduce ABM dimensionality for effective model calibration and optimization. I discuss common sensitivity analysis methods that have been used to decrease the number of parameters in complex ABMs, highlighting Garg et al. (2019)’s paper, where random forests – a non-parametric ensemble algorithm – are used as a sensitivity analysis method for ranking parameters in a biomedical ABM.

Sensitivity Analysis for Dimensionality Reduction in Agent-Based Modeling

A picture is worth a thousand words”, the adage reads. However, pictures cannot replace words in terms of their ability to efficiently convey clear (mostly) unambiguous and concise knowledge. Images and text, indeed, reveal different and complementary information that, if combined, result in more information than the
 sum of that contained in the single media. The combination of visual and textual information can be obtained by linking the entities mentioned in the text with those shown in the pictures. To further integrate this with agent background knowledge, an additional step is necessary. That is, either finding the entities in the agent knowledge base that correspond to those mentioned in the text or shown in the
 picture or, extending the knowledge base with the newly discovered entities. We call this complex task Visual-Textual-Knowledge Entity Linking (VTKEL). In this paper, we precisely define the VTKEL task and present two datasets composed of 1k and 30k pictures, annotated with visual and textual entities, and linked to the YAGO ontology. Successively, we develop the first unsupervised algorithm for the solution of the VTKEL task. The evaluation of the algorithm shows promising results on both 1k and 30k VTKEL datasets.

VT-LINKER: Visual-Textual-Knowledge Entity Linker

In this paper, we present an approach for generating dialogues for characters within the context of computational narratives using personality-based features for deep neural networks. The approach integrates the requirements of both narrative genres and personality traits for the definition of character-based stylistic models. The modelling of characters’ features from existing datasets of complete stories permits the generation of personality-rich character dialogues. We present early results from an evaluation based on a sample of characters’ personality traits across different narrative genres, demonstrating variability in the resulting dialogues.

Influence of Personality-based Features for Dialogue Generation in Computational Narratives

Inter-Slice image augmentation based on fame interpolation for boosting medical image segmentation accuracy

Strong Statistical Correlation Revealed by Quantum Entanglement for Supervised Learning 

Black-box Adversarial Attacks Against Deep Learning Based Malware Binaries Detection with GAN

Explainable Inference in the FRANK Query Answering System

Algorithms are here to stay. They are transforming the way we live and work and increasingly replace cognitively human ways of making decisions. The so called “algorithmocracy” or the ecosystem that we all now inhabit, where algorithms govern many aspects of our behavior, has the potential to bias and be deployed at large scales. Because the automation of decisions by algorithms promise efficiency and resource maximization, AI technologies can be used to meet the 17 Sustainable Development Goals and its 169 targets. However, we must ensure that its application is humane and ethical and within a normative framework guided by basic ethical principles. Here, we try to clarify what people really mean by “ethics” in AI ethics and elucidate a roadmap to implement “ethics by design” standards to establish satisfactory measures of fairness, transparency and explainability of algorithms when use for social good as for example the promotion of Sustainable Development Goals

AI ethics for Sustainable Development Goals

The Artificial Intelligence (AI) revolution brings unique opportunities to help improve the life of every citizen, but also new threats. AI is transforming not only business and every aspect of our lives but also the social fabric we inhabit, including the governments and public organisations. In this Digital Transformation process, we find that many decision-makers, politicians and public servants feel lost on how to apply AI, how to benefit from data analytics and how to transform to improve not only the existing services but the administration too. In this Digital Transformation process is crucial that administrations take into consideration the ethical dimension of the use of AI in data analytics. Public administrations need a vision of how to integrate AI ethically to guarantee fair and unbiased services for the citizens. In this paper, we explore the AI Digital transformation in public services, the fAIr initiative and introduce a current application to a real case in Jalisco, Mexico. The explosion of AI technologies with connected benefits and risks are at the centre of a global discussion.

Enriching Language Models with Semantics

Downloads

Next from ECAI 2020

Lifting Queries for Lifted Inference

Similar lecture

GLM: General Language Model Pretraining with Autoregressive Blank Infilling

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES