Dominican Republic

EMNLP 2021 is planned to be a hybrid event in Punta Cana, Dominican Republic, with both on-site and fully virtual participation possible. The experience for on-site participants would closely approximate a normal pre-COVID *ACL conference, with 5-6 thematically organized parallel sessions and live Q/A and interactive discussion immediately after the talks. Presentations by virtual participants will be equitably interleaved with those of on-site participants, projected on the auditorium screens as if on-site, and also followed immediately by live Q/A and interactive discussion at a time during reasonable waking hours for the virtual presenter. For all participants, on-site and virtual, who are unable to attend a session due to either time-zone issues or because they are participating in another session live, talk recordings and slides will be available online at a minimum after the live presentation (and in many cases before as well), and questions may be submitted in advance on session-specific discussion boards and answered live in session with the usual visual aids if desired.

<iframe style="width:700px;height:400px" src="https://online.fliphtml5.com/ebtyf/ceby/"  seamless="seamless" scrolling="no" frameborder="0" allowtransparency="true" allowfullscreen="true" ></iframe>

Please Note: The EMNLP registration system is not currently connected to the underline site as we are still in the process of building out EMNLP 2021. You will receive access instructions from underline the week of November 1st. 

Access is given only to EMNLP upon registration, if you have not registered please do so [here](https://2021.emnlp.org/registration).

Registered attendees will receive access the week of November 1st.

EMNLP 2021

EMNLP 2021 is planned to be a hybrid event in Punta Cana, Dominican Republic, with both on-site and fully virtual participation possible.

Relational knowledge bases (KBs) are commonly used to represent world knowledge in machines. However, while advantageous for their high degree of precision and interpretability, KBs are usually organized according to manually-defined schemas, which limit their expressiveness and require significant human efforts to engineer and maintain. In this review, we take a natural language processing perspective to these limitations, examining how they may be addressed in part by training deep contextual language models (LMs) to internalize and express relational knowledge in more flexible forms. We propose to organize knowledge representation strategies in LMs by the level of KB supervision provided, from no KB supervision at all to entity- and relation-level supervision. Our contributions are threefold: (1) We provide a high-level, extensible taxonomy for knowledge representation in LMs; (2) Within our taxonomy, we highlight notable models, evaluation tasks, and findings, in order to provide an up-to-date review of current knowledge representation capabilities in LMs; and (3) We suggest future research directions that build upon the complementary aspects of LMs and KBs as knowledge representations.

Relational World Knowledge Representation in Contextual Language Models: A Review

technical paper

Transformer Feed-Forward Layers Are Key-Value Memories

Connecting Attributions and QA Model Behavior on Realistic Counterfactuals

Ultra-High Dimensional Sparse Representations with Binarization for Efficient Text Retrieval

IR like a SIR: Sense-enhanced Information Retrieval for Multiple Languages

Neural Attention-Aware Hierarchical Topic Model

Discretized Integrated Gradients for Explaining Language Models

SciBERT-based Multitasking Deep Neural Architecture to identify Contribution Statements from Scientific articles

Characterizing Test Anxiety on Social Media

Sample Selection Guided by Domain and Task for Cross-Domain Targeted Sentiment Analysis

Bengali Parallel Universal Dependency Treebank

poster

workshop paper

https://d3smihljt9218e.cloudfront.net/transcript/24119/subtitle/d655978cbb77b0371c173ca5b67d3d29.vtt

English (automatic)

Relational World Knowledge Representation in Contextual Language Models: A Review

Downloads

Next from EMNLP 2021

Transformer Feed-Forward Layers Are Key-Value Memories

Similar lecture

Block Pruning For Faster Transformers