United States

Transferring knowledge among various environments is important for efficiently learning multiple tasks online. Most existing methods directly use the previously learned models or previously learned optimal policies to learn new tasks. However, these methods may be inefficient when the underlying models or optimal policies are substantially different across tasks. In this paper, we propose Template Learning (TempLe), a PAC-MDP method for multi-task reinforcement learning that could be applied to tasks with varying state/action space without prior knowledge of inter-task mappings. TempLe gains sample efficiency by extracting similarities of the transition dynamics across tasks even when their underlying models or optimal policies have limited commonalities. We present two algorithms for an ``online&#39;&#39; and a ``finite-model&#39;&#39; setting respectively. We prove that our proposed TempLe algorithms achieve much lower sample complexity than single-task learners or state-of-the-art multi-task methods. We show via systematically designed experiments that our TempLe method universally outperforms the state-of-the-art multi-task methods (PAC-MDP or not) in various settings and regimes.

AAAI 2021

TempLe: Learning Template of Transitions for Sample Efficient Multi-Task RL

Truth and Responsibility
“Truth and Responsibility” is a call to reimagine anthropology to meet the demands of the present moment. The imperative to bear witness, take action, and be held accountable to the truths we write and circulate invites us to reflect on our responsibility in reckoning with disciplinary histories, harms, and possibilities. To whom are we giving evidence and toward what ends? For whom are we writing? To whom are we accountable, and in what ways? We are thrilled to announce the theme of the 2021 AAA Annual Meeting to be held in Baltimore, MD: Truth and Responsibility.

Many consider anthropology to be a holistic social science dedicated to cross-cultural understanding as a way to reduce bigotry and more fully comprehend “what it means to be human.” Others push against this readily circulated origin story, arguing that “human” remains a highly contested, political category—evident as the presumed set of rights and protections associated with the “human” continue to be stripped away violently in the communities in which some of us live and work. Which violent histories and epistemologies must anthropologists take responsibility for in telling truth(s) about the discipline’s development? How do the dual histories of settler colonialism and slavery continue to influence anthropological thought and practices? In these political times, how can anthropologists throughout the globe work to secure a capacious, progressive vision of the human? How might movements for anti-racism, decoloniality, queer liberation, and healing such as #BlackLivesMatter, #ProtectMaunaKea, and #MeToo push a future anthropology out of the ashes of the anthropological past? Finally, what are the limits and possibilities of the anthropological imagination?

Across subfields, we find truths in patterns of human behavior, language, evolution, and cultural worlds. Industry-positioned anthropologists do this by extending the boundaries of the discipline not as an administrative solution to job shortages but as a source of intervention and knowledge production. Increasingly, anthropologists who make use of the scientific method question how status and identity help to decide which facts come to represent truth. How might quantitative researchers use our methods to identify patterned truths, and what responsibility do we hold in challenging conventional wisdom about these patterns? What responsibility do we have to both our colleagues and larger publics, to push toward increased transparency and ethical grounding in our data collection, analysis, and presentation?

Pedagogy is a key medium for the communication of anthropological truths. Which (and whose) truths are foregrounded in our curricula? What are the possibilities for a liberatory pedagogy in a precarious, “post-truth” era? Conferences, museums, organizing spaces, and classrooms are sites where pedagogy and various forms of communication can help us interrogate the performativity of truth. How might anthropologists conceive of truth performances? Might visual, aural, and choreographic performances during AAA sessions offer anthropologists alternative genres for truth-telling and truth-making that provoke discussions about responsibility?

In accordance with the urgency of the year’s theme, the questions posed in this call for papers do not have easy answers. The hope is that those who submit proposals will take up these questions and engage in collective thinking and imagining about the truths we hold, the truths we challenge, and the responsibilities we bear in co-creating a free and more equitable world. All panel proposals should have a statement about how the panel has incorporated the goals of equity, diversity, and inclusion, and/or analysis of power.

Executive Session proposals have already been selected and speak directly to the theme “Truth and Responsibility.” To practice the critical reflexivity this call for papers invites, we asked that Executive Session submissions explicitly address the diversity of session participants, such as organizational/institutional affiliation, career stage, race, ethnicity, disability, sexuality, class, religion, national identity, and gender. Proposals for Executive Sessions that demonstrated a commitment to equity and inclusion and/or a clear analysis of power (i.e. anti-imperialist, anti-white supremacist, decolonial, anti-ableist, feminist, anti-transphobic, anti-xenophobic, etc) were given priority. We are excited to be in conversation with residents of the Baltimore region and look forward to the discussions, performances, and actions generated by the dynamic group of anthropologists attending the 2021 AAA Annual Meeting.

AAA Annual Meeting 2021

“Truth and Responsibility” is a call to reimagine anthropology to meet the demands of the present moment. The imperative to bear witness, take action, and be held accountable to the truths we write and circulate invites us to reflect on our responsibility in reckoning with disciplinary histories, harms, and possibilities. To whom are we giving evidence and toward what ends? For whom are we writing? To whom are we accountable, and in what ways? We are thrilled to announce the theme of the 2021 AAA Annual Meeting to be held in Baltimore, MD: Truth and Responsibility.

Transferring knowledge among various environments is important for efficiently learning multiple tasks online. Most existing methods directly use the previously learned models or previously learned optimal policies to learn new tasks. However, these methods may be inefficient when the underlying models or optimal policies are substantially different across tasks. In this paper, we propose Template Learning (TempLe), a PAC-MDP method for multi-task reinforcement learning that could be applied to tasks with varying state/action space without prior knowledge of inter-task mappings. TempLe gains sample efficiency by extracting similarities of the transition dynamics across tasks even when their underlying models or optimal policies have limited commonalities. We present two algorithms for an ``online'' and a ``finite-model'' setting respectively. We prove that our proposed TempLe algorithms achieve much lower sample complexity than single-task learners or state-of-the-art multi-task methods. We show via systematically designed experiments that our TempLe method universally outperforms the state-of-the-art multi-task methods (PAC-MDP or not) in various settings and regimes.

technical paper

The purpose of the AAAI conference is to promote research in artificial intelligence (AI) and scientific exchange among AI researchers, practitioners, scientists, and engineers in affiliated disciplines. 

Recent advances in Deep Gaussian Processes (DGPs) show the potential to have more expressive representation than that of traditional Gaussian Processes (GPs). However, there exists a pathology of deep Gaussian processes that their learning capacities reduce significantly when the number of layers increases. In this paper, we present a new analysis in DGPs by studying its corresponding nonlinear dynamic systems to explain the issue. Existing work reports the pathology for the squared exponential kernel function. We extend our investigation to four types of common stationary kernel functions. The recurrence relations between layers are analytically derived, providing a tighter bound and the rate of convergence of the dynamic systems. We demonstrate our finding with a number of experimental results.

Characterizing Deep Gaussian Processes via Nonlinear Recurrence Systems

Cross-lingual models trained on source language tasks possess the capability to directly transfer to target languages. However, since word order variances generally exist in different languages, cross-lingual models that overfit into the word order of the source language could have sub-optimal performance in target languages. In this paper, we hypothesize that reducing the word order information fitted into the models can improve the adaptation performance in target languages. To verify this hypothesis, we introduce several methods to make models encode less word order information of the source language and test them based on cross-lingual word embeddings and the pre-trained multilingual model. Experimental results on three sequence labeling tasks (i.e., part-of-speech tagging, named entity recognition and slot filling tasks) show that reducing word order information injected into the model can achieve better zero-shot cross-lingual performance. Further analysis illustrates that fitting excessive or insufficient word order information into the model results in inferior cross-lingual performance. Moreover, our proposed methods can also be applied to strong cross-lingual models and further improve their performance.

On the Importance of Word Order Information in Cross-Lingual Sequence Labeling

Recognizing humor from a video utterance requires understanding the verbal and non-verbal components as well as incorporating the appropriate context and external knowledge. In this paper, we propose Humor Knowledge enriched Transformer (HKT) that can capture the gist of a multimodal humorous expression by integrating the preceding context and external knowledge. We incorporate humor centric external knowledge into the model by capturing the ambiguity and sentiment present in the language. We encode all the language, acoustic, vision, and humor centric features separately using Transformer based encoders, followed by a cross attention layer to exchange information among them. Our model achieves 77.36% and 79.41% accuracy in humorous punchline detection on UR-FUNNY and MUStaRD datasets -- achieving a new state-of-the-art on both datasets with the margin of 4.93% and 2.94% respectively. Furthermore, we demonstrate that our model can capture interpretable, humor-inducing patterns from all modalities.

Humor Knowledge Enriched Transformer for Understanding Multimodal Humor

In this paper, we first study the problem of combinatorial pure exploration with full-bandit feedback (CPE-BL), where a learner is given a combinatorial action space X \subseteq {0,1}^d, and in each round the learner pulls an action x \in X and receives a random reward with expectation x^T \theta, with \theta \in \R^d a latent and unknown environment vector. 
The objective is to identify the optimal action with the highest expected reward, using as few samples as possible. For CPE-BL, we design the first polynomial-time adaptive algorithm, whose sample complexity matches the lower bound (within a logarithmic factor) for a family of instances and has a light dependence of \Delta_min (the smallest gap between the optimal action and sub-optimal actions). Furthermore, we propose a novel generalization of CPE-BL with  flexible feedback structures, called combinatorial pure exploration with partial linear feedback (CPE-PL), which encompasses several families of sub-problems including full-bandit feedback, semi-bandit feedback, partial feedback and nonlinear reward functions. In CPE-PL, each pull of action x reports a random feedback vector with expectation of M_x \theta , where M_x \in R^{m_x \times d} is a transformation matrix for x, and gains a random (possibly nonlinear) reward related to x.  For CPE-PL, we develop the first polynomial-time algorithm, which simultaneously addresses limited feedback, general reward function and combinatorial action space (e.g., matroids, matchings and s-t paths), and provide its sample complexity analysis. Our empirical evaluation demonstrates that our algorithms run orders of magnitude faster than the existing ones, and our CPE-BL algorithm is robust across different \Delta_min settings while our CPE-PL algorithm is the first one returning correct answers for nonlinear reward functions.

Combinatorial Pure Exploration with Full-Bandit or Partial Linear Feedback

Denoising is the essential step for distant supervision based named entity recognition. Previous denoising methods are mostly based on instance-level confidence statistics, which ignore the variety of the underlying noise distribution on different datasets and entity types. This makes them difficult to be adapted to high noise rate settings. In this paper, we propose Hypergeometric Learning (HGL), a denoising algorithm for distantly supervised NER that takes both noise distribution and instance-level confidence into consideration. Specifically, during neural network training, we naturally model the noise samples in each batch following a hypergeometric distribution parameterized by the noise-rate. Then each instance in the batch is regarded as either correct or noisy one according to its label confidence derived from previous training step, as well as the noise distribution in this sampled batch. Experiments show that HGL can effectively denoise the weakly-labeled data retrieved from distant supervision, and therefore results in significant improvements on the trained models.

Denoising Distantly Supervised Named Entity Recognition via a Hypergeometric Probabilistic Model

The success of emotional conversation systems depends on sufficient perception and appropriate expression of emotions. In a real-world conversation, we firstly instinctively perceive emotions from multi-source information, including the emotion flow of dialogue history, facial expressions, and personalities of speakers, and then express suitable emotions according to our personalities, but these multiple types of information are insufficiently exploited in emotional conversation fields. To address this issue, we propose a heterogeneous graph-based model for emotional conversation generation. Specifically, we design a Heterogeneous Graph-Based Encoder to represent the conversation content (i.e., the dialogue history, its emotion flow, facial expressions, and speakers' personalities) with a heterogeneous graph neural network, and then predict suitable emotions for feedback. After that, we employ an Emotion-Personality-Aware Decoder to generate a response not only relevant to the conversation context but also with appropriate emotions, by taking the encoded graph representations, the predicted emotions from the encoder and the personality of the current speaker as inputs. Experimental results show that our model can effectively perceive emotions from multi-source knowledge and generate a satisfactory response, which significantly outperforms previous state-of-the-art models.

Infusing Multi-Source Knowledge with Heterogeneous Graph Neural Network for Emotional Conversation Generation

Influence diagrams provide a modeling and inference framework for sequential decision problems, representing the probabilistic knowledge by a Bayesian network and the preferences of an agent by utility functions over the random variables and decision variables. Computing the maximum expected utility (MEU) and the optimizing policy is exponential in the constrained induced width and therefore is notoriously difficult for larger models. In this paper, we develop a new bounding scheme for MEU that applies partitioning based approximations on top of the decomposition scheme called a multi-operator cluster DAG for influence diagrams that is more sensitive to the underlying structure of the model than the classical join-tree decomposition of influence diagrams. Our bounding scheme utilizes a cost-shifting mechanism to tighten the bound further. We demonstrate the effectiveness of the proposed scheme on various hard benchmarks.

A New Bounding Scheme for Influence Diagrams

AutoML automatically selects, composes and parameterizes machine learning algorithms into a workflow or pipeline of operations that aims at maximizing performance on a given dataset. Although current methods for AutoML achieved impressive results they mostly concentrate on optimizing fixed linear workflows. In this paper, we take a different approach and focus on generating and optimizing pipelines of complex directed acyclic graph shapes. These complex pipeline structure may lead to discovering hidden features and thus boost performance considerably. We explore the power of heuristic search and context-free grammars to search and optimize these kinds of pipelines. Experiments on various benchmark datasets show that our approach is highly competitive and often outperforms existing AutoML systems.

Searching for Machine Learning Pipelines Using a Context-Free Grammar

Existing datasets for training pedestrian detectors in images suffer from limited appearance and pose variation. The most challenging scenarios are rarely included because they are too difficult to capture due to safety reasons, or they are very unlikely to happen. The strict safety requirements in assisted and autonomous driving applications call for an extra high detection accuracy also in these rare situations. Having the ability to generate people images in arbitrary poses, with arbitrary appearances and embedded in different background scenes with varying illumination and weather conditions, is a crucial component for the development and testing of such applications.
The contributions of this paper are three-fold.
First, we describe an augmentation method for the controlled synthesis of urban scenes containing people, thus producing rare or never-seen situations. This is achieved with a data generator (called DummyNet) with disentangled control of the pose, the appearance, and the target background scene.
Second, the proposed generator relies on novel network architecture and associated loss that takes into account the segmentation of the foreground person and its composition into the background scene.
Finally, we demonstrate that the data generated by our DummyNet improve the performance of several existing person detectors across various datasets as well as in challenging situations, such as night-time conditions, where only a limited amount of training data is available. 
In the setup with only day-time data available, we improve the night-time detector by 17% log-average miss rate over the detector trained with the day-time data only.

Artificial Dummies for Urban Dataset Augmentation

Explaining the predictions of neural black-box models is an important problem, especially when such models are used in applications where user trust is crucial. Estimating the influence of training examples on a learned neural model's behavior allows us to identify training examples most responsible for a given prediction and, therefore, to faithfully explain the output of a black-box model. The most generally applicable existing method is based on influence functions, which scale poorly for larger sample sizes and models.  

We propose gradient rollback, a general approach for influence estimation, applicable to neural models where each parameter update step during gradient descent touches a smaller number of parameters, even if the overall number of parameters is large. Neural matrix factorization models trained with gradient descent are part of this model class. These models are popular and have found a wide range of applications in industry. Especially knowledge graph embedding methods, which belong to this class, are used extensively. We show that gradient rollback is highly efficient at both training and test time. Moreover, we show theoretically that the difference between gradient rollback's influence approximation and the true influence on a model's behavior is smaller than known bounds on the stability of stochastic gradient descent. This establishes that gradient rollback is robustly estimating example influence. We also conduct experiments which show that gradient rollback provides faithful explanations for knowledge base completion and recommender datasets. An implementation and an appendix are available.

Downloads

Next from AAAI 2021

Characterizing Deep Gaussian Processes via Nonlinear Recurrence Systems

Similar lecture

Temple-Stay in South Korea: A Wellness Journey amid a Happiness Crisis

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES

.css-70qvj9{display:-webkit-box;display:-webkit-flex;display:-ms-flexbox;display:flex;-webkit-align-items:center;-webkit-box-align:center;-ms-flex-align:center;align-items:center;}Downloads

Next from AAAI 2021

Characterizing Deep Gaussian Processes via Nonlinear Recurrence Systems

Similar lecture

Temple-Stay in South Korea: A Wellness Journey amid a Happiness Crisis

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES

Downloads