Reinforcement learning under partial observability poses two types of conceptually orthogonal learning challenges; learning a useful representation
of the observable past, and selecting actions based on that representation. While the latter is common to both fully and partially observable control
problems, the former is idiomatic to the partially observable case. Traditional reinforcement learning relies exclusively on the reward signal to train the
representation model, but rewards constitute a weak learning signal in partially observable settings. To help train richer representations, we discuss
and propose an auxiliary self-supervised learning task designed to help the primary reinforcement learning task. We further propose two training schemes
for training with auxiliary tasks, one inspired by the idea of promoting complementary representations. Empirical evaluations show that agents which
exploit auxiliary tasks and complementary representations learn better policies, and converge faster, compared to agents which use common reactive and
recurrent representations trained on the rewards alone.

Learning Complementary Representations of the Past using Auxiliary Tasks in Partially Observable Reinforcement Learning

Learning and Adaptation

technical paper

AAMAS is the leading scientific conference for research in autonomous agents and multi-agent systems. The AAMAS conference series was initiated in 2002 as the merging of three respected scientific meetings: the International Conference on Multi-Agent Systems (ICMAS), the International Workshop on Agent Theories, Architectures, and Languages (ATAL), and the International Conference on Autonomous Agents (AA). The aim of the joint conference is to provide a single, high-profile, internationally-respected archival forum for scientific research in the theory and practice of autonomous agents and multi-agent systems.

Browse keynotes, discussions, panels and over 300 presentations.


AAMAS 2020

AAMAS is the leading scientific conference for research in autonomous agents and multi-agent systems. The AAMAS conference series was initiated in 2002 as the merging of three respected scientific meetings: the International Conference on Multi-Agent Systems (ICMAS), the International Workshop on Agent Theories, Architectures, and Languages (ATAL), and the International Conference on Autonomous Agents (AA). 

Andrea Baisero

1

1

SHORT BIO

Presentations

Learning Complementary Representations of the Past using Auxiliary Tasks in Partially Observable Reinforcement Learning

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES