New Zealand


Reinforcement learning (RL) in partially observable, fully cooperative multi-agent settings (Dec-POMDPs) can in principle be used to address many real-world challenges such as controlling a swarm of rescue robots or a synchronous team of quadcopters. However, Dec-POMDPs are significantly harder to solve than single-agent problems, with the former being NEXP-complete and the latter, MDPs, being just P-complete. Hence, current RL algorithms for Dec-POMDPs suffer from poor sample complexity, thereby reducing their applicability to practical problems where environment interaction is costly. Our key insight is that using just a polynomial number of samples, one can learn a centralized model that generalizes across different policies. We can then optimize the policy within the learned model instead of the true system, reducing the number of environment interactions. We also learn a centralized exploration policy within our model that learns to collect additional data in state-action regions with high model uncertainty. We empirically evaluate the proposed model-based algorithm, MARCO, in three cooperative communication tasks, where it improves sample efficiency by up to 20x. Finally, to investigate the theoretical sample complexity, we propose a tabular model-based method for Dec-POMDPs and show that it achieves sample complexity in polynomial samples.

AAMAS 2022

Centralized Model and Exploration Policy for Multi-Agent RL

dec-pomdps

cooperative multi-agent reinforcement learning

model-based

We are pleased to announce the Fortieth AAAI Conference on Artificial Intelligence (AAAI-26), which will be held in Singapore EXPO from January 20 to January 27, 2026.

The purpose of the AAAI conference series is to promote research in Artificial Intelligence (AI) and foster scientific exchange between researchers, practitioners, scientists, students, and engineers across the entirety of AI and its affiliated disciplines. AAAI-26 will feature technical paper presentations, special tracks, invited speakers, workshops, tutorials, poster sessions, senior member presentations, competitions, and exhibit programs, and a range of other activities to be announced.

To access this event page, you need to log in with the **email address you registered with**. Access credentials will be sent to your email from Underline - subject line "Welcome to AAAI 2026". Please be sure to check your spam email folder if you do not see an email confirmation right away.

Please log in

To access this event page, you are required to register.
Please complete your registration to continue.

We recommend reading [**the registration information**](https://aaai.org/conference/aaai/aaai-26/registration/) first.

**Online Registration Form**: https://aaai.getregistered.net/conference-2026 

Registration Required

AAAI 2026

We are pleased to announce the Fortieth AAAI Conference on Artificial Intelligence (AAAI-26), which will be held in Singapore EXPO from January 20 to January 27, 2026.

technical paper

AAMAS (International Conference on Autonomous Agents and Multiagent Systems) is the largest and most influential conference in the area of agents and multiagent systems. The aim of the conference is to bring together researchers and practitioners in all areas of agent technology and to provide a single, high-profile, internationally renowned forum for research in the theory and practice of autonomous agents and multiagent systems. AAMAS is the flagship conference of the non-profit International Foundation for Autonomous Agents and Multiagent Systems (IFAAMAS).

The AAMAS conference series was initiated in 2002 in Bologna, Italy as a joint event comprising the 6th International Conference on Autonomous Agents (AA), the 5th International Conference on Multiagent Systems (ICMAS), and the 9th International Workshop on Agent Theories, Architectures, and Languages (ATAL).

Subsequent AAMAS conferences have been held in Melbourne, Australia (July 2003), New York City, NY, USA (July 2004), Utrecht, The Netherlands (July 2005), Hakodate, Japan (May 2006), Honolulu, Hawaii, USA (May 2007), Estoril, Portugal (May 2008), Budapest, Hungary (May 2009), Toronto, Canada (May 2010), Taipei, Taiwan (May 2011), Valencia, Spain (June 2012), Minnesota, USA (May 2013), Paris, France (May 2014), Istanbul, Turkey (May 2015), Singapore (May 2016), São Paulo (2017) and Stockholm, Sweden (2018), Montreal (May 2019), Auckland (May 2020, Virtual), London (May 2021, Virtual).

A ticket is required to attend this event, please register using the link below:

https://aamas2022-conference.auckland.ac.nz/attending/registration/

Registration Is Required

AAMAS (International Conference on Autonomous Agents and Multiagent Systems) is the largest and most influential conference in the area of agents and multiagent systems. The aim of the conference is to bring together researchers and practitioners in all areas of agent technology and to provide a single, high-profile, internationally renowned forum for research in the theory and practice of autonomous agents and multiagent systems. AAMAS is the flagship conference of the non-profit International Foundation for Autonomous Agents and Multiagent Systems (IFAAMAS).


We propose a novel formulation of group fairness in the contextual multi-armed bandit (CMAB) setting. In the CMAB setting a sequential decision maker must at each time step choose an arm to pull from a finite set of arms after observing some context for each of the potential arm pulls. In our model arms are partitioned into two or more sensitive groups based on some protected feature (e.g., age, race, or socio-economic status). Despite the fact that there may be differences in expected payout between the groups, we may wish to ensure some form of fairness between picking arms from the various groups. In this work we explore two definitions of fairness: equal group probability, wherein the probability of pulling an arm from any of the protected groups is the same; and proportional parity, wherein the probability of choosing an arm from a particular group is proportional to the size of that group. We provide a novel algorithm that can accommodate these notions of fairness for an arbitrary number of groups, and provide bounds on the regret for our algorithm. We then validate our algorithm using synthetic data as well as two real-world datasets for intervention settings wherein we want to allocate resources fairly across protected groups.

Group fairness in bandit arm selection


Autonomous agents may encounter the transportability problem when they suffer performance deficits from training in an environment that differs in key respects from that in which they are deployed. Although a causal treatment of transportability has been studied in the data sciences, the present work expands its utility into online, multi-agent, reinforcement learning systems in which agents are capable of both experimenting within their own environments and observing the choices of agents in separate, potentially different ones. In order to accelerate learning, agents in these MAT problems face the unique challenge of determining which agents are acting in similar environments, and if so, how to incorporate these observations into their policy. We propose and compare several agent policies that exploit local similarities between environments using causal selection diagrams, demonstrating that optimal policies are learned more quickly than in baseline agents that do not. Simulation results support the efficacy of these new agents in a novel variant of the Multi-Armed Bandit problem with MAT environments.

Exploiting Causal Structure for Transportability in Online, Multi-Agent Environments



In kidney exchange programs, multiple patient-donor pairs each
of whom are otherwise incompatible, exchange their donors to
receive compatible kidneys. The Kidney Exchange problem is
typically modelled as a directed graph where every vertex is either
an altruistic donor or a pair of patient and donor; directed edges are
added from a donor to its compatible patients. The computational
task is to find if there exists a collection of disjoint cycles and paths
starting from altruistic donor vertices of length at most ℓ_𝑐 and ℓ_𝑝
respectively that covers at least some specific number 𝑡 of nonaltruistic vertices (patients). We study parameterized algorithms for
the kidney exchange problem in this paper. Specifically, we design
FPT algorithms parameterized by each of the following parameters:
(1) the number of patients who receive kidney, (2) treewidth of the
input graph + max{ℓ_𝑝, ℓ_𝑐 }, and (3) the number of vertex types in the
input graph when ℓ_𝑝 ≤ ℓ_𝑐 . We also present interesting algorithmic
and hardness results on the kernelization complexity of the problem.
Finally, we present an approximation algorithm for an important
special case of Kidney Exchange.

Parameterized Algorithms for Kidney Exchange

**Read paper on the following link:**

https://ifaamas.org/Proceedings/aamas2022/pdfs/p1563.pdf

**Abstract:**



Optimal Local Bayesian Differential Privacy over Markov Chains


In MARL, communication among agents is essential to establish cooperation. Over the realistic wireless network, many factors can affect transmission reliability, especially considering that the wireless network condition varies with agents’ mobility. We propose a framework that improves the intelligence of communication over realistic wireless networks in two fundamental aspects: (1) When: Agents learn the timing of communication based on message importance and wireless channel condition. We further propose a communication lagging technique to make the training end-to-end differentiable. (2) What: Agents augment message contents with
wireless network measurements. The messages improve both the game and communication actions of the agents. Experiments on a standard environment show that compared with state-of-the-art, our framework enables more intelligent collaboration and thus achieves significantly better game performance, convergence speed and communication efficiency.

Intelligent Communication over Realistic Wireless Networks in Multi-Agent Cooperative Games

Federated learning (FL) allows distributed clients to collaboratively train a global model without sharing their private data. We propose a novel FL algorithm, which can accurately evaluate the contributions of clients and aggregate global model in a more efficient manner. More specifically, we propose to use a Deep Reinforcement Learning (DRL) method to dynamically learn the contributions of clients in each communication round. Based on this, we adaptively assign appropriate weights to clients, which will be used in global model aggregation. By improving the process of global mode aggregation, our proposed scheme greatly improves the performance of federated learning.

Adaptive Aggregation Weight Assignment for Federated Learning: A Deep Reinforcement Learning Approach


PointGoal navigation has seen significant recent interest and progress,
spurred on by the Habitat platform and associated challenge.
In this paper, we study PointGoal navigation under both a sample
budget (75 million frames) and a compute budget (1 GPU for 1 day).
We conduct an extensive set of experiments, cumulatively totaling
over 50,000 GPU-hours, that let us identify and discuss a number of
ostensibly minor but significant design choices – the advantage esti-
mation procedure (a key component in training), and visual encoder
architecture. Overall, these design choices lead to considerable and
consistent improvements. Under a sample budget, performance for
RGB-D agents improves 3 SPL on Gibson (4% relative improvement)
and 20 SPL on Matterport3D (43% relative improvement). Under a
compute budget, performance for RGB-D agents improves by 3 SPL
on Gibson (5% relative improvement) and 15 SPL on Matterport3D
(50% relative improvement). Our findings and recommendations
will serve to make the community’s experiments more efficient – to
reach 50 SPL with RGB-D on Matterport3D, they reduce the samples
needed by 3x and the training time 2x.

How to Train PointGoal Navigation Agents on a (Sample and Compute) Budget

Multiagent self-assembly allows collectives to reach areas otherwise inaccessible to any particular agent. However, the coordination of this collective is not trivial, so each agent’s position in the structure is usually determined apriori. In our approach, we take inspiration from army ants and use a simulated model of the Eciton Robotica robot to form emergent structures with bio-inspired local rules. We demonstrate that by coupling this with traffic control, we can induce the formation of a structure and control certain characteristics without pre-computed paths or central coordination.

Influencing Emergent Self-Assembled Structures in Robotic Collectives Through Traffic Control

**Read paper on the following link:**

https://ifaamas.org/Proceedings/aamas2022/pdfs/p1536.pdf

**Abstract:**



Can Algorithms be Explained Without Compromising Efficiency? The Benefits of Detection and Imitation in Strategic Classification


Representation learning on visualized input is an essential yet challenging task for deep reinforcement learning (RL). While training agents using deep reinforcement learning algorithms, we usually assume that the agent could extract appropriate features and take actions accordingly. However, learning essential and generalizable features based on high-dimensional input images is a great challenge. To help the RL agent learn more general and discriminative representation
among various states, we present cross-state self-constraint (CSSC). This novel technique regularizes representation learning by comparing state embedding similarities across different state-action pairs. We test our proposed method on the OpenAI Procgen benchmark with Rainbow and PPO and demonstrate significant improvement across most Procgen environments.

Downloads

Next from AAMAS 2022

Group fairness in bandit arm selection

Similar lecture

Scalable Solution Methods for Dec-POMDPs with Deterministic Dynamics

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES

.css-70qvj9{display:-webkit-box;display:-webkit-flex;display:-ms-flexbox;display:flex;-webkit-align-items:center;-webkit-box-align:center;-ms-flex-align:center;align-items:center;}Downloads

Next from AAMAS 2022

Group fairness in bandit arm selection

Similar lecture

Scalable Solution Methods for Dec-POMDPs with Deterministic Dynamics

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES

Downloads