New Zealand

We develop a game theoretic model of malware protection using the state-of-the-art sandbox method, to characterize and compute optimal defense strategies for anti-malware. We model the strategic interaction between developers of malware (M) and anti-malware (AM) as a two player game, where AM commits to a strategy of generating sandbox environments, and M responds by choosing to either attack or hide malicious activity based on the environment it senses. We characterize the condition for AM to protect all its machines, and propose two frameworks to solve the for optimal AM strategy in other cases. First, we provide quadratically constrained quadratic program (QCQP)-based optimization framework to solve for the optimal AM strategy. Second, we model the problem using generative adversarial networks where M uses a discriminator to detect its current environments, and AM uses a generator to generate sandboxes to defeat M&#39;s discriminator.

AAMAS 2022

Anti-Malware Sandbox Games

non-cooperative game theory

anti-malware

sandbox

Naval Information Warfare Center Pacific is partnering with AFCEA San Diego chapter to host the workshop.

The NAML workshop is an opportunity for researchers from Navy research and development centers and our partner organizations to exchange technical ideas and to come together as a team.

The goals of NAML are:

* To spread awareness of current machine learning research relevant to Naval applications

* To connect machine learning researchers with experts in military requirements

* To build and strengthen collaborations within the defense research community

**Watch this video to hear about the AFCEA purpose.**

<iframe width=1280 height=706 frameborder="0" scrolling="no" src="https://screencast-o-matic.com/player/creleVVcvRh?v=6&ff=1&title=0&controls=1" allowfullscreen="true"></iframe>

NAML 2021

We develop a game theoretic model of malware protection using the state-of-the-art sandbox method, to characterize and compute optimal defense strategies for anti-malware. We model the strategic interaction between developers of malware (M) and anti-malware (AM) as a two player game, where AM commits to a strategy of generating sandbox environments, and M responds by choosing to either attack or hide malicious activity based on the environment it senses. We characterize the condition for AM to protect all its machines, and propose two frameworks to solve the for optimal AM strategy in other cases. First, we provide quadratically constrained quadratic program (QCQP)-based optimization framework to solve for the optimal AM strategy. Second, we model the problem using generative adversarial networks where M uses a discriminator to detect its current environments, and AM uses a generator to generate sandboxes to defeat M's discriminator.

technical paper

AAMAS (International Conference on Autonomous Agents and Multiagent Systems) is the largest and most influential conference in the area of agents and multiagent systems. The aim of the conference is to bring together researchers and practitioners in all areas of agent technology and to provide a single, high-profile, internationally renowned forum for research in the theory and practice of autonomous agents and multiagent systems. AAMAS is the flagship conference of the non-profit International Foundation for Autonomous Agents and Multiagent Systems (IFAAMAS).

The AAMAS conference series was initiated in 2002 in Bologna, Italy as a joint event comprising the 6th International Conference on Autonomous Agents (AA), the 5th International Conference on Multiagent Systems (ICMAS), and the 9th International Workshop on Agent Theories, Architectures, and Languages (ATAL).

Subsequent AAMAS conferences have been held in Melbourne, Australia (July 2003), New York City, NY, USA (July 2004), Utrecht, The Netherlands (July 2005), Hakodate, Japan (May 2006), Honolulu, Hawaii, USA (May 2007), Estoril, Portugal (May 2008), Budapest, Hungary (May 2009), Toronto, Canada (May 2010), Taipei, Taiwan (May 2011), Valencia, Spain (June 2012), Minnesota, USA (May 2013), Paris, France (May 2014), Istanbul, Turkey (May 2015), Singapore (May 2016), São Paulo (2017) and Stockholm, Sweden (2018), Montreal (May 2019), Auckland (May 2020, Virtual), London (May 2021, Virtual).
<br>
<br>



A ticket is required to attend this event, please register using the link below:

https://aamas2022-conference.auckland.ac.nz/attending/registration/

Registration Is Required

AAMAS (International Conference on Autonomous Agents and Multiagent Systems) is the largest and most influential conference in the area of agents and multiagent systems. The aim of the conference is to bring together researchers and practitioners in all areas of agent technology and to provide a single, high-profile, internationally renowned forum for research in the theory and practice of autonomous agents and multiagent systems. AAMAS is the flagship conference of the non-profit International Foundation for Autonomous Agents and Multiagent Systems (IFAAMAS).


We study a cooperative game setting where the grand coalition may change since the initial players can invite more players. We focus on the monotone games, i.e., adding more players to the grand coalition is not harmful. We model the invitation relationship as a directed acyclic graph. Our goal is to design a reward distribution mechanism for this new cooperative game setting such that players are incentivized to invite new players. In this paper, we propose the weighted permission Shapley value (inspired by permission structure and the weighted Shapley value) to achieve the goal. Our solution offers the very first attempt to incentivize players to invite more players to form a larger coalition via their private invitations in cooperative settings.

Incentives to Invite Others to Form Larger Coalitions


We initiate the study of the social welfare loss caused by corrupt auctioneers, both in single-item and multi-unit auctions. In our model, the auctioneer may collude with the winning bidders by letting them lower their bids in exchange for a (possibly bidder-dependent) fraction \gamma of the surplus. We consider different corruption schemes. In the most basic one, all winning bidders lower their bid to the highest losing bid. We show that this setting is equivalent to a \gamma-hybrid auction in which the payments are a convex combination of first-price and the second-price payments. More generally, we consider corruption schemes that can be related to \gamma-approximate first-price auctions (\gamma-FPA), where the payments recover at least a \gamma-fraction of the first-price payments. Our goal is to obtain a precise understanding of the robust price of anarchy (POA) of such auctions. If no restrictions are imposed on the bids, we prove a bound on the robust POA of \gamma-FPA which is tight (over the entire range of \gamma) for the single-item and the multi-unit auction setting. On the other hand, if the bids satisfy the no-overbidding assumption a more fine-grained landscape of the price of anarchy emerges, depending on the auction setting and the equilibrium notion. Albeit being more challenging, we derive (almost) tight bounds for both auction settings and several equilibrium notions, basically leaving open some (small) gaps for the coarse-correlated price of anarchy only.

Corruption in Auctions: Social Welfare Loss in Hybrid Multi-Unit Auctions


Bargaining can be used to resolve mixed-motive games in multi-agent systems. Although there is an abundance of negotiation strategies implemented in automated negotiating agents, most agents are based on single fixed strategies, while it is widely acknowledged that there is no single best-performing strategy for all negotiation settings.

In this paper, we focus on bargaining settings where opponents are repeatedly encountered, but the bargaining problems change. We introduce a novel method that automatically creates and deploys a portfolio of complementary negotiation strategies using a training set and optimise pay-off in never-before-seen bargaining settings through per-setting strategy selection. Our method relies on the following contributions. We introduce a feature representation that captures characteristics for both the opponent and the bargaining problem. We model the behaviour of an opponent during a negotiation based on its actions, which is indicative of its negotiation strategy, in order to be more effective in future encounters.

Our combination of feature-based methods generalises to new negotiation settings, as in practice, over time, it selects effective counter strategies in future encounters. Our approach is tested in an \gls{anac}-like tournament, and we show that we are capable of winning such a tournament with a \(5.6\% \) increase in pay-off compared to the runner-up agent.

Automated Configuration and Usage of Strategy Portfolios for Bargaining

We show that Game Description Language (GDL) can be used to describe some of the most commonly used test-beds in the automated negotiations literature, namely Genius and Colored Trails. This opens up an entirely new, declarative, approach to automated negotiation, in which a single algorithm can negotiate over a very broad class of different negotiation domains. We formally prove that the set of possible agreements of any negotiation domain from Genius (either linear or non-linear) can be modeled as a set of strategies over a deterministic extensive-form game that can be described efficiently in GDL. Furthermore, we show experimentally that, given only this GDL description, we can explore the agreement space efficiently using entirely generic domain-independent algorithms. In addition, we show that the same also holds for negotiation domains in the Colored Trails framework. This means we have the basic ingredients to implement a single negotiating agent that is capable of negotiating over many different kinds of negotiation domains, including Genius and Colored Trails.

GDL as a Unifying Domain Description Language for Declarative Automated Negotiation (Extended Abstract)

We propose and study a general framework for modelling and formal reasoning about multi-agent systems and, in particular, multi-stage games where both quantitative and qualitative objectives and constraints are involved. Our models enrich concurrent game models with payoffs and guards on actions associated with each state of the model. We propose a quantitative extension of the logic ATL* that enables the combination of quantitative and qualitative reasoning. We illustrate the framework with some examples and then consider the model-checking problems arising in our framework and establish some general undecidability and decidability results for them.

Combining quantitative and qualitative reasoning in concurrent multi-player games


Automated Negotiation is attracting more attention from researchers recently
as it is becoming more relevant to industrial and business applications with
increased reliance on automated systems.
Most research in this area assumes either a
single negotiation thread with a well-defined utility function for each
agent involved or a set of concurrent negotiations with an ordering of
outcomes in each local negotiation. In this paper, we consider an agent
engaged in a set of concurrent negotiations with a utility function
defined only for the complete set of agreements in all of them and
no locally defined ordering of outcomes in any negotiation independent from what
happens in the others. We argue that this problem setting is interesting both 
from the academic and the industrial points of view. The paper then
presents an algorithm that allows such agent to maximize its expected
global utility by orchestrating its behavior in all negotiation
threads. The performance of the proposed method is analyzed theoretically
and empirically using simulation in the context of a trading market.

Concurrent Negotiations with Global Utility Functions


We introduce a practical and scalable algorithm (PALMA) for solving one of the fundamental problems of multi-agent systems -- finding matches and allocations -- in unboundedly large settings (e.g., resource allocation in urban environments, mobility-on-demand systems, etc.), while providing strong worse-case privacy guarantees. PALMA is decentralized, runs on-device, requires no inter-agent communication, and converges in constant time under reasonable assumptions. We evaluate PALMA in a mobility-on-demand and a paper assignment scenario, using real data in both, and demonstrate that it provides a strong level of privacy (epsilon < 1 and median as low as epsilon = 0.5 across agents) and high quality matchings (up to 86% of the non-private optimal).

A Distributed Differentially Private Algorithm for Resource Allocation in Unboundedly Large Settings


Many real-world scenarios involve teams of agents who have to coordinate their policies to achieve a shared goal. Most previous studies mainly focus on learning decentralized control policies to maximize a common reward and rarely consider the coordinated control policies, which is critical in dynamic, complicated environments. Out of the fully decentralized rules, we propose a graph-based coordination strategy (GCS) which consists of a graph generator and a factored coordination policy. We adopt an encoder-decoder model as the generator to construct a directed acyclic graph (DAG), dynamically representing the underlying decision structure. We also apply the DAGness and depth constrained optimization in the graph generator to balance efficiency and performance. To exploit the underlying decision structure, we investigate the factored coordination policy to obtain the optimally coordinated behaviors among agents. We train the graph generator and the factored coordination policy simultaneously to maximize the discounted return. Empirical evaluations on Collaborative Gaussian Squeeze, Cooperative Navigation, and Google Research Football demonstrate the superiority of the proposed method.

GCS: Graph-Based Coordination Strategy for Multi-Agent Reinforcement Learning


High-performing teams learn intelligent and efficient communication and coordination strategies to maximize their joint utility. These teams implicitly understand the different roles of heterogeneous team members and adapt their communication protocols accordingly. Multi-Agent Reinforcement Learning (MARL) seeks to develop computational methods for synthesizing such coordination strategies, but formulating models for heterogeneous teams with different state, action, and observation spaces has remained an open problem. Without properly modeling agent heterogeneity, as in prior MARL work that leverages homogeneous graph networks, communication becomes less helpful and can even deteriorate the cooperativity and team performance. We propose Heterogeneous Policy Networks (HetNet) to learn efficient and diverse communication models for coordinating cooperative heterogeneous teams. Building on heterogeneous graph-attention networks, we show that HetNet not only facilitates learning heterogeneous collaborative policies per existing agent-class but also enables end-to-end training for learning highly efficient binarized messaging. Our empirical evaluation shows that HetNet sets a new state of the art in learning coordination and communication strategies for heterogeneous multi-agent teams by achieving an 8.1% to 98.7% performance improvement over the next-best baseline across multiple domains while simultaneously achieving a 200x reduction in the required communication bandwidth.

Learning Efficient Diverse Communication for Cooperative Heterogeneous Teaming


In online advertising, search engines sell ad placements for keywords continuously through auctions. This problem can be seen as an infinitely repeated game since the auction is executed whenever a user performs a query with the keyword. As advertisers may frequently change their bids, the game will have a large set of equilibria with potentially complex strategies. In this paper, we propose the use of natural strategies for reasoning in such setting as they are processable by artificial agents with limited memory and/or computational power as well as understandable by humans users. To reach this goal, we introduce a quantitative version of Strategy Logic with natural strategies in the setting of imperfect information. In a first step, we show how to model strategies for repeated keyword auctions and take advantage of the model for proving properties evaluating this game. In a second step, we study the logic in relation to the distinguishable power, expressivity, and model-checking complexity for strategies with and without recall.

Anti-Malware Sandbox Games

Downloads

Next from AAMAS 2022

Incentives to Invite Others to Form Larger Coalitions

Similar lecture

Applying Generative Adversarial Network constructs to Mission-based Simulations to produce “Realistic” Synthetic Training Data for Machine Learning Algorithms

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES

Anti-Malware Sandbox Games

.css-70qvj9{display:-webkit-box;display:-webkit-flex;display:-ms-flexbox;display:flex;-webkit-align-items:center;-webkit-box-align:center;-ms-flex-align:center;align-items:center;}Downloads

Next from AAMAS 2022

Incentives to Invite Others to Form Larger Coalitions

Similar lecture

Applying Generative Adversarial Network constructs to Mission-based Simulations to produce “Realistic” Synthetic Training Data for Machine Learning Algorithms

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES

Downloads