United States

Understanding data prior to using machine learning algorithms can help make machine learning (ML) results less opaque and inform ML design decisions. Characterizing the geometry (topology) of data can help identify (i) missing data and (ii) the complexity of the decision boundary between different classes of data. This can lead to the more efficient deployment of ML tools. In this poster we present new results on our use of topological data analysis for analyzing machine learning tools and show how to scale these methods to manage larger data sets. We illustrate this approach with a large data set from the particle physics community and compare topological results with deep learning results.

NAML 2022

Extracting Properties of Separators from Larger Scale Data using Topological Data Analysis Methods

interpretabiility

data geometry

topological data analysis

deep learning

Naval Information Warfare Center Pacific is partnering with AFCEA San Diego chapter to host the workshop.

The NAML workshop is an opportunity for researchers from Navy research and development centers and our partner organizations to exchange technical ideas and to come together as a team.

The goals of NAML are:

* To spread awareness of current machine learning research relevant to Naval applications

* To connect machine learning researchers with experts in military requirements

* To build and strengthen collaborations within the defense research community

**Watch this video to hear about the AFCEA purpose.**

<iframe width=1280 height=706 frameborder="0" scrolling="no" src="https://screencast-o-matic.com/player/creleVVcvRh?v=6&ff=1&title=0&controls=1" allowfullscreen="true"></iframe>

NAML 2021

poster

##### For full functionality of Underline, please SHUT OFF your VPN, or use a personal device.


Naval Information Warfare Center Pacific is partnering with AFCEA San Diego chapter to host the workshop.

The NAML workshop is an opportunity for researchers from Navy research and development centers and our partner organizations to exchange technical ideas and to come together as a team.

The goals of NAML are:

To spread awareness of current machine learning research relevant to Naval applications

To connect machine learning researchers with experts in military requirements

To build and strengthen collaborations within the defense research community


<figure class="video_container">
  <iframe src="https://s3.amazonaws.com/pf-user-files-01/u-59356/uploads/2022-03-22/hk13mxo/NAML_ReceptionWithtitle.mp4" width=826  height=526  frameborder="0" allowfullscreen="true"> </iframe>
</figure>

Naval Information Warfare Center Pacific is partnering with AFCEA San Diego chapter to host the workshop. The NAML workshop is an opportunity for researchers from Navy research and development centers and our partner organizations to exchange technical ideas and to come together as a team.

The goals of NAML are:

To spread awareness of current machine learning research relevant to Naval applications

To connect machine learning researchers with experts in military requirements

To build and strengthen collaborations within the defense research community



Military tactical decision-making requires the ability to determine efficient optimized actions across multiple entities in complex environments, potentially with limited or denied communications. In recent years, researchers have applied various approaches to wargaming problems, including game theory, optimization, and more recently, deep reinforcement learning. Most deep reinforcement learning algorithms treat agents as decentralized with rewards that do not require cooperation across agents. In this research, we model a blue versus red war game scenario in an AI-gym environment. We add a stochastic game algorithm (COCO-Q) to a decentralized reinforcement learning algorithm (PRIMAL) to incorporate cooperation as a part of a goal-oriented model for a blue versus red simulation. 

PRIMAL is a decentralized pathfinding model used to implement pathways for warehouse drones. Each drone has a drop-off location, and it makes pathway decisions on its moves within a certain radius. This approach will provide a locally optimal pathway for each individual drone. COCO-Q is a stochastic game model with side payments. The side payments provide incentive for agents to work together for a common goal. These incentives are included when calculating the COCO value. The advantage of COCO-Q is that it considers both competitive and cooperative objectives, which allow the model to be shaped as a team advantage solution versus individual agents playing the same game independently. In this work, we introduce an extension of COCO-Q to a blue/red wargame that looks for a cooperative pathway for the given scenario and compare solutions to PRIMAL’s individual pathway solution.

Stochastic Game with Multi-agents in a competitive-cooperative game theory environment with an altered reward structure.

We investigate the use of artificial intelligence-based techniques in learning to play a 2-player, real-time strategy game called Hunting-of-the-Plark. The game is challenging to play for both humans and artificial intelligence-based techniques because neither player can directly observe its opponent's moves at any time during the game, and has to rely on post hoc analyses of game moves and outcomes to infer the opponent's game-playing strategies and learn to play effectively against them. We analyze the performance of different deep reinforcement algorithms to train software agents that can play the game. We also investigate different techniques that can be used by players to improve their play including self-play, where each player first builds a model of the opponent from the history of opponent's perceived actions and then uses it to refine their own game-playing strategies, and, dynamic strategy evolution, where the players strategically adapt their own strategies to gain advantage over the opponent. Our experimental results show that the actor-critic learning algorithm is the most efficient in terms of training time and rewards received by both players. Our experiments also showed that while one of the players starts with a disadvantage due to the inherent asymmetric nature of the game rules, it can increase its score considerably by using improved techniques like self-play and dynamic strategy evolution.

Learning to Play Simulated War-Games using AI: A Case Study of Deep Reinforcement Learning for Hunting of the Plark Game

R-DEX Systems (R-DEX) was formed in 2014 to develop and transition innovative technologies to Government and commercial clients. The R-DEX mission is to bring cutting edge Artificial Intelligence (AI), Machine Learning (ML), and robotics technologies to Government and commercial customers. R-DEX is actively engaged in multiple federally-funded efforts to develop a suite of technologies to achieve resilient AI systems that can be trusted, validated, and on par with human-like performance. These efforts focus in multiple modalities non-traditional sensor modalities, including Synthetic Aperture Radar (SAR), Inverse SAR, panchromatic electro-optical (EO), Electronic Warfare (EW), RF, and radar. Throughout the course of these efforts, R-DEX has developed and continues to develop a suite of Quality Assurance (QA) tools for AI/ML models with the goal of improving confidence in AI/ML results and to improve performance. In this talk, we will discuss R-DEX QA tools for AI/ML that focus in three general areas: 1) stress testing, 2) preventative tools, and 3) treatment tools. This discussion will include a summary of R-DEX’s proprietary Adversarial Input Detector (AID) models to detect and classify adversarial inputs as well as methods for prediction correction. These models hold for adversarial inputs that are caused by either bad actors or natural distortions. R-DEX’s tools also include techniques to combat epistemic uncertainty, namely, the uncertainty that AI/ML models face that arise from a lack of knowledge (e.g., lack of training examples, corrupted data, etc.). Common issues include data drift, unseen samples arising, and model not learning proper signals. R-DEX tools for combatting epistemic uncertainty include SDENets, data drift detection and retraining, and AI/ML forensics and meta-learning analysis. In addition, R-DEX tools to improve model robustness include DefenseGAN, R-DEX’s AID models, Jacobian Regularization, and Segmentation Masks.

Building AI Resiliency

While the Navy benefits tremendously from cloud-based, big data systems, they have yet to realize the benefits of artificial intelligence throughout the denied, disconnected, intermittent and low-bandwidth (DIL) settings in which they operate. In order to help the Navy apply artificial intelligence to missions in DIL settings—including predictive maintenance and early warning, JADC2, and ISR—Booz Allen developed the Beacon platform for edge AI. Using the Beacon platform, Booz Allen AI engineers have been able to dramatically reduce size and power consumption of algorithms while increase throughput and holding accuracy relatively constant. Ultimately, Booz Allen’s Beacon platform is a key enabler for bringing AI to DIL mission environments.

Bringing AI to the Edge with BEAST

Machine Learning (ML) systems are able to complete many tasks more efficiently and accurately than humans, but their competency often drops when operating in untrained conditions.  The opaqueness of how most ML agents arrive at their output reduces trust of human operators or teammates even for conditions where the ML agent’s average capability exceeds that of their human counterparts.  The MindfuL™ System has been developed on DARPA’s Competency Aware Machine Learning (CAML) program and aims to solve both of these issues.
The MindfuL™ system characterizes incoming data and environmental conditions that drive competency of the ML system through Hierarchical Dirichlet Processes.  This very compact representation focuses on the elements of the ML agent’s experience that leads to specific approaches in the ML model to completing the task (strategies) and performance of the ML agent.  Leveraging input data as well as past performance and strategies of the ML agent, MindfuL™ software is able to predict future performance and strategy implementation and provides users with the context necessary to understand if an ML agent is suited to its task given the current environment and why.
The MindfuL™ system performance exceeded the Year 2 DARPA Competency Aware Machine Learning program metrics.  When applied to a Convolutional Neural Network aiming to predict obstacle depth from 2-D imagery, the MindfuL™ system was able to correctly identify more than 95% of competency controlling conditions present in the environment, to characterize the behavior of the neural network correctly 94% of the time, and to predict performance of the ML agent relevant to a human for 99% of images.
Continued development on MindfuL™ software aims to provide more semantically meaningful conditions and specific suggestions for how best an operator should use an ML agent under the current or proposed operating conditions.

MindfuL™ Software: Competency Aware Machine Learning

A key challenge in modern machine learning is how to build accurate explainable classifiers. A significant issue is the tradeoff between using expert-generated, explainable features and deeply learned features generated by neural networks. Deep learning (DL) achieves impressive performance in many domains, but the resulting networks function as “black box” systems, without the capability to explain their conclusions. The lack of explainability impedes their safe application to some of the very domains that could most benefit from AI, including military, intelligence, security, medical, and legal applications where decisions must be justified and the consequences of failure are too great.
Case-based reasoning (CBR) solves problems by retrieving and adapting cases encoding the solutions to prior similar problems. The CBR process leverages analogical reasoning with knowledge about similarity and about how to adapt solutions to new circumstances. CBR can exploit the intelligibility of cases to provide explanations in a form compelling to humans. CBR often uses expert-generated features to index cases. This is both a strength for interpretability and a weakness for knowledge acquisition.
We are developing methods for applying deep learning to generate case features to augment expert features, to improve performance while retaining the explainability of expert features. The goal of this hybrid approach is for cases to provide a human-intelligible vehicle for capturing and explaining decisions, while network learning methods support the CBR process by generating the similarity knowledge to select the right cases.

Deep Learning to Enhance Similarity Assessment for Case-based Reasoning

The US Navy relies on SONAR for detection and classification of contacts to support navigation and other mission related tasks. The field of deep learning (DL) could be useful in this problem space given that it is the current state of the art approach for image and speech recognition. However, supervised deep learning is a data hungry process and many Navy problems have limited labeled data. A sufficiently data rich underwater acoustic classification problem is recognizing marine mammals from individual echolocation clicks. The objective of this project is to apply DL to this problem space and determine how much training data is required for a DL classifier to compete with an existing baseline approach. This collaborative effort between the Naval Undersea Warfare Center (NUWC) Division, Newport, RI (NUWCDIVNPT) and the Naval Surface Warfare Center Carderock Division (NSWCCD) demonstrated multiple successful DL methods utilizing different input types (i.e. time-series or spectrogram-like images). Models investigated include a one dimensional convolutional neural network (1D CNN) that ingests raw time-series data previously isolated by a power law detector, as well as a Temporal Convolutional Network (TCN) that can detect as well as classify time-series data. This work also includes detailed performance comparisons between the different DL methods in terms of classification accuracy, precision, recall, and heat maps that portray one-to-one visualizations of classifications results for 1,500 common (hold out) test cases organized by approximate signal to noise ratio (SNR) and recording sensor location.

deepBioNet: Biologic Acoustic Transient Classifier

We propose MagNet, a simple and interpretable time-domain neural network for magnetic anomaly detection. We describe the results of a supervised learning application in which we train MagNet to identify the presence of magnetic dipoles as they pass by a magnetic vector gradiometer. The detection statistics show robust performance as a function of signal-to-noise ratio and the ability to provide detections before the closest point of approach. In addition, we use the interpretable layers of MagNet as a diagnostic tool to provide new insights into sensor data and bulk dynamics of the dipole.

Time-Domain Neural Network Detects Passing Dipole Targets Registered by a Magnetic Vector Gradiometer

Professional and technology skills are in high demand; so are human factors like creativity. With today’s top talent already engaged in meaningful work, the race is on to find emerging talent. Resumes present an inherent barrier to finding the top performers of the future. We developed an Artificial Intelligence (AI) based system, CVkeys, to overcome the challenges associated with finding top talent. As a result, we can match people with jobs in milliseconds. This is a demonstrated application of machine learning that has far-reaching applications and implications across the Navy information enterprise.


Artificial Intelligence/Machine Learning Ontologies

Automatic Modulation Classification (AMC) is an important front-end step in a number of applications such as Signals Intelligence, spectrum interference monitoring, link adaptation, dynamic spectrum access, radio fault detection, cognitive radio and 4G/5G cellular standards. We present results of Quantization-Aware Training (QAT) and Pruning of a Deep Convolutional Neural Network (DCNN) for Hardware-Efficient RF modulation classification. An 8-bit quantized MobileNeXt DCNN consisting of sandglass blocks of Depthwise and Pointwise convolution layers was trained on the DeepSig RadioML 2018.01A dataset as part of the 2021 ITU AI/ML in 5G Lightning-Fast Modulation Classification challenge organized by the International Telecommunication Union. The training was done using the Xilinx Brevitas QAT library and the PyTorch pruning library. We introduce the notion of Inference Cost whose key determinants are the number of multiply accumulate (MAC) operations, the number of weights and the bit precision of the weights and activations as compared to a reference 8-bit quantized VGG10 DCNN. We will discuss the next steps for deploying the model with hardware specific optimizations on the Zynq UltraScale+ RFSoC using the Xilinx FINN (Fast Scalable Quantized Neural Network Inference) library. Work was supported by FY21 NISE 219 funding.

Downloads

Next from NAML 2022

Stochastic Game with Multi-agents in a competitive-cooperative game theory environment with an altered reward structure.

Similar lecture

I Spy in the Sea and Sky: Classification of Maritime and Aerial Targets from Tracking Data

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES