United States

Machine learning research generally necessitates extensive data requirements. In the sub-field of computer vision, there is a high demand for visual data that accurately depicts the real world around us. This data has traditionally taken the form of digital images captured with optical sensors (physical cameras) and annotations applied during post-processing. Synthetic imagery provides a mechanism to dynamically create this training content for machine learning algorithms.
This project’s goal was to bring advanced machine learning technologies to explosive ordnance disposal (EOD) teams. The application of synthetic imagery technology can assist in the detection, recognition, and identification of ordnance while increasing the level of safety and efficiency for EOD specialists in the field.

NAML 2022

Synthetic Imagery Applications in Computer Vision

synthetic

photogrammetry

data

physics

lidar

simulation

image

vision

annotation

Brought to you by **National Defense Industrial Association ([NDIA](https://www.google.com/url?q=https%3A%2F%2Fwww.ndia-sd.org%2F&sa=D&sntz=1&usg=AFQjCNHj_BQx1K4KVKKp1NTIsAltZOG9Vg))** and hosted by the **Battlespace Exploitation of Mixed Reality ([BEMR](https://cdn.dvidshub.net/media/video/2101/DOD_108139354/DOD_108139354-1024x576-1769k.mp4)) Lab**, at **Naval Information Warfare Center Pacific ([NIWC PAC](https://www.google.com/url?q=https%3A%2F%2Fwww.public.navy.mil%2Fnavwar%2FNIWC-Pacific%2FPages%2Fdefault.aspx&sa=D&sntz=1&usg=AFQjCNFNS160IEsocfaBrnCNB3u7NqLHPw))**, and welcoming academia, government/DOD, and industry leaders who support Industrial Augmented Reality/Virtual Reality by using the following technologies:   


* Augmented Reality (AR) / Virtual Reality (VR)

* 2D/3D displays

* mobile displays

* wearables

* any other "immersive" technology

### In all fields that touch:

* 3D modeling

* Manufacturing 

* Installations 

* Maintenance and Repairs

* Construction

* Logistics

* Additive manufacturing

* Training

The technical exchange is a two day event held online this year due to COVID-19. It will feature two days of oral presentations, demonstrations, and posters from leaders in AR/VR and other display technologies, including government briefings on active projects within the DOD. The technical exchange is unclassified and we welcome participation from the Navy, DoD as well as from industry and academia. 

The goals of TEAR 3M are:

*  To spread awareness of current immersive technology research relevant to Navy/DOD applications

*  To connect AR researchers with experts in DOD to learn about needs and requirements

*  To build and strengthen collaborations within the DOD research community

![](https://assets.underline.io/uploads/markdown_image/1/image/0c13ac0ffa096b2353573964d8b89789.png)

TEAR 3M General Chairs:

Heidi Buck,  Director @ BEMR Lab, Naval Information Warfare Center, Pacific

Lauren Burnette, BEMR Lab, Naval Information Warfare Center, Pacific


For more information, contact Lauren and Heidi at:  tear3m@spawar.navy.mil

Questions regarding sponsorship/registration contact:  ndiasd@sandiegositepros.com

Conference host POC is Tammy Sanchez (NDIA):  tamsanch@cisco.com

TEAR 3M 2021

poster

##### For full functionality of Underline, please SHUT OFF your VPN, or use a personal device.


Naval Information Warfare Center Pacific is partnering with AFCEA San Diego chapter to host the workshop.

The NAML workshop is an opportunity for researchers from Navy research and development centers and our partner organizations to exchange technical ideas and to come together as a team.

The goals of NAML are:

To spread awareness of current machine learning research relevant to Naval applications

To connect machine learning researchers with experts in military requirements

To build and strengthen collaborations within the defense research community


<figure class="video_container">
  <iframe src="https://s3.amazonaws.com/pf-user-files-01/u-59356/uploads/2022-03-22/hk13mxo/NAML_ReceptionWithtitle.mp4" width=826  height=526  frameborder="0" allowfullscreen="true"> </iframe>
</figure>

Naval Information Warfare Center Pacific is partnering with AFCEA San Diego chapter to host the workshop. The NAML workshop is an opportunity for researchers from Navy research and development centers and our partner organizations to exchange technical ideas and to come together as a team.

The goals of NAML are:

To spread awareness of current machine learning research relevant to Naval applications

To connect machine learning researchers with experts in military requirements

To build and strengthen collaborations within the defense research community



In this session, attendees will participate in a live tutorial of Juneberry, an experimental machine learning framework designed to manage the training and evaluation of machine learning models. Each participant will be able to download a fully configured Docker container and follow along with a live exercise. The exercise is based on the tutorial “Replicating a Classic Machine Learning Result with Juneberry”, which guides users through the steps required to replicate a ResNet from the He et al. 2015 paper.

Juneberry aims to reduce the costs associated with having to deal with multiple sets of machine learning models. The framework facilitates experimentation and model comparison through a JSON-based config file system, which manages input data files, models, and the underlying calls of machine learning platforms such as PyTorch, TensorFlow, Detectron2, and MMDetection. By relying on this config pipeline, a machine learning researcher can focus more on the design of their model, while spending less time implementing and iterating upon their design.

Juneberry also offers an “experiment outline” feature, which allows users to vary aspects of their base model and compare how the model’s performance reacts to those changes. Experiments also allow users to compare the performance of multiple models, enabling researchers to choose the model that is the best match for their design goals.

IMPORTANT:

Before the tutorial the users will need to have docker installed on their platform (note, we do NOT support Apple Silicon) and download a specific docker image. The directions can be found here:
https://github.com/cmu-sei/juneberry/blob/main/docs/vignettes/vignette1/Replicating_a_Classic_Machine_Learning_Result_with_Juneberry.md#working-with-juneberry-docker-containers

For more information about Juneberry, see the following links:
https://github.com/cmu-sei/juneberry
https://github.com/cmu-sei/juneberry/blob/main/juneberry/documentation/vignettes/Replicating_a_Classic_Machine_Learning_Result_with_Juneberry.md

Juneberry, a machine learning experiment framework tutorial

Challenges and Opportunities in the Navy AI Space: An Operational Perspective from the AI Task Forces

This talk describes the principle of ``General Cyclical Training'' in machine learning, where training starts and ends with "easy training" and the "hard training" happens during the middle epochs. We propose several manifestations for training neural networks, including algorithmic examples (via hyper-parameters and loss functions), data-based examples, and model-based examples. Specifically, we introduce several novel techniques: cyclical weight decay, cyclical batch size, cyclical focal loss, cyclical softmax temperature, cyclical data augmentation, cyclical gradient clipping, and cyclical semi-supervised learning. In addition, we demonstrate that cyclical weight decay, cyclical softmax temperature, and cyclical gradient clipping (as three examples of this principle) are beneficial in the test accuracy performance of a trained model. Furthermore, we discuss model-based examples (such as pretraining and knowledge distillation) from the perspective of general cyclical training and recommend some changes to the typical training methodology. In summary, this paper defines the general cyclical training concept and discusses several specific ways in which this concept can be applied to training neural networks.


On General Cyclical Training of Neural Networks

Derivations are given of various versions of equilibrium propagation using adjoint methods. The learning rules are studied using simulations with the MNIST data set.

Variational Perspective on Learning Rules for Networks with an Energy Function

With the advent of quantum supremacy, quantum technologies are establishing themselves profitable with near-term commercial products becoming more and more prominent in different parts of the world, with applications that include the military sector. Among such applications, the area of quantum machine learning (QML) is starting to establish itself as a field of its own. Much like classical machine learning, the goal is to be able to generalize a process into multiple applications, but a deeper question remains as to whether there is computational advantage against classical processes via quantum-inspired algorithms; common ways to find such advantages involves proving that there is no best known classical algorithm that performs more efficiently than a quantum algorithm, and processing wise that there exists a run- time exponential advantage over classical computing . While proving quantum advantage and supremacy is controversial and non-trivial, an additional challenge lies in the processing limitation imposed by currently available quantum computers, often referred to as Noisy Intermediate Scale Quantum (NISQ) processors . Such limitations have forced developers to compile algorithms limited both in the num- ber of qubits and number of qubit operations by a hardware-specific metric referred to as Quantum Volume (QV). As a result, it is widely accepted in academia and industry that there is not clear quantum advantage over classical processors given the current technological readiness of available quantum processors due to noise and quantum bits qubit de-coherence limiting the number of qubits and gate operations. However, while acknowledging such limitations, there are some avenues to continue advancing the paradigm of quantum machine learning applications acknowledging hardware limitations: 1) theoretical explorations are done to demonstrate, via com- putational complexity theory, implementations that could get attained in the future once a fault-tolerant quantum computer becomes available, 2) via hybrid instances where some machine learning tasks are managed by a quantum computer while a classical processor takes the rest, such that, quantum machine learning algorithms are used to classify quantum states that are produced by a quantum simulator, and 3) programming a NISQ computer and assessing its quantum algorithm performance against a classical processor counterpart.

Quantum Assisted Machine Learning (QAML) - Promises and Challenges

Modulation recognition on Intel’s Loihi through ANN/SNN conversion

Monitoring of maritime objects, particularly dark vessels, at a global scale is a challenging task. Synthetic aperture radar (SAR) is a valuable data source because it offers day/night and all-weather situational awareness unlike passive sources such as electro-optical imagery or data sources requiring vessel cooperation such as automatic identification system (AIS) or vessel monitoring system (VMS) data. Deep learning-based computer vision approaches to analyzing SAR imagery have historically been limited by a scarcity of high-quality labeled imagery. To address this problem and to stimulate academic and commercial development of SAR-focused object detectors, the xView3 dataset and challenge was recently introduced to provide annotated imagery for training and evaluation drawn from the ongoing Sentinel-1 satellite SAR mission operated by the European Space Agency. While the xView3 dataset is an important contribution to SAR computer vision research, this is a temporary and limited solution. As novel examples are seen in the wild and as new SAR sensors become available, existing object detection models will need to be retrained with relevant new examples. Given a pool of unlabeled images, the task of selecting new images to label is traditionally assigned to human experts or chosen randomly. As labeling resources are limited, particularly with SAR which requires specialized expertise and ancillary data, it is important to select the most informative images to label so that the model steadily improves as new examples are encountered. Active learning (AL) seeks to automate and optimize this data selection process. Active learners provide an acquisition function which selects a subset of examples for labeling from the set of unlabeled data according to some criteria such as uncertainty, disagreement, diversity, expected error reduction, etc. In this work, we propose to evaluate state-of-the-art AL algorithms for the task of maritime object detection in SAR imagery using the xView3 dataset. To the best of our knowledge, no publicly available work has compared different AL approaches for SAR-based computer vision. We compare their learning curves for different dataset slices (e.g., near-shore, open-ocean, island, etc.) as well as for different object detection models to assess the transferability of AL algorithms to new data and model architectures. Given the high resolution and volume of satellite SAR imagery, we additionally report processing time for each algorithm. We identify gaps in current AL solutions for SAR computer vision and propose solutions to address these shortcomings to improve their utility in practical settings.

Active learning for maritime object detection in synthetic aperture radar imagery

Apply Reinforcement Learning (RL) techniques to extend the holdover time of an inertial system in the absence of aiding from a Global Navigation Satellite System (GNSS).

Drift Improvement through Reinforcement Learning - INS (DIRT-I)

Modern radar simulation development primarily uses raw data collects from blue forces placed in intelligence databases that have not yet been thoroughly vetted and distilled into a usable data product.  These resources often have redundant, ambiguous, or missing information describing modes and operation of the system that must be preprocessed by those local to the organization developing the simulations rather than the Intelligence Communities (ICs) themselves.  The ICs’ process to generate a Tier I or II product takes considerable time and doesn’t always meet the timeline requirement to support the Warfighter in a dynamically changing Electronic Warfare (EW) threat environment.  Hence, it is required for personnel to utilize data-driven tools leveraging Artificial Intelligence (AI) and Machine Learning (ML) to down-select redundant or ambiguous information and impute missing information to construct quick-reaction models at a relatively high frequency.  This effort employs clustering algorithms to find redundant or ambiguous modes for a particular emitter and then constructs the radar simulation based on the consolidation of modes.  The quality is comparable to the traditional manual construction of simulations in many cases and drastically increases the speed and quantity at which simulations are processed.  Missing parameter data is addressed by utilizing a decision-tree based regressor that imputes the missing parameters based on training data taken from other sources that could provide inference (i.e. other radars).  Lowering the variance of these estimates requires execution on data at fairly low levels describing the radar system, but has potential to initially bridge parameter gaps not yet filled. 

Machine learning applications for quick-reaction development of radar simulations with imperfect data

As one of the pillars of readiness, maintenance manning plays a critical role in the production of mission capable aircraft; the quantity, skills, and experience of maintainers onboard directly impacts the ability of a squadron to meet its readiness goals. Current distribution of maintainers is performed manually according to a set of heuristics and expert knowledge. Prior work performed under the Digital Aviation Readiness Technology Engine (DARTE) effort focused on automating this process via a statistical approach to identifying targeted, data-driven personnel moves expected to increase the readiness of the enterprise. Improving upon this work, the Resource Optimization with Agent Reinforcement (ROAR) model is built using reinforcement learning to train an agent which directs maintainer transfers within the fleet. The agent learns within a simulated environment which incorporates predictive models of important features into the transition model. This approach allows the agent to consider additional elements of the state of the enterprise (e.g. expected change in mission capable aircraft). In this way, the agent can select targeted personnel transfers which maximize readiness across the enterprise.

Premium content

Synthetic Imagery Applications in Computer Vision

Next from NAML 2022

Juneberry, a machine learning experiment framework tutorial

Similar lecture

Transform How You Plan: Rapid Scanning and Collaborative XR Visualization

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES