United States

We present AR-Mentor, an AI enhanced application based on AR and Virtual Personal Assistance (VPA) technologies. AR-Mentor combines AR, Human Behavior Understanding, VPA technology and Scene Understanding to provide guidance. The system is designed to act as a personal mentor, providing human-like understanding and guidance. It provides a heads-up and hands-free experience. The user can train anywhere and use the system for providing guidance during actual maintenance or operation of the equipment. VPA is a dialog system that can listen and respond to users while maintaining conversational and environment context throughout the dialog. Scene understanding module enhances the typical AR systems with recognition of objects/parts in the scene. The behavior understanding module interprets user movements, actions, gestures and speech in the context of the task at hand. We will present results from experiments we did at the Bradley Vehicle Maintenance Training Center.

TEAR 3M 2021

AR-Mentor: Augmented Reality Maintenance Training System

audio-visual guidance

training

Brought to you by **National Defense Industrial Association ([NDIA](https://www.google.com/url?q=https%3A%2F%2Fwww.ndia-sd.org%2F&sa=D&sntz=1&usg=AFQjCNHj_BQx1K4KVKKp1NTIsAltZOG9Vg))** and hosted by the **Battlespace Exploitation of Mixed Reality ([BEMR](https://cdn.dvidshub.net/media/video/2101/DOD_108139354/DOD_108139354-1024x576-1769k.mp4)) Lab**, at **Naval Information Warfare Center Pacific ([NIWC PAC](https://www.google.com/url?q=https%3A%2F%2Fwww.public.navy.mil%2Fnavwar%2FNIWC-Pacific%2FPages%2Fdefault.aspx&sa=D&sntz=1&usg=AFQjCNFNS160IEsocfaBrnCNB3u7NqLHPw))**, and welcoming academia, government/DOD, and industry leaders who support Industrial Augmented Reality/Virtual Reality by using the following technologies:   


* Augmented Reality (AR) / Virtual Reality (VR)

* 2D/3D displays

* mobile displays

* wearables

* any other "immersive" technology

### In all fields that touch:

* 3D modeling

* Manufacturing 

* Installations 

* Maintenance and Repairs

* Construction

* Logistics

* Additive manufacturing

* Training

The technical exchange is a two day event held online this year due to COVID-19. It will feature two days of oral presentations, demonstrations, and posters from leaders in AR/VR and other display technologies, including government briefings on active projects within the DOD. The technical exchange is unclassified and we welcome participation from the Navy, DoD as well as from industry and academia. 

The goals of TEAR 3M are:

*  To spread awareness of current immersive technology research relevant to Navy/DOD applications

*  To connect AR researchers with experts in DOD to learn about needs and requirements

*  To build and strengthen collaborations within the DOD research community

![](https://assets.underline.io/uploads/markdown_image/1/image/0c13ac0ffa096b2353573964d8b89789.png)

TEAR 3M General Chairs:

Heidi Buck,  Director @ BEMR Lab, Naval Information Warfare Center, Pacific

Lauren Burnette, BEMR Lab, Naval Information Warfare Center, Pacific


For more information, contact Lauren and Heidi at:  tear3m@spawar.navy.mil

Questions regarding sponsorship/registration contact:  ndiasd@sandiegositepros.com

Conference host POC is Tammy Sanchez (NDIA):  tamsanch@cisco.com

technical paper

As the DoD continues to test the efficacy of XR products for training, there are challenges that remain for secure, efficient, and effective implementation. These challenges include providing 1) one place for discovery and distribution of XR products, 2) a streamlined way to use different XR products in one training course based on which is optimal for the KSAs being taught, and 3) a secure way to capture, analyze, view, and store the data from disparate products. Dynepic's DX Platform, white-labeled as MOTAR for the USAF, provides a secure infrastructure, open APIs and SDKs optimized for XR products, a marketplace for discovery and distribution of XR products, and a learning records store (LRS) and learning management system (LMS) that pull student performance data from third-party XR products into real-time, consolidated instructor dashboards. The MOTAR ecosystem will be discussed, along with lessons learned from a course run by AETC’s Maintenance Training Next Program.

MOTAR: An Ecosystem to Power the Future of Immersive Training

How do you define requirements for hardware that doesn't exist yet? Augmented reality (AR) headsets enable warfighters to take in complex spatial information without compromising situational awareness. Unfortunately, AR development is challenging because the underlying technology (e.g., displays, sensors) is constantly maturing. A proposed feature may require months of hardware development, only to discover it is too cognitively demanding to be viable. Simulating AR inside VR enables rapid prototyping of AR capabilities with full control over hardware features that would otherwise be subject to real-life limitations, such as field of view and tracking stability. In this talk I present a VR experiment simulating AR capabilities to identify usability issues and hardware requirements. I also describe the XR Testbed, a modular research platform designed to improve prototyping, simplify data collection, and improve collected data quality.

Simulating Augmented Reality Inside Virtual Reality

Extended Reality (XR) technologies present enormous potential for training, in shipyard operations, assembly and construction activities, as well as inspection and instructions for maintenance, repair, and overhaul operations. However, projects and demonstrations to date have failed to address issues of scalability. Mira will deliver a COTS solution for the creation of Augmented Reality (AR) work instructions and procedures installed on a DoD server and the consumption of this content on COTS Head Mounted Display (HMD). This brief will provide an overview of Mira tools as well some real life examples AR deployments from the Enterprise and DoD.

Scalable AR Solutions for the Deskless Industrial Workforce

EducationXR is an extended reality (XR) platform used to create, deploy, and distribute immersive education and training content. Learn how global-leading corporations are using XR for remote learning and leveraging access to XR content from all phones, tablets, desktops, PC's, and VR headsets, including the Oculus Quest 2. Immersive education and learning is here, now, and EducationXR is a platform powering scalability and access.

EducationXR: scalable creation, deployment and distribution of XR content

Quick look into how the most advanced large scale AR platform can support your logistic and maintenance / field service process. We not only show the tech, but real up and running implementations / best practices all around the world.


the most advanced large scale AR platform for highly efficient logistics and maintenance

Maritime security and defense industries face a unique set of challenges when it comes to implementing accessible, affordable, and productive training programs. From training that needs to adapt to keep pace with operational requirements for continuous seafarer training to a delivery model that can defy communication (and cost) barriers, finding a training solution that can be adaptive, scalable, and delivered broadly enough across working locations can pose a significant challenge—one that has been amplified by today’s additional requirement of meeting a remote working condition. 
Immersive technologies can help make training accessible across spatial barriers while helping to “train the untrainable” on-site experiences, but can the creation of immersive training be made quickly and adaptable enough to keep pace with operational requirements—and operating budgets? As this presentation will explain, immersive technology on its own may not be the answer, but immersive training that is platform agnostic and which also includes an adaptive and scalable modular training creation model can help the maritime defense and security industries access training that can reduce development costs, shorten the time-to-field, and adapt to meet continuing seafarer training requirements, allowing you to turn an immersive training solution into a cost-effective, adaptive, and reusable training content strategy.


How to Unlock the Full Potential of Immersive (AR & VR) Technologies for Maritime Defense and Security Training

Straight from the BEMR Lab at NIWC PACIFIC -- some suggestions to help vendors sell items to the government. Just a short overview of common problems we have run into as we buy from vendors.

First Time Selling to the Government?

D5T will provide an overview of mixed reality applications specific to industry training and operations (focus US shipyards). This will include an introduction of general knowledge capture and dissemination using state of the art technologies such as AR/VR/MR, an overview of Augmented Reality and Artificial Intelligence integration for use with shipyard operations, integration of visualization tools to improve welding operations in tight spaces, a multi-purpose virtual reality training platform, and integration of optimized registration for augmented reality training.

Mixed Reality Applications in Training and Operational Efforts

Military healthcare training is a complex endeavor, combining a variety of instructional techniques and training technologies. Augmented and virtual reality hold the promise of advancing healthcare training, improving learning outcomes, and increasing student immersion and engagement. This presentation will focus on research efforts in the areas of human computer interaction, haptics, and augmented reality applications for healthcare training. Challenges in this area will be highlighted, along with avenues of future research.

Virtual and Augmented Reality for Military Healthcare Training

Technology Transfer, or T2, is the intentional sharing of knowledge, expertise, facilities, equipment, and other resources for application to military and nonmilitary systems. In this session, the NIWC Pacific T2 Office will provide a short T2 overview brief to create a better understanding of T2, enabling more successful partnering opportunities. The brief will open with a brief history of T2, T2’s role, and how a number of the “how to work with the government” briefs are connected by, or leverage, T2. The second part of the brief will describe relevant T2 tools, namely agreements NIWC Pacific uses to conduct T2, highlighting the salient points that may help you work with the federal government.

Premium content

AR-Mentor: Augmented Reality Maintenance Training System

Downloads

Next from TEAR 3M 2021

MOTAR: An Ecosystem to Power the Future of Immersive Training

Similar lecture

Collaborative AR CAD Visualization and Procedure Assistance with ProtoSpace

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES