United States

TEAR 3M 2021

Augmented Reality For Training: Case Study Air Force Maintenance Next

Brought to you by **National Defense Industrial Association ([NDIA](https://www.google.com/url?q=https%3A%2F%2Fwww.ndia-sd.org%2F&sa=D&sntz=1&usg=AFQjCNHj_BQx1K4KVKKp1NTIsAltZOG9Vg))** and hosted by the **Battlespace Exploitation of Mixed Reality ([BEMR](https://cdn.dvidshub.net/media/video/2101/DOD_108139354/DOD_108139354-1024x576-1769k.mp4)) Lab**, at **Naval Information Warfare Center Pacific ([NIWC PAC](https://www.google.com/url?q=https%3A%2F%2Fwww.public.navy.mil%2Fnavwar%2FNIWC-Pacific%2FPages%2Fdefault.aspx&sa=D&sntz=1&usg=AFQjCNFNS160IEsocfaBrnCNB3u7NqLHPw))**, and welcoming academia, government/DOD, and industry leaders who support Industrial Augmented Reality/Virtual Reality by using the following technologies:   


* Augmented Reality (AR) / Virtual Reality (VR)

* 2D/3D displays

* mobile displays

* wearables

* any other "immersive" technology

### In all fields that touch:

* 3D modeling

* Manufacturing 

* Installations 

* Maintenance and Repairs

* Construction

* Logistics

* Additive manufacturing

* Training

The technical exchange is a two day event held online this year due to COVID-19. It will feature two days of oral presentations, demonstrations, and posters from leaders in AR/VR and other display technologies, including government briefings on active projects within the DOD. The technical exchange is unclassified and we welcome participation from the Navy, DoD as well as from industry and academia. 

The goals of TEAR 3M are:

*  To spread awareness of current immersive technology research relevant to Navy/DOD applications

*  To connect AR researchers with experts in DOD to learn about needs and requirements

*  To build and strengthen collaborations within the DOD research community

![](https://assets.underline.io/uploads/markdown_image/1/image/0c13ac0ffa096b2353573964d8b89789.png)

TEAR 3M General Chairs:

Heidi Buck,  Director @ BEMR Lab, Naval Information Warfare Center, Pacific

Lauren Burnette, BEMR Lab, Naval Information Warfare Center, Pacific


For more information, contact Lauren and Heidi at:  tear3m@spawar.navy.mil

Questions regarding sponsorship/registration contact:  ndiasd@sandiegositepros.com

Conference host POC is Tammy Sanchez (NDIA):  tamsanch@cisco.com

technical paper

ROVs are taking on an increasing role in the Navy to perform precision tasks in harsh environments which only commercial and tech divers were capable of performing. Casey Sapp, CEO of VRTUL, will discuss the critical role of livestreaming 360 video and Virtual Reality to help ROV pilots and EOD Techs in their work.

ROV VR for Maintenance, Inspection, and Explosive Ordnance Disposal

Here is a video link of my presentation: https://vimeo.com/492199892/ae0dc3169d

Vermeer is building an AR/VR Realtime Common Operating Picture with command and control and GPS denied capabilities for autonomous systems.


AR To Control Reality

Augmented reality (AR) is an emerging technology that has seen a drastic rise in enterprise and consumer adoption. In this vein, AR has made a substantial impact in industrial, retail, and training sectors. One such domain is maintenance, where organizations are taking advantage of AR technologies to improve safety, increase efficiency, and close the knowledge gap. The current presentation discusses the recent advancements in AR use in both commercial and military applications. Specifically, the use of AR to capture a plethora of explicit, implicit, and critical tacit knowledge is discussed. Case studies with commercial trucking, the 367 Training Support Squadron from the US Air Force, and maintainers onboard the USS Gerald R. Ford (CVN 78) from the US Navy are presented to demonstrate the robust benefits of AR for knowledge capture. The presentation concludes with major take-aways from these case studies and recommendations for future use of AR across military and commercial domains.

Augmented Reality Knowledge Capture: Case Studies Across Commercial and Military Maintenance Applications

Irene and I will briefly cover the background of FARO Technologies, our hardware and software solutions and bring it full circle showing how you can use the power of laser scanning and integrate this into your VR/AR workflows and deliverables!

Laser Scanning, Point Clouds & Your Reality

Our RetroActivity system automatically builds computational models of a complex physical task, such as a maintenance activity, given only a handful of recorded demonstrations of the task. Once such a model is built, RetroActivity can finely track the job status from live video, to guide a worker through the task, provide independent training, and perform analytics. We enable ordinary AR developers to build AI-mediated feedback within hours, instead of requiring teams of specialized computer vision engineers who build temporal causation rules on top of 3rd-party visual recognition modules over months.

AI-Mediated Job Status Tracking in AR

Text localization and recognition in 3D
point cloud environment are challenging tasks. In this paper, we introduce
a method to adapt 2D text detection and recognition
techniques in panorama images with appropriate map-
ping; combined with some heuristic methodologies such
as artificial camera to create a fast and efficient 3D
text localization and recognition system. The simplistic nature of this system is attractive and computationally inexpensive because it focuses on 2D processing instead of 3D. The system shows promising results
with over 90% accuracy for detection, localization tasks
and 95% on recognition task.

NIWC Pacific, RESTORE Lab: “3D Localizations and Recognition of Text in Shipboard Point Cloud Data Using Corresponding 2D Images via Virtual Camera”

During this presentation we will expose our return on experience and identify key factors allowing AR application developers to focus on their application use cases and not on implementing the technology to make them work. With Unreal Engine's extensive support for XR platforms and devices, you can use Unreal Engine to deploy your project to any XR platform as well as utilize the immersive devices in your content creation pipeline. Epic Games is one of the founding members of the OpenXR Working Group along with the Khronos Group and industry partners. This multi-company group is working to solve XR fragmentation with a cross-platform standard.

Back to the mission : changing focus from the tech to the operational use cases.

Enabling Remote Creative Collaboration through VR and AI

"Today, video game technologies are evolving and moving to the cloud for computational capabilities and storage, not just multiplayer gaming. Commercial enterprises and government entities in particular are utilizing game engines such as Unity3D to build training mechanisms for staff. With the integration of Unity3D into these verticals, many of these applications need to integrate cloud technologies, such as storage, compute, internet of things (IoT) data streaming, AI/ML, and natural language processing, and there is a lack of plugins to rapidly connect prototypes to these platforms. This presentation will demonstrate one method to integrate into AWS services into a Unity3D application.
"

Premium content

Augmented Reality For Training: Case Study Air Force Maintenance Next

Downloads

Next from TEAR 3M 2021

ROV VR for Maintenance, Inspection, and Explosive Ordnance Disposal

Similar lecture

TEAR 3M Logistics

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES