United States

The presentation summarizes the results from an exploratory multi-year investigation of two-person team performance on a shared mission planning scenario when using HoloLens devices compared to a more traditional 2D tabletop display. The augmented reality visualization technology used to create the shared scene is described, as well as, the study setup and mission planning scenario implementation. An overview of end-user team results focused on perceived teaming efficacy and performance, and self-reported mental demand and frustration related to device use is discussed.

TEAR 3M 2021

Observations from a collaborative AR mission planning study

end-user study

mission planning

collaborative visualization

augmented reality

Brought to you by **National Defense Industrial Association ([NDIA](https://www.google.com/url?q=https%3A%2F%2Fwww.ndia-sd.org%2F&sa=D&sntz=1&usg=AFQjCNHj_BQx1K4KVKKp1NTIsAltZOG9Vg))** and hosted by the **Battlespace Exploitation of Mixed Reality ([BEMR](https://cdn.dvidshub.net/media/video/2101/DOD_108139354/DOD_108139354-1024x576-1769k.mp4)) Lab**, at **Naval Information Warfare Center Pacific ([NIWC PAC](https://www.google.com/url?q=https%3A%2F%2Fwww.public.navy.mil%2Fnavwar%2FNIWC-Pacific%2FPages%2Fdefault.aspx&sa=D&sntz=1&usg=AFQjCNFNS160IEsocfaBrnCNB3u7NqLHPw))**, and welcoming academia, government/DOD, and industry leaders who support Industrial Augmented Reality/Virtual Reality by using the following technologies:   


* Augmented Reality (AR) / Virtual Reality (VR)

* 2D/3D displays

* mobile displays

* wearables

* any other "immersive" technology

### In all fields that touch:

* 3D modeling

* Manufacturing 

* Installations 

* Maintenance and Repairs

* Construction

* Logistics

* Additive manufacturing

* Training

The technical exchange is a two day event held online this year due to COVID-19. It will feature two days of oral presentations, demonstrations, and posters from leaders in AR/VR and other display technologies, including government briefings on active projects within the DOD. The technical exchange is unclassified and we welcome participation from the Navy, DoD as well as from industry and academia. 

The goals of TEAR 3M are:

*  To spread awareness of current immersive technology research relevant to Navy/DOD applications

*  To connect AR researchers with experts in DOD to learn about needs and requirements

*  To build and strengthen collaborations within the DOD research community

![](https://assets.underline.io/uploads/markdown_image/1/image/0c13ac0ffa096b2353573964d8b89789.png)

TEAR 3M General Chairs:

Heidi Buck,  Director @ BEMR Lab, Naval Information Warfare Center, Pacific

Lauren Burnette, BEMR Lab, Naval Information Warfare Center, Pacific


For more information, contact Lauren and Heidi at:  tear3m@spawar.navy.mil

Questions regarding sponsorship/registration contact:  ndiasd@sandiegositepros.com

Conference host POC is Tammy Sanchez (NDIA):  tamsanch@cisco.com

technical paper

Please join Elysium Inc. as we share the steps taken during the Laser Scan to CAD Analysis NSRP project to improve our solution, InfiPoints, to meet the requirements of the industry. InfiPoints offers an inclusive solution which supports multiple CAD and point cloud formats, pre-processing, simulation, and modeling within one software. Through the efforts of the project, InfiPoints now offers enhanced validation capabilities and new functionality to extract the label plates of scanned equipment. By combining these enhancements, users can efficiently identify differences between the model and the environment, as well as validate if the equipment in the environment matches the equipment designated in the digital twin by providing users with text information of scanned label plates.

NSRP Project: Laser Scan to CAD Analysis

Headwall is a patent pending technology that utilizes standard AV infrastructure to virtualize the command center video wall. The presentation will explore

Headwall: Augmented Reality Video Wall for Command Centers and Watchfloors

Due to the adoption of additive manufacturing, virtual reality, and 3D scanning technologies within the DoD, the sharing of sensitive and controlled 3D data has become more common and prevalent than ever. Especially for DoD assets, the integrity of the 3D data being shared is paramount. Discussed here are steganography solutions for 3D data that address some of the new data sharing problems that the DoD is facing. The methods discussed focus on meshes (for 3D printing applications) and point clouds (for large scale scanning documentation), but could be adapted to new formats.

RESTORE Lab: Implementation and Applications of Steganography to 3D Data Distribution

The DoD is playing catch up with industry but we are seeing significant positive results from the Open Topic initiative.

AFVentures overview of Open Topic SBIR/STTR

In order to be effective in the field, the military trains warfighters. The goals of training are for the warfighter to learn (1) vehicle and weapon operations and dynamics (e.g., how the vehicle and gun turret work and “feel”) in live tactical situations and (2) how to effectively coordinate with team members and joint operations.

The military employs both live and virtual reality training to achieve these goals. Live training, especially gunnery, requires significant facilities and range infrastructure and is also limited to specific sites due to safely restrictions. Unfortunately, live training is expensive. In this work, augmented reality based training systems are presented. The trainees are able to walk and drive on physical terrain and engage virtual entities for tactical and gunnery training. By augmenting the real world using virtual entities and effects, along with existing training aids and devices, training anywhere and anytime is enabled.

We present three systems in this talk to address the training challenges. First, AR-unaided eye is a head mounted Augmented Reality (AR) system that allows dismounts to train. Second, AR-binoculars is a set of fixed-zoom optical sights that enable stable AR insertions at long ranges. Third, AR-Stryker is a vehicle-borne AR training system for augmenting the views of the driver, commander, and gunner. All of the systems rely on inertial measurements, cameras, and GPS to provide jitter free, real-time pose estimation. Synthetic targets (e.g., dismounts, technical, target) are rendered. We will share system hardware details and video samples of the AR renderings.

Augmented Reality Training for Forward Observers and Vehicles

Welcome to SOFWERX! A non-profit, partnered with the United States Special Operations Command (USSOCOM), in a mission to solve challenging problems for the Warfighter. Through collaboration, thought leadership, and rapid prototyping, our team ultimately helps deliver innovative technologies to the SOF soldier. With the assistance of USSOCOM, Innovators, Academia, and National labs we ensure best-of-breed capabilities are making it into the hands of Nation’s heroes.

How to Engage with SOFWERX and USSOCOM

Lockheed Martin’s (LM) Missile and Fire Control (MFC) is exploring model-based advanced visualization environments designed to holistically cover Engineering, Manufacturing, and Sustainment life cycle use-cases. Future affordability is key as the advanced visualization teams work towards maintaining customer flexibility and security requirements, analyzing interoperability between software toolsets and hardware platforms, pushing for open data standards, and necessitating open-architecture frameworks to minimize vendor or point-solution obsolescence impacts.

Lockheed Martin MFC – A Holistic Approach for Advanced Visualization Implementations

Use of augmented reality paired with a backend of electrical signaling emulation for use with diagnostics procedures to enhanced the ability for real-time fault detection, reduction of ambiguity groups and reducing reliance on pre-authored specific diagnostic procedures. Use of defined algorithms to compare expected signal state emulation of a system to real-time sensor data state through use of augmented reality headset sensors and embedded diagnostics to validate the dynamic changes and determine fault conditions and increase chances that the first repair actions will fix the system.

Augmented Reality With Electrical Emulation for Diagnostics

Today we are already seeing vision based Artificial Intelligence (AI) systems being developed throughout defense. In autonomous vehicles we see that there are systems that can take video and other sensor information and detect objects, signs and lane markings. In robotics systems have to use perception to understand their environment so they can safely interact with humans and recognize components and products that they are going to manipulate. In aircraft maintenance training systems there is the need to replace manual aircraft inspections to identify components that need repair. Finally, we also see vision based AI systems in force protection where we can identify anomalous behavior and potential threats on the stream of massive data that we have collected. This presentation will start by going over the different challenges associated with computer vision applications for Augmented Reality (AR) today. It will then introduce you to Unity Perception. Highlighting what is it, what it does, and why AR based computer vision applications can benefit from it. Then it will provide a short overview of an AR iPad application customer use case Unity worked on. Lastly, it will wrap up with where Unity can take Unity Perception in the future. 



Unity Computer Vision

To address the Navy's need for cross-domain transition goggles with an integrated, illuminated display, Intellisense Systems, Inc. is developing a new Transition Wide-Angle Goggles with Integrated Illuminated Display (TWIGIID) based on an innovative design that uniquely integrates an ellipsoidal visor with reflective coating, free-form plastic-molded optics, and high resolution miniature microdisplays. The use of ellipsoidal reflectors provide wide Field-of-View; (FOV) distortion-free collimation; and free-form surface design to correct the geometrical distortion over swim goggles. Water-proof sealing of the microdisplay and electronics allows seamless transition between underwater and above-water operation. Use of a passive coating and purging with dry gas enables the small goggles to be cleared if flooded with water, to equalize pressure as needed, and to be fog-free. The proposed TWIGIID device will have revolutionary new capabilities in Augmented Reality (AR) visualization, with an extremely light and low-profile goggles integrated display, that will be producible at low cost. By providing these new capabilities, the TWIGIID device can help provide the Navy, Air Force, Marine Corps, and other military forces with enhanced situational awareness and capabilities.

Premium content

Observations from a collaborative AR mission planning study

Downloads

Next from TEAR 3M 2021

NSRP Project: Laser Scan to CAD Analysis

Similar lecture

Mixed Reality (MR) with Robotic Automation for Quality Inspection & Maintenance

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES