United States

David Watters and Anthony Duca discuss the different technologies and methods used to rapidly scan objects, spaces, and larger geographies into a virtual space for remote, real-time collaboration, with full spatial co-presence, for planning, training, and visualization using Desktop 3D, XR headsets, and mobile solutions.

TEAR 3M 2021

Transform How You Plan: Rapid Scanning and Collaborative XR Visualization

platform

command

co-presence

photogrammetry

sanning

training

virtual

cloud

lidar

spatial

simulation

planning

collaboration

control

visualization

Brought to you by **National Defense Industrial Association ([NDIA](https://www.google.com/url?q=https%3A%2F%2Fwww.ndia-sd.org%2F&sa=D&sntz=1&usg=AFQjCNHj_BQx1K4KVKKp1NTIsAltZOG9Vg))** and hosted by the **Battlespace Exploitation of Mixed Reality ([BEMR](https://cdn.dvidshub.net/media/video/2101/DOD_108139354/DOD_108139354-1024x576-1769k.mp4)) Lab**, at **Naval Information Warfare Center Pacific ([NIWC PAC](https://www.google.com/url?q=https%3A%2F%2Fwww.public.navy.mil%2Fnavwar%2FNIWC-Pacific%2FPages%2Fdefault.aspx&sa=D&sntz=1&usg=AFQjCNFNS160IEsocfaBrnCNB3u7NqLHPw))**, and welcoming academia, government/DOD, and industry leaders who support Industrial Augmented Reality/Virtual Reality by using the following technologies:   


* Augmented Reality (AR) / Virtual Reality (VR)

* 2D/3D displays

* mobile displays

* wearables

* any other "immersive" technology

### In all fields that touch:

* 3D modeling

* Manufacturing 

* Installations 

* Maintenance and Repairs

* Construction

* Logistics

* Additive manufacturing

* Training

The technical exchange is a two day event held online this year due to COVID-19. It will feature two days of oral presentations, demonstrations, and posters from leaders in AR/VR and other display technologies, including government briefings on active projects within the DOD. The technical exchange is unclassified and we welcome participation from the Navy, DoD as well as from industry and academia. 

The goals of TEAR 3M are:

*  To spread awareness of current immersive technology research relevant to Navy/DOD applications

*  To connect AR researchers with experts in DOD to learn about needs and requirements

*  To build and strengthen collaborations within the DOD research community

![](https://assets.underline.io/uploads/markdown_image/1/image/0c13ac0ffa096b2353573964d8b89789.png)

TEAR 3M General Chairs:

Heidi Buck,  Director @ BEMR Lab, Naval Information Warfare Center, Pacific

Lauren Burnette, BEMR Lab, Naval Information Warfare Center, Pacific


For more information, contact Lauren and Heidi at:  tear3m@spawar.navy.mil

Questions regarding sponsorship/registration contact:  ndiasd@sandiegositepros.com

Conference host POC is Tammy Sanchez (NDIA):  tamsanch@cisco.com

technical paper

An overview of NIWC PACIFIC and the BEMR Lab, to include a discussion on the Navy's digital transformation and how mixed reality is going to play a role in it.

Mixed Reality's Role in the Navy's Digital Transformation

Once an augmented reality strategy is selected, it is critical that early deployments are successful in order to reach scale. This presentation will share best practices that Scope AR has deployed with their customers in a prescriptive way, in order to manage expectations, and successfulle reach the desired outcomes.

Flattening the HypeCycle With AR

The Virtual Equipment Environment (V2E) is a government-owned (GOTS) parts assembly and disassembly engine that allows us to easily virtualize your existing CAD models, tech manuals, or training material into a virtual immersive trainer.



NIWC Pacific, BEMR Lab:” Virtual Equipment Environment (V2E)”

HyperTunnel® is a mixed reality (MR) remote collaboration system that enables front-line workers to summon an expert in a different location into a real time, immersive and shared digital twin to collaborate, provide guidance and instructions on the task at hand. The system also serves as a training and simulation environment. 

The solution provides the following capabilities: 
• Scan Remote Worksite: Leverage input from scanners, cameras, microphones and other sensors that might be available at the remote worksite.
• Create Digital Twin at HQ: captured data is used to reproduce a real-size immersive digital representation of the worksite at a central location.
• Match / Enhance shared Scenes: AR remote worksites and VR digital twins are synched, tracked and enhanced by AI focusing on relevant objects and actions.
• Annotate and Demonstrate: Immersed users can place virtual objects and annotations, provide guidance and demonstrate actions in the shared space.

HyperTunnel - Teleporting Expertise Anywhere

The DoD and its branches face a convergence of challenges. As trusted career experts and depot artisans retire in increasing numbers, product variety and complexity accelerate. Traditional methods for scaling expertise are no longer sufficient. But there are companies who are innovating—overcoming these challenges to increase service quality and efficiency. How are they doing it?

Turning Maintenance Challenges into Opportunities with AR

Spatial is cross platform collaboration solution currently used by the DOD and IC to enable distributed intelligence briefings. This talk will elaborate on Spatial's background, how the solution works, and how it is currently being deployed by the DOC/IC, particularly in light of the mandate for Distributed Operations and the rise of telework during Covid. 



Spatial - Distributed Intelligence Briefings and the Virtual Command Post

Despite the fairly smooth progression of all the other elements of the VR ecosystem….operating systems, headsets, PCs, enterprise applications and games……creating true natural walking in VR has sat largely unaccomplished until recently. The last several years have seen several solutions for locomotion in VR including the introduction of a true omnidirectional treadmill finally providing the ability for true and natural walking. This capability provides for an immense number of use cases in the military, mainly under the umbrella of training. Training for combat is one of the most obvious though we also see training use cases for aircraft maintenance, aircraft cargo loading, pre-flight inspection training, naval ship docking training, infantry training as well as the multitude of military medical rehabilitation use cases. This talk will focus on many of the current use cases for the omnidirectional treadmill across the various branches of the military.

The many military use cases for natural walking in VR using an omnidirectional treadmill.

The technology enabling Extended Reality (XR), the combination of Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR), is rapidly advancing where just a few years ago the primary challenge revolved around the ability to render graphics at framerates and latencies needed for virtual reality. In 2021, with many powerful graphics cards “VR Ready” the next set of challenges will remarkably broaden the potential of XR. While GPU power will continue to increase well into the future, the major driver in 2021 will come from the profound impact of combining the idea of disaggregated graphics or “split-rendering” from the cloud and All-In-One (AIO) devices. Powered by ease of use and low cost, AIOs are fundamentally changing the XR adoption curve. The emergent trend of coupling AIOs with the increasing availability of edge computing via high performance networks will reinvent “where” XR is served from. For instance, training applications, requiring more realistic environments, will move from on-headset compute to datacenter servers inside low-latency private networks. The tools enabling XR experiences to be driven from the datacenter will also enable the market to move more and more use cases to the Cloud, including collaborative design, maintenance, and a variety of healthcare scenarios.

071: Streaming XR: the new era of light weight, all-in-one devices delivering high end graphics and compute.

This Navy ManTech project, funded under ONR contract N00014-15-D-5003, focuses on the development of a head-mounted display (HMD) and high-dynamic-range (HDR) camera system to improve visualization for manual welding. We selected and integrated HDR cameras with a variety of head-mounted displays and used real-time image processing to produce a variety of working prototypes. In coordination with a subcontractor, we preformed evaluations in Pascagoula, MS.

Guided by the results of shipyard testing and additional optical evaluation, we selected and evaluated a number of candidate cameras and HMDs based on dynamic range, resolution, frame rate, latency, and suitability for wearing over an extended time period. The final system emphasizes visibility of the weld pool while also providing situational context to the welder.

Premium content

Transform How You Plan: Rapid Scanning and Collaborative XR Visualization

Downloads

Next from TEAR 3M 2021

Mixed Reality's Role in the Navy's Digital Transformation

Similar lecture

Enabling 3D Geospatial for AR/VR

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES