United States

Due to the adoption of additive manufacturing, virtual reality, and 3D scanning technologies within the DoD, the sharing of sensitive and controlled 3D data has become more common and prevalent than ever. Especially for DoD assets, the integrity of the 3D data being shared is paramount. Discussed here are steganography solutions for 3D data that address some of the new data sharing problems that the DoD is facing. The methods discussed focus on meshes (for 3D printing applications) and point clouds (for large scale scanning documentation), but could be adapted to new formats.

TEAR 3M 2021

RESTORE Lab: Implementation and Applications of Steganography to 3D Data Distribution

mesh

3d data

point cloud

steganography

Brought to you by **National Defense Industrial Association ([NDIA](https://www.google.com/url?q=https%3A%2F%2Fwww.ndia-sd.org%2F&sa=D&sntz=1&usg=AFQjCNHj_BQx1K4KVKKp1NTIsAltZOG9Vg))** and hosted by the **Battlespace Exploitation of Mixed Reality ([BEMR](https://cdn.dvidshub.net/media/video/2101/DOD_108139354/DOD_108139354-1024x576-1769k.mp4)) Lab**, at **Naval Information Warfare Center Pacific ([NIWC PAC](https://www.google.com/url?q=https%3A%2F%2Fwww.public.navy.mil%2Fnavwar%2FNIWC-Pacific%2FPages%2Fdefault.aspx&sa=D&sntz=1&usg=AFQjCNFNS160IEsocfaBrnCNB3u7NqLHPw))**, and welcoming academia, government/DOD, and industry leaders who support Industrial Augmented Reality/Virtual Reality by using the following technologies:   


* Augmented Reality (AR) / Virtual Reality (VR)

* 2D/3D displays

* mobile displays

* wearables

* any other "immersive" technology

### In all fields that touch:

* 3D modeling

* Manufacturing 

* Installations 

* Maintenance and Repairs

* Construction

* Logistics

* Additive manufacturing

* Training

The technical exchange is a two day event held online this year due to COVID-19. It will feature two days of oral presentations, demonstrations, and posters from leaders in AR/VR and other display technologies, including government briefings on active projects within the DOD. The technical exchange is unclassified and we welcome participation from the Navy, DoD as well as from industry and academia. 

The goals of TEAR 3M are:

*  To spread awareness of current immersive technology research relevant to Navy/DOD applications

*  To connect AR researchers with experts in DOD to learn about needs and requirements

*  To build and strengthen collaborations within the DOD research community

![](https://assets.underline.io/uploads/markdown_image/1/image/0c13ac0ffa096b2353573964d8b89789.png)

TEAR 3M General Chairs:

Heidi Buck,  Director @ BEMR Lab, Naval Information Warfare Center, Pacific

Lauren Burnette, BEMR Lab, Naval Information Warfare Center, Pacific


For more information, contact Lauren and Heidi at:  tear3m@spawar.navy.mil

Questions regarding sponsorship/registration contact:  ndiasd@sandiegositepros.com

Conference host POC is Tammy Sanchez (NDIA):  tamsanch@cisco.com

technical paper

The DoD is playing catch up with industry but we are seeing significant positive results from the Open Topic initiative.

AFVentures overview of Open Topic SBIR/STTR

In order to be effective in the field, the military trains warfighters. The goals of training are for the warfighter to learn (1) vehicle and weapon operations and dynamics (e.g., how the vehicle and gun turret work and “feel”) in live tactical situations and (2) how to effectively coordinate with team members and joint operations.

The military employs both live and virtual reality training to achieve these goals. Live training, especially gunnery, requires significant facilities and range infrastructure and is also limited to specific sites due to safely restrictions. Unfortunately, live training is expensive. In this work, augmented reality based training systems are presented. The trainees are able to walk and drive on physical terrain and engage virtual entities for tactical and gunnery training. By augmenting the real world using virtual entities and effects, along with existing training aids and devices, training anywhere and anytime is enabled.

We present three systems in this talk to address the training challenges. First, AR-unaided eye is a head mounted Augmented Reality (AR) system that allows dismounts to train. Second, AR-binoculars is a set of fixed-zoom optical sights that enable stable AR insertions at long ranges. Third, AR-Stryker is a vehicle-borne AR training system for augmenting the views of the driver, commander, and gunner. All of the systems rely on inertial measurements, cameras, and GPS to provide jitter free, real-time pose estimation. Synthetic targets (e.g., dismounts, technical, target) are rendered. We will share system hardware details and video samples of the AR renderings.

Augmented Reality Training for Forward Observers and Vehicles

Welcome to SOFWERX! A non-profit, partnered with the United States Special Operations Command (USSOCOM), in a mission to solve challenging problems for the Warfighter. Through collaboration, thought leadership, and rapid prototyping, our team ultimately helps deliver innovative technologies to the SOF soldier. With the assistance of USSOCOM, Innovators, Academia, and National labs we ensure best-of-breed capabilities are making it into the hands of Nation’s heroes.

How to Engage with SOFWERX and USSOCOM

Lockheed Martin’s (LM) Missile and Fire Control (MFC) is exploring model-based advanced visualization environments designed to holistically cover Engineering, Manufacturing, and Sustainment life cycle use-cases. Future affordability is key as the advanced visualization teams work towards maintaining customer flexibility and security requirements, analyzing interoperability between software toolsets and hardware platforms, pushing for open data standards, and necessitating open-architecture frameworks to minimize vendor or point-solution obsolescence impacts.

Lockheed Martin MFC – A Holistic Approach for Advanced Visualization Implementations

Use of augmented reality paired with a backend of electrical signaling emulation for use with diagnostics procedures to enhanced the ability for real-time fault detection, reduction of ambiguity groups and reducing reliance on pre-authored specific diagnostic procedures. Use of defined algorithms to compare expected signal state emulation of a system to real-time sensor data state through use of augmented reality headset sensors and embedded diagnostics to validate the dynamic changes and determine fault conditions and increase chances that the first repair actions will fix the system.

Augmented Reality With Electrical Emulation for Diagnostics

Today we are already seeing vision based Artificial Intelligence (AI) systems being developed throughout defense. In autonomous vehicles we see that there are systems that can take video and other sensor information and detect objects, signs and lane markings. In robotics systems have to use perception to understand their environment so they can safely interact with humans and recognize components and products that they are going to manipulate. In aircraft maintenance training systems there is the need to replace manual aircraft inspections to identify components that need repair. Finally, we also see vision based AI systems in force protection where we can identify anomalous behavior and potential threats on the stream of massive data that we have collected. This presentation will start by going over the different challenges associated with computer vision applications for Augmented Reality (AR) today. It will then introduce you to Unity Perception. Highlighting what is it, what it does, and why AR based computer vision applications can benefit from it. Then it will provide a short overview of an AR iPad application customer use case Unity worked on. Lastly, it will wrap up with where Unity can take Unity Perception in the future. 



Unity Computer Vision

To address the Navy's need for cross-domain transition goggles with an integrated, illuminated display, Intellisense Systems, Inc. is developing a new Transition Wide-Angle Goggles with Integrated Illuminated Display (TWIGIID) based on an innovative design that uniquely integrates an ellipsoidal visor with reflective coating, free-form plastic-molded optics, and high resolution miniature microdisplays. The use of ellipsoidal reflectors provide wide Field-of-View; (FOV) distortion-free collimation; and free-form surface design to correct the geometrical distortion over swim goggles. Water-proof sealing of the microdisplay and electronics allows seamless transition between underwater and above-water operation. Use of a passive coating and purging with dry gas enables the small goggles to be cleared if flooded with water, to equalize pressure as needed, and to be fog-free. The proposed TWIGIID device will have revolutionary new capabilities in Augmented Reality (AR) visualization, with an extremely light and low-profile goggles integrated display, that will be producible at low cost. By providing these new capabilities, the TWIGIID device can help provide the Navy, Air Force, Marine Corps, and other military forces with enhanced situational awareness and capabilities.

Transition Wide-Angle Goggles with Integrated Illuminated Display

The digital revolution can no longer be ignored, the warfighter requires real-time access to fully interactive digital twins in support of their specific mission. Using automation digital twins can be created rapidly and affordably for every DoD weapon system in support of design, training, and logistics.

Digital Twins for the Warfighter

Mixed Reality is evolving rapidly with ever increasing examples of successful operational deployment and growing confidence in the maturity of Mixed Reality solutions to support a range of analytics, training, and operational functions and deliver the operational effect and efficiencies that were predicted. Sensor data and AI integration in mixed reality will provide new way to interact with and explore sensed environmental and geo-spatial data, as well as high-resolution imagery enabling increased autonomy for remotely deployed operators, while retaining the capacity to reach back and collaborate with experts to support analysis, decision making and mission planning and rehearsal.

Operational Remote Support

There is immense pressure to improve the effectiveness and quality of maintainer training with a direct correlation between maintenance efficiency and operational readiness. The spread and acceptance of virtual and augmented reality technologies have made these capabilities a must-have for training personnel.

These technologies immerse and engage students, reinforce proper techniques, save on equipment wear and tear, enabling students to train at their own pace, and improve the safety and efficiency of training in a safe environment.

VE mentor allows developers to easily transition training content from the classroom to the hands-on experience in augmented reality on HoloLens 2 and mobile devices. At the same time, VE Mentor allows content authored on the “flight-line” to flow back into the classroom, closing the loop on providing efficient and effective maintenance training.

This presentation will discuss utilizing Mixed-Reality technology to keep classroom training current, efficient, and comprehensive.


Premium content

Downloads

Next from TEAR 3M 2021

AFVentures overview of Open Topic SBIR/STTR

Similar lecture

NIWC Pacific, RESTORE Lab: “3D Localizations and Recognition of Text in Shipboard Point Cloud Data Using Corresponding 2D Images via Virtual Camera”

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES