Warfighter Situational Awareness

We at Envision understand the need for sensor fusion especially in battlefield combat or any situation that would require advanced graphical situational awareness. We therefore designed an experience that can either run in Virtual Reality (VR), for training and simulation, or in Augmented Reality (AR), for real-world operation using ruggedized wearable AR technology. The solution can plot known sniper and land mine locations, possibly collected by drone data, and alert the user how to avoid the geographic area of hazard. The following photo of our design illustrates this solution in AR which is beneficial to both the defense and intelligence communities. We are experimenting with 5G technology to transfer real time information to a wearable headset as illustrated below in the diagram. 

Envision’s Warfighter Situational Awareness Example

Military Vehicle Maintenance Training

Envision understands the need for proper military vehicle maintenance procedures. Therefore we designed a VR experience that takes student trainees through a virtual Stryker for a general high-level inspection routine. We have the capability to implement a full list of inspection procedures upon customer request. Additionally we have the capability to implement interactive checklists that forces student trainees to perform the inspection procedures with their real hands while inside the VR experience. This acts as a comprehensive familiarization tool so that student trainees optimize their time in expensive and resource-limited physical simulators or while performing real maintenance on such vehicles.

Additionally we have the capability to design and develop AR software for vehicle maintenance inspectors to utilize while in the field. The inspector would either need to use a wearable headset, smartphone or tablet with a rear-facing camera to enable the AR experience. Three levels of support are possible. First are pre-loaded instructions and 3D animations of inspection procedures. Second is the ability for machine learning and Artificial Intelligence (AI) to supplement the inspectors AR experience with common problems and issues based on past-collected data. Third is the ability to summon a Subject Matter Expert (SME) to walk the inspector through the maintenance procedures. If the inspector is utilizing an AR wearable, like the Microsoft Hololens for example, then both of their hands are free to work while receiving the instruction. The following app footage video shows the VR IAV Stryker Maintenance Simulator we developed as a POC for the US ARMY.

Envision’s VR IAV Stryker Maintenance Simulator

Avionics Simulation

XR can be used for training, simulation and real-time maintenance of any technology no matter how complex. Our technology provides unparalleled instruction and hands-on learning in a distraction-free environment. Complex avionics systems benefit from our living eXtended Reality (XR) solutions as legacy paper documentation and 2D illustrations become obsolete. Remote AR assistance significantly reduces the time and cost of assessment and repair of avionics networks both on the ground and or in the air.

Envision’s XR Lead Solutions Architect, Jonathan Carr, demonstrates an avionics maintenance experience in VR.