According to an article published on the breakingdefense website on November 29th, California based Red 6 is expected to integrate its augmented reality system (ATARS) with the T-38 trainer aircraft next year, laying the foundation for the US Air Force to train fighter pilots on how to engage in aerial combat with virtual enemies on real planes.

Red 6 founder and CEO Daniel Robinson stated in an interview on November 14th that the company is working to transform its airborne tactical augmented reality system from a prototype to a mature system that can be used in military aircraft.

1、 Overview of Airborne Tactical Augmented Reality System

The concept of Red 6 revolves around emerging augmented reality technology, which overlays virtual elements onto the real environment that users can physically see. Its prototype ATARS system is being integrated with the T-38 for training fighter pilots before operating F-16, F-15, F-22, or F-35 fighter jets. If successful, this technology could provide the US Air Force with a more cost-effective way for pilots to engage in combat with the enemy without relying on specialized "imaginary enemy" pilots to play the role of opponents.

The ATARS system includes a customized augmented reality headset installed on a standard HGU-55 helmet, as well as hardware that plugs into the aircraft itself and tracks the pilot's head through space. Red 6 has built a prototype system for its Berkut 540 test aircraft and conducted multiple demonstration tests under a small business innovation research contract with the Air Force Innovation Center AFWERX.

2、 Challenges and Problems

The system faces many challenges when modified on the T-38. One is whether the onboard hardware can withstand the daily operating environment, as well as whether it can adapt to the size, weight, power, and cooling limitations brought by the trainer aircraft installed in the 1960s.

The second challenge is security. Daniel Robinson stated, '; Both the theory and ground prototype indicate that the technology is feasible, but when integrated into military aircraft with human involvement, additional considerations need to be given to all safety issues that exist& quot; For example, modifications to the T-38 pilot helmet may increase weight and volume. This means that the new helmet must undergo ejection seat testing to ensure that pilots do not pose additional risks of head, neck, or spine injuries when ejected in emergency situations.

The third challenge is data encryption and latency. The research team led by Todd Creek, Chief Technology Officer of Red 6, is leading the militarization of the company's augmented reality system. Once the system is integrated with the T-38, the US Air Force and Red 6 Corporation will begin ground and flight testing of it. Ultimately, the goal is to verify that multiple trainer aircraft can operate in the same augmented reality world, fighting against the same virtual opponent without delay or technical failure, while still maintaining secure transmission of sensitive data. Robinson stated that encrypting sensitive data will also affect latency, and how to ensure both sensitive data security and low latency is also one of the challenges faced by the project team.

3、 Experimental Status and Prospects

Earlier this month, Red 6 conducted its final demonstration for AFWERX: a one-on-one battle where its Berkut 540 test aircraft formed formations with an augmented reality version of the F-22 to engage in aerial combat with opponents. This experiment is the first time that a virtual wingman and an opponent have simultaneously projected onto the operator's helmet interface. In this experiment, Robinson stated that the F-22 generated by virtual reality technology can fly autonomously and make autonomous decisions, and adopt two to one tactics based on the actions of manually operated aircraft.

At present, the US Navy has participated in the latest AFWERX demonstration and is also quite interested in this technology. Red 6 expects that in the near future, the Navy will sign a small business innovation research contract to develop a Navy aviation specific type of its augmented reality trainer.

In the future, Red 6 Company will develop an aircraft carrier takeoff and landing training system based on augmented reality technology. Simulating aircraft carrier takeoff and landing at high altitude reduces the risk for pilots and minimizes wear and tear on fighter jets. This technology has low-cost training capabilities and is of great value to the navy.

Source: Global Aviation Information