HomeNewsArticle Display

AFRL 3-D audio research helps to make cockpit safer

Dr. Griffin Romigh tests 3-D audio software that spatially separates sound cues to mimic real-life human audio capabilities, Nov. 7, 2014 at Wright-Patterson Air Force Base, Ohio. The application allows operators in complex communication environments with multiple talking voices to significantly improve voice intelligibility and communication effectiveness. The technology, which consists primarily of software and stereo headphones, has potential low-cost, high-value application for both aviation and ground command and control communication systems. Romigh is a researcher at the Air Force Research Laboratory’s Human Effectiveness directorate, Battlespace Acoustics Branch.  (Air Force photo/Richard Eldridge)

Dr. Griffin Romigh tests 3-D audio software that spatially separates sound cues to mimic real-life human audio capabilities, Nov. 7, 2014, at Wright-Patterson Air Force Base, Ohio. The application allows operators in complex communication environments with multiple talking voices to significantly improve voice intelligibility and communication effectiveness. The technology, which consists primarily of software and stereo headphones, has potential low-cost, high-value application for both aviation and ground command and control communication systems. Romigh is a researcher at the Air Force Research Laboratory’s Human Effectiveness directorate, Battlespace Acoustics Branch. (Air Force photo/Richard Eldridge)

WRIGHT-PATTERSON AIR FORCE BASE, Ohio (AFNS) -- Imagine yourself in a cockpit, flying a mission, listening to a multitude of critical voices, delivering vital messages, all at the same time and from the same direction.

Now imagine the same environment, except that the voices are now distinct and separate, and you can not only define who they are and interpret what they are saying, but you can hear them as if you were at a party and having a conversation with one person, able to hear that person distinctly, above the noise of the party.

The Air Force Research Laboratory, Human Effectiveness directorate Battlespace Acoustics Branch, has developed 3-D sound technology that creates a sound environment that mimics the way the human body receives aural cues -- much like 3-D movies create the perception that the viewer is part of the movie.

The technology has proven so effective that recently the Air Force's Technology Transfer office collaborated with aviation audio control systems developer PS Engineering to give the company an exclusive use license, allowing PS Engineering to incorporate the multi-talker technology into their new audio system, the PMA450, for general aviation.

According to PS Engineering founder and CEO, Mark Scheuer, AFRL's technology allows the company's digital audio interface, IntelliAudio, to place two communication channels in various positions within the stereo headset, making simultaneous radio signals sound as if they are coming from different locations -- essentially a 3-D sound environment.

"The all-new (digital audio system) brings to the pilot a new invention, thanks to the cooperative efforts of the U.S. Air Force," Scheuer said.

The basis of the multi-talker technology has its history in the development of virtual audio display technology, according to former AFRL research scientist and key developer of the multi-talker technology, Dr. Douglas Brungart, the chief scientist, National Military Audiology and Speech Center at Walter Reed National Military Medical Center, Bethesda, Maryland.

During his career at AFRL and while a student at MIT, Brungart studied the way listeners perceive sounds that are located near the head, which eventually led to the discovery that listeners could easily separate voices that were close to the head and far from the head, even when both talkers were located in the same direction from the listener. The discovery made it possible to develop a technology application that would spatially separate sound sources in a multi-talker speech display.

That technology has been adopted by PS Engineering, and has potential application for a multitude of aviation and ground command and control systems, including air traffic control and remotely piloted vehicles.

"We've been excited about this technology for a long time, but previous applications have been limited by the relatively expensive hardware required to implement it," Brungart said. "However, as technology has advanced, the cost of implementing virtual audio has dropped dramatically."

According to Battlespace Acoustics technical advisor, Dr. Brian Simpson, spatial sound cue separation is critical to effective communication and speech intelligibility. Simpson and his team of researchers believe they have found a key to maximizing audio clarity by placing sound cues into a display that plays them so that they are perceived to be coming from different places -- the way humans listen to and perceive sound in reality.

"The improvement is tremendous," Simpson said. "You can achieve greater communication effectiveness, reduce workload and, importantly, improve overall safety in flight operations. Even highly trained pilots, who are used to listening to multiple channels, can benefit from this technology, and the more complex the environment, the greater this benefit will be."

The technology is also intuitive and easy to learn, low-cost and extremely high in value, Simpson added. The research team hopes to see it integrated into future Air Force and commercial capabilities.

"I feel like we're on the tipping point," Simpson said. "As soon as one flying community gets it, everyone else will want it."

Engage

Facebook Twitter
.@116ACW #Airmen have established communications for emergency services in Miller County, Ga., following… https://t.co/8mMny2vBR2
RT @BloombergTV: U.S. Air Force Secretary Heather Wilson is making her case for billions in funding that she says her service will need to…
#ICMYI: The #AtlasV successfully launched @45thSpaceWing carrying the @LockheedMartin #AEHF payload into orbit. War… https://t.co/SwJjApUn1T
It's been a week since #HurricaneMichael hit the #Florida panhandle and @TeamTyndall. Witness how #Airmen from sist… https://t.co/oMLU4NY3Uk
RT @NASA: Hear from @AstroHague as he answers your questions for the first time since his trip to @Space_Station was aborted last Thursday.…
#Airmen & families are entering @TeamTyndall to inspect living facilities & collect their belongings. All other are… https://t.co/Q5DrLeCCSR
RT @TeamTyndall: Chaplains, mental health experts, first sergeants, and other support agencies are preparing to receive Airmen returning to…
RT @HQUSAFEPA: "This is a sad day for the US & Ukraine. Our deepest condolences go out to the family, friends & fellow Airmen of both the U…
The #AirForce director of civil engineering praised #Airmen & our joint partners on their collaborative work during… https://t.co/nSQE09xwfZ
RT @LeeHudson_: #USAF officials say all of the #F22 aircraft left during the storm are repairable.
Now this is what #resilience looks like! With the support of #TotalForce #Airmen around the #AirForce,… https://t.co/oiLqSFcH0W
RT @HQUSAFEPA: We are aware of a Ukrainian Su-27UB fighter aircraft that crashed in the Khmelnytskyi region during Clear Sky 2018 today inv…
Phase two of @TeamTyndall recovery efforts has begun. #Airmen & dependents will have limited access to the base to… https://t.co/AVQQZf4RQP
This is the @USAF_ACC Crisis Action Team in action! Hundreds of #Airmen are working 24/7 to get @TeamTyndall the fo… https://t.co/NR2NBOWMAA
RT @TeamTyndall: Crews are working throughout Tyndall to clear roads, safe down powered lines and inspect buildings so Team Tyndall may ret…
Recovery efforts are currently underway at @TeamTyndall. This map will provide real-time information as facility as… https://t.co/E0ohjEOtJE
Visitors from the sky! For the first time in 51 years, @RamsteinAirBase #parajumpers dropped in on Chièvres Air Bas… https://t.co/LCptd76A0a
RT @Oriana0214: TONIGHT FROM MATTIS: "Right now the initial review yesterday by @SecAFOfficial, coming on 48 hours due by Air Combat Comman…