SALSA Initiative Looks To Automate Live Audio Mixing Process

Fairlight is collaborating with DTS and the University of Salford, located in Manchester, UK, to develop a new approach to assist sound engineers with live sports productions.

Collectively, the group said the Spatial Automated Live Sports Audio (SALSA) solution is a real-time automated mixing process that identifies the location of specific sound events from a grid of pitch microphones. The algorithm, developed by the University of Salford, identifies the type of sound event, its 3D location, and its duration, and automatically drives console fader movements to open the relevant mic(s). This real-world solution came to life when SALSA was combined with the object-based audio live production system co-developed by DTS and Fairlight.

Leaving pitch microphones at a fixed level can result in off-pitch crowd noise masking on-pitch sounds in the broadcast mix. With the introduction of even more mics and immersive object-based audio, it will become even more challenging to manually create the best possible mix.

SALSA helps address this problem by allowing different game sounds, such as ball kicks and referee whistles, to be processed automatically by the mixing console. SALSA can be adapted to search for different sounds, allowing the automated mixing to be applied to different sports.

A new algorithm, developed by the University of Salford, identifies the type of sound event, its 3D location, and its duration, and automatically drives console fader movements to open the relevant mic(s) on cue.

A new algorithm, developed by the University of Salford, identifies the type of sound event, its 3D location, and its duration, and automatically drives console fader movements to open the relevant mic(s) on cue.

By choosing to use the open object-based audio standard MDA (ETSI 103-223: Multi-Dimensional Audio), SALSA was able to easily be integrated by Fairlight into their next-generation live production systems, supporting both conventional and object-based broadcasts.

“By combining cutting edge technology from our three organizations, the SALSA project automatically translates pitch mics into 3D audio objects,” said Tino Fibaek, Chief Technical Officer at Fairlight. “This allows broadcast mix engineers to focus on the overall mix, whilst the system does the hard labour of extracting the best possible sound from the pitch for sports aficionados.”

“We believe our SALSA software will bring a step-change in the quality of broadcast audio for sports and we’re excited to be working with Fairlight and DTS to showcase its capabilities in a practical work-flow,” said Dr. Rob Oldfield, Audio Research Consultant from the University of Salford.

“We are delighted to see this collaboration come together to create real innovation for the live broadcast community,” said Fadi Malak, Director of Corporate Strategy at DTS, Inc. “Combining the algorithm from the University of Salford with MDA was a natural fit. It really helped showcase the true potential of the ETSI standard.”

At NAB 2016, SALSA was demonstrated as part of a complete outside broadcast production workflow, from capture to reproduction. SALSA-identified objects were shown being extracted from the mix by the 3DAW system in Fairlight’s EVO.Live mixing console, and packaged into a linear MDA bitstream for contribution over SDI.

Let us know what you think…

Log-in or Register for free to post comments…

You might also like...

Your Guide to Understanding IP

See that hill up ahead? It’s not a hill, it’s Mt Everest and your job is to conquer that mountain. Rendered into familiar industry vernacular, you, video engineer, are charged with building an IT-centric facility. A SMPTE standard was…

A Conversation with Up-and-Coming Audio Mixer Sean Prickett

In this interview, we meet Sean Prickett – a “young gun” audio mixer that’s making a name for himself on some of TV’s most high-profile live and audition shows. Most recently, Sean was A1 for the live-broadcast finals of the CBS r…

Articles You May Have Missed – October 25, 2017

Any new media or production and playout center must be built leveraging the latest in IP-centric technology. Here are two articles that examine the latest technology being installed in live broadcast and playout applications and OB trucks. Combined, the articles…

Award-Winning TV Mixer: My Journey With SSL’s System T

[Editor’s Note: Kevin Duff is an award-winning live television sound supervisor and dubbing mixer with over 30 years of industry experience on some of the largest TV productions. Here he provides a first-hand account of using the Solid State Logic S…

RTL’s New Luxembourg Headquarters is an IP Broadcast Game Changer

In a time of uncertainty among many parts of the broadcast industry, Broadcasting Center Europe (BCE), part of the RTL Group, a Luxembourg-based media conglomerate that operates TV and radio channels as well as production companies located throughout Europe and…