Avid On The Forefront Of AI

Avid has forged the path toward implementation of Artificial Intelligence in post-production, and their use of AI is just beginning.

Artificial Intelligence (AI) is making major inroads to post-production, and nowhere more significantly than in Avid’s editing systems.

When speaking with David Colantuoni, vp of product management at Avid, I started by asking how he would define what AI is.

ScriptSync matches each source clip to its associated line in the script.

ScriptSync matches each source clip to its associated line in the script.

“In the Media and Entertainment context, we look at AI as using machine learning to reach out to massive amounts of data and streamlining it so it can become practical to use it in productions,” he began. “In addition, it is used to relieve humans of repetitive procedures by letting computers supervise automated tasks.”

And Avid has been in the forefront of putting these concepts to good use.

“We’ve had AI functionality in our systems for many years,” Colantuoni said, “with our ScriptSync and PhraseFind features that let an editor search for spoken words in a general phonetically indexed database. We were using AI before the expression came into general usage.”

PhraseFind allows editors to search their Media Composer project phonetically – that is, by the sounds of the words.

PhraseFind allows editors to search their Media Composer project phonetically – that is, by the sounds of the words.

In fact, just to jog peoples’ memories, ScriptSync, or the ability to reference raw footage to its position in a written script was first introduced in 2007.

It was joined by the ability to search for the appearance of specific words with PhraseFind in 2011.

Although well received, due to licensing machinations behind the scenes both were discontinued in 2014.

But ideas as downright useful as those two could not stay down forever, so ScriptSync and PhraseFind re-appeared in 2017, each upgraded to version 2.0 and each with an upgraded license fee offered either separately or bundled together.

“Now we are more and more getting into ways to leverage the computing power of the cloud by using Microsoft Azure,” Colantuoni told me. “That is giving us the ability to help people responsible for logging massive amounts of source video for productions such as, for example, Reality Shows, based on several criteria.”

Azure was announced in October 2008 under the codename

Azure was announced in October 2008 under the codename "Project Red Dog."

Using video uploaded from MediaCentral to the Azure cloud, you can process the visual information and turn it into metadata. Then you can search that metadata for specific words, faces, or even objects.

“Say there is a specific red car you need to use in a scene, you can have the system find all instances of that red car by searching the metadata identifying it,” he said. “But it doesn’t end there.”

Avid has extended their metadata information into quality assurance. “For example if PhraseFind has identified some words that should be place in a certain scene,” Colantuoni described, “the operator can access the linked metadata to verify that the associated closed captions are appearing in the proper shots.”

It all has to do with MediaCentral interfacing with a database because of the metadata component that enables this kind of multi-level search.

“Metadata is going to be providing the foundation of ever more elaborate search capabilities as we learn to leverage AI more extensively in post-production,” Colantuoni finished up. “But, of course, it is always going to require human intelligence to give the final result meaning.”

Let us know what you think…

Log-in or Register for free to post comments…

You might also like...

Nine Pitfalls Of Relying On FTP To Move Large Media Files

Broadcasters are continuing to adopt and take advantage of IT working practices as they transition to file-based workflows. However, some seemingly effective solutions are outdated, have not kept pace with advances in computing power, and are unable to efficiently transfer…

Essential Guide: Secure IP Infrastructures For Broadcasters

Security is becoming increasingly important for broadcasters looking to transition to IP infrastructures. But creating improved software, firewalls and secure networks is only half the story as cybercriminals look to find new and imaginative methods of compromising data.

At IBC2019 Technology Puts The Consumer At The Center Of Distribution

At the 2019 IBC convention this year it was clear that the consumer is king and, for broadcasters and content delivery platforms, reliably serving that on-demand ruler with hyper-adaptable operations that can reach many platforms simultaneously could secure the keys to…

Essential Guide: Immersive Audio Pt 4 - Options And Tools For Production Of Live Immersive Content

In this fourth installment of the Immersive Audio series we investigate the production tools needed to produce live immersive content. Moving from channel-based output to object audio presents some interesting challenges as the complex audio image moves around in three-dimensional…

Essential Guide: Live HDR Down-Conversion

Live sports productions are the natural home for HDR. The increase in luminance latitude combined with extended color space delivers an immersive experience never before witnessed by the home viewer. But backwards compatibility must still be maintained for legacy SDR…