Granular Metadata Can Help Broadcasters Fight Back Against Big Internet And OTT Players

Metadata is well known to hold the keys to good user experiences by making content readily searchable and enabling more compelling or relevant recommendations, but has been held back by limited depth and need for laborious manual production.

While metadata has the potential for significant competitive differentiation and can help legacy broadcasters or operators exploit more fully the one advantage they often have over the big Internet players, unfortunately the video is often poorly described at only a basic level of detail. That information typically includes little beyond genre and title. Today's metadata is often inconsistent and reliant on diverse and often incompatible third-party sources.

This is their content, which especially in the case of TV shows and live sports has scope for exploitation beyond the existing footprint via OTT distribution over the Internet.

These deficits have spawned a new breed of metadata specialist taking advantage of more advanced tools based on techniques under the banners of Artificial Intelligence (AI) and Machine Learning (ML). Although much overused and over hyped, these terms loosely apply to software based methods encapsulating various forms of human expertise enabling tasks to be automated and performed much faster. In the case of ML, there is also some capability to improve through continued exposure to relevant data sets, which can for example enable better recommendations in the light of feedback from users.

Automatic Detail Identification

Media Distillery, based in Amsterdam, Netherlands, is one such vendor that has developed software designed to extract levels of detail at the scene or frame level from video in real time. This includes identification of people from facial recognition applied to the relevant part of a frame, as well as logos, objects such as buildings, subtitles and words or phrases within the audio stream.

Speaking at the recent OTT World Summit in London, Media Distillery CEO Roland Sars argued such metadata can take recommendations to a new level of detail in keeping with emerging content consumption rends, especially among Millennials. It cannot just identify titles on the basis of finer levels of search data, but can perform “intra” searches within whole content items such as movies or TV shows to extract clips of particular interest. “Current recommendations are often based on collaborative filtering but with this metadata we can make these more relevant to probing more deeply what consumers are really watching. They may prefer to receive short clips of interest rather than whole programs. Current metadata is too limited for this, but we feed much richer metadata,” said Sars.

Media Distillery CEO Roland Sars argues that granular metadata will revolutionize the way people watch as well as find content.

Media Distillery CEO Roland Sars argues that granular metadata will revolutionize the way people watch as well as find content.

Such detailed metadata can also improve the viewing experience in other ways than better beyond recommendation. Sars pointed out that 75% of linear programs do not start on time, but that Media Distillery’s technology can locate the correct point by recognizing visual or audio cues. “We can point to the right start or end time without bias to channels,” said Sars. “This is becoming more important with the trend towards replay watching away from linear.”

Automated Metadata

Another vendor applying AI tools to metadata creation is Finland’s Valossa, which has focused on exploiting this to generate more descriptive tags and categories to improve navigation as well as search. Like Media Distillery, Vanossa emphasizes the importance of automating metadata generation given that manual inspection is becoming far too time consuming and expensive with proliferating volumes of content becoming available all the time. Valossa is promoting its metadata for more effective ad targeting as well since there is scope for matching an ad more exactly not just to broad genre but precisely what is showing within a program at a given time. Ads can be matched to scenes or spoken words within the content.

A longer-term goal is to enable video search to be as granular as Google is for text, enabling any content including user generated material to be located almost instantly on the basis of a relevant search key. Valossa is heading in this direction with a search engine currently under development, building on the existing scene-level metadata to allow content discovery based on natural language.

One problem these systems do not address on their own is the issue of metadata integration from multiple sources. In fact, this could get worse with greater granularity in the absence of common standards at this level. As UK based video systems integrator and consultancy Piksel argues consistently, metadata management is often compromised by inconsistencies across different sources at content ingest, which reduces effectiveness of discovery and recommendation. Given the growing reliance on metadata, Piksel now suggests that broadcasters and distributors should consider replacing third party sources and instead create their own unique metadata using tools it or rivals can provide.

This is not feasible for many smaller service providers and so the likes of Piksel are also offering services to create bespoke packages that work on metadata at the scene-level, utilizing visual identification and natural language processing of closed captions, as well as speech recognition. 

You might also like...

NAB Show 2024 BEIT Sessions Part 2: New Broadcast Technologies

The most tightly focused and fresh technical information for TV engineers at the NAB Show will be analyzed, discussed, and explained during the four days of BEIT sessions. It’s the best opportunity on Earth to learn from and question i…

Standards: Part 6 - About The ISO 14496 – MPEG-4 Standard

This article describes the various parts of the MPEG-4 standard and discusses how it is much more than a video codec. MPEG-4 describes a sophisticated interactive multimedia platform for deployment on digital TV and the Internet.

The Big Guide To OTT: Part 9 - Quality Of Experience (QoE)

Part 9 of The Big Guide To OTT features a pair of in-depth articles which discuss how a data driven understanding of the consumer experience is vital and how poor quality streaming loses viewers.

Chris Brown Discusses The Themes Of The 2024 NAB Show

The Broadcast Bridge sat down with Chris Brown, executive vice president and managing director, NAB Global Connections and Events to discuss this year’s gathering April 13-17 (show floor open April 14-17) and how the industry looks to the show e…

5G Broadcast: Part 6 - Technical Dive Into 5G Broadcast & New 3GPP Standards

Standards bodies and mobile technology developers are putting the finishing touches to 5G Multicast and Broadcast. These include enabling seamless switching between unicast and multicast, and equally transparent roaming for users as they move between mobile cells. There is also…