3 Screen Solutions Applies Machine Learning with Media Distillery to Content Metadata Creation

Germany’s Android set top box (STB) software provider 3 Screen Solutions (3SS) is integrating machine learning technology for metadata creation from Media Distillery to enable deeper content search on the basis of audio or visual objects down to the frame level.

The technology will be combined with 3SS’ 3READY platform, which comprises a front end and User Interface.

It applies Convolutional Neural Networks, one of the principal variants of machine learning, to index content on the basis of components such as faces, single keywords, topics, logos and whole text strings, to create metadata in the first place. Then the 3SS platform would apply this in various ways to enhance content search and recommendation, so that for example users could be sent notifications when their favorite athletes, politicians or pop stars are on a linear show that is about to go out. Users can also search for content directly on the basis of such objects, or by context.

As Roland Sars, CEO of Amsterdam based Media Distillery, hinted, his company is aiming to solve the problem of audio/video search which has escalated in recent years because of the proliferation of content and also fragmentation of sources. “While it may be easy to search for content, we all know it is not always easy to find it,” said Roland Sars, CEO of Media Distillery. “With our new joint solution with 3SS, viewers will get much more personal TV experiences, and finding their desired content will be quicker, easier, and more intuitive.”

Such at least is the ambition and it remains to be seen how successfully that will be realized at a time when other vendors are piling into this field. It is certainly true that Media Distillery’s machine learning technology makes content searchable down to a more itemized level than legacy approaches, which tended to be limited to title, genre and a few other characteristics such as director and lead actor in the case of movies.

Content metadata creation for search is a fast-moving field that is attracting a lot of investment from the big technology players like Netflix, Google and Amazon. 3SS and Media Distillery refer to AI in the context of their partnership but their approach is strictly speaking based on machine learning, which is really advanced iterative correlation in this case applied largely to object recognition. There are however other techniques, some loosely under the banner of general AI, which are also playing roles in content metadata creation. These include OCR (Optical Character Recognition) for identifying text so that it is searchable, and at a more advanced level natural language processing for identifying context. 

You might also like...

Broadcaster D2C Requirements For The 2020s - Part 2

The first part of this article explained the set of requirements that appear in the most modern OTT Services from broadcasters launching their own App-based services in the 2020s. Here we inspect those requirements in the two broad areas of…

US Open Golf Puts Spotlight On Latency And Scale For Live Streaming

Every big global sporting event exerts stress on streaming infrastructures and challenges providers to deliver further improvements in the viewing experience as demand and traffic levels go on increasing. The 2022 US Open Golf Championship in Brookline, Massachusetts, is particularly under…

No Sign Of Innovation Slowing At NAB 2022

Covid-19 may have changed the course of broadcasting but has not slowed its development, judging from NAB 2022, the first major industry show with a physical presence since before the pandemic.

Broadcaster D2C Requirements For The 2020s - Part 1

Most national broadcasters in developed countries have app-based OTT services, many of which have been in place for over a decade. Less-developed national broadcasters still rely on YouTube, Social Media platforms, or their own websites to deliver OTT content to…

2022 NAB Show Review, Part 2

With fewer exhibits and smaller crowds, the 2022 NAB Show aisles were easier to navigate and exhibitors had more time to speak with visitors.