3 Screen Solutions Applies Machine Learning with Media Distillery to Content Metadata Creation

Germany’s Android set top box (STB) software provider 3 Screen Solutions (3SS) is integrating machine learning technology for metadata creation from Media Distillery to enable deeper content search on the basis of audio or visual objects down to the frame level.

The technology will be combined with 3SS’ 3READY platform, which comprises a front end and User Interface.

It applies Convolutional Neural Networks, one of the principal variants of machine learning, to index content on the basis of components such as faces, single keywords, topics, logos and whole text strings, to create metadata in the first place. Then the 3SS platform would apply this in various ways to enhance content search and recommendation, so that for example users could be sent notifications when their favorite athletes, politicians or pop stars are on a linear show that is about to go out. Users can also search for content directly on the basis of such objects, or by context.

As Roland Sars, CEO of Amsterdam based Media Distillery, hinted, his company is aiming to solve the problem of audio/video search which has escalated in recent years because of the proliferation of content and also fragmentation of sources. “While it may be easy to search for content, we all know it is not always easy to find it,” said Roland Sars, CEO of Media Distillery. “With our new joint solution with 3SS, viewers will get much more personal TV experiences, and finding their desired content will be quicker, easier, and more intuitive.”

Such at least is the ambition and it remains to be seen how successfully that will be realized at a time when other vendors are piling into this field. It is certainly true that Media Distillery’s machine learning technology makes content searchable down to a more itemized level than legacy approaches, which tended to be limited to title, genre and a few other characteristics such as director and lead actor in the case of movies.

Content metadata creation for search is a fast-moving field that is attracting a lot of investment from the big technology players like Netflix, Google and Amazon. 3SS and Media Distillery refer to AI in the context of their partnership but their approach is strictly speaking based on machine learning, which is really advanced iterative correlation in this case applied largely to object recognition. There are however other techniques, some loosely under the banner of general AI, which are also playing roles in content metadata creation. These include OCR (Optical Character Recognition) for identifying text so that it is searchable, and at a more advanced level natural language processing for identifying context. 

Let us know what you think…

Log-in or Register for free to post comments…

You might also like...

Building On IP COTS

Transitioning to IP improves flexibility and scalability, both of which are achievable using COTS IT equipment. But can COTS solve every challenge? Or does broadcasting still have some unique and more demanding requirements that need further attention? In this article,…

The Move Towards Next Generation Platforms

Whenever I’m asked about my opinion on the transition to IP, I always state that the impact can’t be appreciated until its history is understood. This brings into context the need for broadcasters to educate and surround themselves wit…

Taming The Virtualized Beast

Without doubt, virtualization is a key technological evolution focus and it will empower many broadcast and media organizations to work differently, more efficiently and more profitably.

Color and Colorimetry – Part 3

The human visual system (HVS) sees color using a set of three overlapping filters, which are extremely broad. As a result, the HVS is completely incapable of performing any precise assessment of an observed spectrum.

Color and Colorimetry – Part 2

At one time the only repeatable source of light on Earth was the sun. Later it was found that if bodies were made hot enough, they would radiate light. Any treatment of illumination has to start with the radiation from…