3 Screen Solutions Applies Machine Learning with Media Distillery to Content Metadata Creation

Germany’s Android set top box (STB) software provider 3 Screen Solutions (3SS) is integrating machine learning technology for metadata creation from Media Distillery to enable deeper content search on the basis of audio or visual objects down to the frame level.

The technology will be combined with 3SS’ 3READY platform, which comprises a front end and User Interface.

It applies Convolutional Neural Networks, one of the principal variants of machine learning, to index content on the basis of components such as faces, single keywords, topics, logos and whole text strings, to create metadata in the first place. Then the 3SS platform would apply this in various ways to enhance content search and recommendation, so that for example users could be sent notifications when their favorite athletes, politicians or pop stars are on a linear show that is about to go out. Users can also search for content directly on the basis of such objects, or by context.

As Roland Sars, CEO of Amsterdam based Media Distillery, hinted, his company is aiming to solve the problem of audio/video search which has escalated in recent years because of the proliferation of content and also fragmentation of sources. “While it may be easy to search for content, we all know it is not always easy to find it,” said Roland Sars, CEO of Media Distillery. “With our new joint solution with 3SS, viewers will get much more personal TV experiences, and finding their desired content will be quicker, easier, and more intuitive.”

Such at least is the ambition and it remains to be seen how successfully that will be realized at a time when other vendors are piling into this field. It is certainly true that Media Distillery’s machine learning technology makes content searchable down to a more itemized level than legacy approaches, which tended to be limited to title, genre and a few other characteristics such as director and lead actor in the case of movies.

Content metadata creation for search is a fast-moving field that is attracting a lot of investment from the big technology players like Netflix, Google and Amazon. 3SS and Media Distillery refer to AI in the context of their partnership but their approach is strictly speaking based on machine learning, which is really advanced iterative correlation in this case applied largely to object recognition. There are however other techniques, some loosely under the banner of general AI, which are also playing roles in content metadata creation. These include OCR (Optical Character Recognition) for identifying text so that it is searchable, and at a more advanced level natural language processing for identifying context. 

You might also like...

Essential Guide: Reality of IP

As broadcasters migrate to IP, the spotlight is focusing more and more on IT infrastructure. Quietly in the background, IT has been making unprecedented progress in infrastructure design to deliver low latency high-speed networks, and new highly adaptable business models,…

Maintaining Cyber Security in IP Media Systems

Protecting media systems from hacking, malware and viruses are genuine concerns to every broadcast and production facility engineer. Unfortunately, antimalware protection software is seldom used on audio and video media systems because the two technologies often prove incompatible.

Viewpoint: Making The Multiscreen Experience Applicable For Multiple Customers

There is an unprecedented transformation occurring in the TV platform, from a rigid, linear TV experience to one of flexible fluidity in the OTT and multiscreen worlds. More than half of today’s TV viewers say they now watch their f…

Google Leaves RDK Trailing with Android TV Operator Tier

Android TV is finally being adopted on a large scale by pay TV operators three years after its launch and seven years on from the original unveiling of its predecessor Google TV. One casualty could be the RDK (Reference Design…

Com Hem Claims World First Major Android TV Operator Tier Deployment with Help from 3SS

Com Hem, Sweden’s largest cable operator, has revealed that Germany’s 3 Screen Solutions (3SS) played a key role in project development and systems integration for its TV Hub, a hybrid set top box (STB) based on Android TV. 3SS als…