3 Screen Solutions Applies Machine Learning with Media Distillery to Content Metadata Creation

Germany’s Android set top box (STB) software provider 3 Screen Solutions (3SS) is integrating machine learning technology for metadata creation from Media Distillery to enable deeper content search on the basis of audio or visual objects down to the frame level.

The technology will be combined with 3SS’ 3READY platform, which comprises a front end and User Interface.

It applies Convolutional Neural Networks, one of the principal variants of machine learning, to index content on the basis of components such as faces, single keywords, topics, logos and whole text strings, to create metadata in the first place. Then the 3SS platform would apply this in various ways to enhance content search and recommendation, so that for example users could be sent notifications when their favorite athletes, politicians or pop stars are on a linear show that is about to go out. Users can also search for content directly on the basis of such objects, or by context.

As Roland Sars, CEO of Amsterdam based Media Distillery, hinted, his company is aiming to solve the problem of audio/video search which has escalated in recent years because of the proliferation of content and also fragmentation of sources. “While it may be easy to search for content, we all know it is not always easy to find it,” said Roland Sars, CEO of Media Distillery. “With our new joint solution with 3SS, viewers will get much more personal TV experiences, and finding their desired content will be quicker, easier, and more intuitive.”

Such at least is the ambition and it remains to be seen how successfully that will be realized at a time when other vendors are piling into this field. It is certainly true that Media Distillery’s machine learning technology makes content searchable down to a more itemized level than legacy approaches, which tended to be limited to title, genre and a few other characteristics such as director and lead actor in the case of movies.

Content metadata creation for search is a fast-moving field that is attracting a lot of investment from the big technology players like Netflix, Google and Amazon. 3SS and Media Distillery refer to AI in the context of their partnership but their approach is strictly speaking based on machine learning, which is really advanced iterative correlation in this case applied largely to object recognition. There are however other techniques, some loosely under the banner of general AI, which are also playing roles in content metadata creation. These include OCR (Optical Character Recognition) for identifying text so that it is searchable, and at a more advanced level natural language processing for identifying context. 

You might also like...

Leveraging The Cloud Keeps Media Businesses Running Smoothly

While cloud computing and storage have reimagined how remote workflows are implemented, they can also play a huge role in business continuity and even disaster recovery. As many major productions have already proven, the key to continued success is extending…

OTT (Or Is It ABR?) - Part 3 - DASH-CMAF With HTTP/1.1 Chunked Transfer For Low Latency

ABR segments are transferred conventionally using HTTP/1.0 transfers, where the client requests the whole segment and it is transferred using store-and-forward transfers, where all the data belonging to the transfer is buffered before sending. In order to start the transfer,…

The Sponsors Perspective: TAG Video Systems Introduces New Business Model For Broadcast Technology

With the emergence of the cloud into the media production and delivery space, the broadcast and media industry must embrace an entirely new approach to acquiring and deploying technology. Large capital expenditures (CapEx) are increasingly being replaced by operating expense …

Cloud Native Technology Ensures Media Business Success

As the media landscape continues to streamline the way it delivers content, cloud-native technology, that is, container-based virtualized environments that replicate traditional workflows on premise, is playing a big role. However, some broadcasters moving their assets and processing power to…

OTT (Or Is It ABR?) - Part 2 - The Mechanics Of ABR Delivery

ABR delivery offers the prospect of automatic adaptation of bit rates to the prevailing network conditions. Since the client is aware of the set of available bit rates, it can determine, segment-by-segment, which is the optimal bit rate to use.