Broadcast Standards - The Science Of AI: New Foundations

We begin this series with the foundational building blocks of AI. Basic principles, the technology stack and the types of AI based upon it, and how to apply them effectively in a broadcasting enterprise.


This article is part of ‘Broadcast Standards - The Science Of Artificial Intelligence’.  Download the entire content collection for free here.

Artificial Intelligence is increasingly relevant to broadcast and streaming production, but it helps to select the most appropriate solution to solve a production problem. Here we explore the taxonomy of the different kinds of AI to discover their inner workings and practical applications.

Being circumspect in how you use AI can be misinterpreted as having a negative attitude towards it, but being cautious is fundamentally important because using AI is not entirely risk free. With every advanced tool comes a mandate to use it responsibly.

In a simplistic way, AI embodies any kind of pseudo intelligent behavior. The word pseudo is highlighted because this is not real intelligence in the human sense – it is still a rule based deterministic algorithm. Until AI evolves to modify its own code, that algorithm is still designed by human programmers.

AI systems cannot create new content but they can appear to create new and unique text and data by aggregating the stimuli that they were trained on. This is not the same kind of creativity that humans are capable of. There is nothing fundamentally original happening although unrelated ideas may be combined in novel ways to appear to be creative.

A Timeline

In common with most overnight successes, Artificial Intelligence has been around for some time without being noticed until recently. Here is a snapshot of some important milestones:

Time FrameDescription
1900sThe intellectual groundwork and thinking about AI starts.
1910sEarly OCR emerges for converting text into telegraphy signals.
1949Donald Hebb publishes research into neural structures in the brain. This illustrates combining nodes together as artificial neurons which is the theoretical foundation for Neural Networks.
1959Arthur Samuel coins the term Machine Learning when computers were extremely primitive and machine learning capabilities would have been speculative.
1950sAlan Turing introduces the Turing Test to evaluate whether a system is intelligent.
1950sMICR recognition of account numbers on cheques developed at Stanford University.
1959Stanford University implements the ADELINE neural network tool to cancel echoes in telephone lines.
1960sRaytheon develops a sonar signal analyzer called Cybertron which was able to recognize distinct sounds.
1978Heuristic (learning) speech recognition system on a plug-in card is introduced for the Apple ][ personal computer.
1970sAlexey Ivakhnenko publishes the first 8-layer Neural Network as a Deep Learning algorithm.
1990sAXON develops the AX 100 guitar-to-MIDI note tracker using a Neural Network to discern the pitch from the first rising half cycle of the audio signal.
1990sPrimitive LLMs developed.
2015Latent Diffusion techniques emerge for synthesizing images.
2017Transformers are introduced into LLMs to make them more capable.
2022Stable Diffusion emerges as a development based on Latent Diffusion techniques.
2024The Agentic AI concept emerges, although some earlier work is related.

New Terminology To Assimilate

AI developers use a glossary of arcane terms to describe what they do as a form of condensed language. It sounds complex but as usual, there is nothing to fear:

TermMeaning
TransformerA specialized neural network that converts raw text into one of a set of pre-defined tokens.
Deep LearningMultiple layers of processing in a Neural Network.
Model Context ProtocolMCP is an open-source technique developed by Anthropic for sharing LLM data with other tools.
Latent Semantic AnalysisThe process of grouping documents together in a virtual space where the axes are based on terminology contained within the document. See the Spire system designed by Pacific Northwest Laboratories.
Latent DiffusionAn early method of generating synthetic images.
Stable DiffusionA refined text-to-image model that recursively filters white noise until an image recognizer is satisfied that it represents the desired output.
Network BendingA technique for altering the resulting behavior of Generative AI when it makes an output image or sound.
TensorsA collective term that describes multi-dimensional data objects.
Semantic AnalysisThe process of discovering meaning in arbitrary text sequences.
CPUCentral Processing Units are the heart of a microprocessor architected computer. They are nowadays implemented in multiples to provide general purpose computing resources.
GPUGraphics Processing Units offload processing from the CPU for rendering images onto a view canvas. Useful also as computational accelerators because they are massively parallel scalar compute engines.
TPUA Tensor Processing Unit developed by Google for AI compute acceleration. Similar in many ways to a GPU core which operates on scalars, TPU cores operate on more complex multi-dimensional objects.
LLMLarge Language Models train massive amounts of content.
SLMSmall Language Models train on a specialized sub-set of subject-based knowledge. This is likely to be more useful and less risky.

Applying AI Tools To Production

Notwithstanding perceived negative aspects of AI, there is a great deal of useful functionality to deploy within a broadcast infrastructure. Separate the marketing hype from the real capabilities (and limitations). Then develop a working understanding of how AI systems work.

Unless you are in the business of building them, it is not necessary to go very deeply down the rabbit hole and a quick peek under the hood equips us with useful knowledge to facilitate an effective deployment. Understanding the limitations of the technology shows where your infrastructure needs additional support and solutions to augment the AI facilities.

Used correctly and appropriately, AI tools can be of great benefit and provide significant time-saving leverage. The most obvious area that immediately benefits broadcasters is gathering of metadata to describe content in a media storage system; AI empowers search engines to use new and interesting techniques for discovering content.

AI is useful for generating ideas and starting points but if you don’t fully understand what it is doing then betting your reputation on what it thinks you want to do is a high risk. Here are some important criteria to consider:

  • Know the provenance of the training data used for the AI model.
  • Fully understand the output the AI system generates.
  • Make sure the AI system is not creating content that exposes you to a copyright infringement liability.
  • Constrain the LLM to be an SLM that has full knowledge of a small topic extent.
  • Be aware that using public systems to analyze proprietary data can leak confidential and security sensitive information into the wild for anyone to obtain.
  • Be mindful that the global landscape of AI and copyright law is still evolving, both in terms of the ownership of AI-generated output at one end, and the use of copyrighted materials to train AI models at the other. Expect more development of policies that attempt to balance AI content with the protection of intellectual property rights. Broadcasters and other content providers should keep abreast of changes in international and regional copyright law to avoid any legal and licensing penalties in the future.

Taxonomy Of AI Systems

Here is an example taxonomy that identifies different paradigms within the AI world based on their practical use and application. These are arranged somewhat into a sequence where they evolve in complexity and autonomy. This starts with the least sophisticated decision making capabilities up to experimental and somewhat hypothetical thinking machines.

There are other abstract ways to characterize AI but for practical applications this is the most appropriate:

ParadigmCharacteristicsRelevance
Perceptive AIUseful for recognizing features in images, speech and speaker recognition from audio streams and semantic analysis of text. Sometimes described as Pattern Recognition.Content searching, analyzing media for visual and speech recognition.
Predictive AIGiven some historical data and context, trend analysis and anticipation based on existing pattern detection allows some degree of prediction. Weather forecasting can apply these techniques.Production control, weather forecasting, network bandwidth saturation.
Assistive AIDescribes systems operating in collaboration with a human in a non-autonomous fashion. Useful for content creation with humans in full editorial control of the final output.Visual effects, editing, project resource gathering.
Ambient AIObserving the TV sound volume detects a high setting and assumes the viewer is hard of hearing. This might also imply the viewer is also a senior citizen. Combine this with other relevant sensory detectors to ratify that conclusion. Reliably detecting that scenario allows the environmental controls to be adjusted.Automated viewer assistance.
Conversational AIChatbots trained to answer questions.Help desks, content queries.
Generative AIUsed to create textual, imagery, video and audio content based on learned stimuli.Visual effect, graphics production.
Agentic AIProcesses that run autonomously with minimal human input. Useful for repetitive and mundane tasks. Can deliver higher levels of Assistive AI. Verify that they are working as intended before letting them loose.Content archiving, shot logging, assembling assets into projects for NLE editors.
Physical AIAn extension of the Assistive AI concepts applied to the care of physically compromised individuals. Fall detection, wired homes, and collision detection on motorized wheelchairs are all examples. This is related to the Internet of Things concept for connecting real-world-objects to IT systems.Moving scenery on sets, lighting control, ambient environmental controls.
Autonomous AIMore advanced Agentic AI systems that can decide for themselves what to do, when to do it, and how. A Content Management System might operate in an autonomous mode to keep all the various media formats available for every content item without needing to be supervised.Background archive maintenance, ingesting large collections of media.
Artificial Narrow IntelligenceSophisticated AI constrained to operate within a well-defined set of tasks.Generating metadata for individual programs.
Artificial General IntelligenceAGI is trained on a very large body of knowledge. It can understand context, history and a series of connected prompts. It would match human capabilities and is still at a theoretical stage.Scheduling and call sheet preparation, booking resources.
Artificial Super IntelligenceExceeds human capabilities in every area. A highly speculative concept. Technically possible but would require massive computational resources. This may become relevant when Quantum computing is more widely available.The extent of how this could be used is still debatable.

Ecological & Financial Impact

At some point it will be important to consider the ecological impact of using AI systems. There are unintended consequences of deploying AI on a large scale and they show no signs of easing soon. In fact, the situation is getting worse.

A single AI prompt dissipates much more energy than a search engine query ever did. There is a significant proportion of the world’s energy generating capacity and water resources now being consumed by data centers.

The financial impact is reflected in the much higher prices being charged for memory chips and hard drives. Graphics cards have been in short supply for years. That may ease as Tensor Processing Units and Nvidia AI chips become more widely available but it is likely to be some time before memory and disk storage prices return to normal.

Relevant Standards - Where To Find Out More

As yet, there are very few standards to describe AI systems. This is bound to change as we move from a competitive approach to something more collaborative where AI data needs to be distributed and shared between systems developed by different companies.

These are important initiatives and standards:

DocumentDescription
ISO 6048JPEG AI learning-based image coding system.
ISO 6048-1The core coding system.
ISO 6048-2JPEG AI - Profiling.
ISO 6048-3JPEG AI - Reference software.
ISO 6048-4JPEG AI - Conformance.
ISO 6048-5JPEG AI - File format.
ISO 15938MPEG-7.
ISO 15938-17NNC - Compression of Neural Networks for Multimedia Content Description and analysis.
ISO 15938-18NNC - Conformance and reference software for compression of neural networks.
ISO 23053Framework for Artificial Intelligence (AI) Systems Using Machine Learning (ML).
ISO 23092MPEG-G - Genomic Information Representation (compressing DNA using media codec algorithms).
ISO 23888AI for Multimedia.
ISO 23888-1Vision and scenarios.
ISO 23888-2VCM - Video coding for machines.
ISO 23888-3Optimization of encoders and receiving systems for machine analysis of coded video content.
ISO 24102Audio coding for machines.
ISO 42001AI Management system.
MCPThe open-source Model Context Protocol published by Anthropic.
MPAILeonardo Chiaraglione founded the MPAI organization which is working on standards for AI assisted coding of media and metadata. Examine their archived publications for insights into the ongoing work.
SMPTE ER 1010Artificial Intelligence And Media (2023).
SMPTE ER 1011Artificial Intelligence And Media (2025).

Conclusions

Big tech companies are developing the AI technology and competing to be first to develop highly capable artificial general intelligence. Clearly, they won’t stop there and will evolve onwards to super intelligent machines: the genie is out of the bottle and up to mischief.

It is altogether exciting and frightening in equal measure but somewhere in this complex mix are the tools that broadcasters can use creatively to make better media content.

You might also like...

IP Security For Broadcasters - The Book 2026

Security is everyone’s problem. It is not just about having the right policies in place or knowing where the vulnerabilities in your network are; it’s about understanding how the network is accessed and by whom, and how to str…

Standards: Audio - MPEG Layer 3 Audio Coding (MP3)

Launched in 1995, MP3 remains one of the most ubiquitous audio formats in the world. This guide explains how psychoacoustic compression works, explains the differences between MPEG-1 and MPEG-2 implementations, and finds out where MP3 works – and where it doesn’t.

Production–Delivery Convergence: Part 8 - Why Informed Creativity Is A Competitive Advantage

Every creative decision in the streaming economy has a direct impact on multiple parts of the production and delivery chain. It means media organizations can no longer work in silos, and in this final part we examine how understanding the…

The Struggle With Generated Content

Like every other industry on the planet, broadcasting is struggling to strike its own balance over AI generated content. In the first of two articles we discuss the challenges facing broadcasters and how digital forensics, online services, and the big…

Standards: Audio - Standards For Audio Coding

Audio coding demands very different tools and workflows to video, but the same fundamental principles around quality apply to both. This guide surveys the standards, codecs and container formats you need to navigate modern audio workflows.