Broadcast Standards - The Science Of AI: New Foundations
We begin this series with the foundational building blocks of AI. Basic principles, the technology stack and the types of AI based upon it, and how to apply them effectively in a broadcasting enterprise.
Artificial Intelligence is increasingly relevant to broadcast and streaming production, but it helps to select the most appropriate solution to solve a production problem. Here we explore the taxonomy of the different kinds of AI to discover their inner workings and practical applications.
Being circumspect in how you use AI can be misinterpreted as having a negative attitude towards it, but being cautious is fundamentally important because using AI is not entirely risk free. With every advanced tool comes a mandate to use it responsibly.
In a simplistic way, AI embodies any kind of pseudo intelligent behavior. The word pseudo is highlighted because this is not real intelligence in the human sense – it is still a rule based deterministic algorithm. Until AI evolves to modify its own code, that algorithm is still designed by human programmers.
AI systems cannot create new content but they can appear to create new and unique text and data by aggregating the stimuli that they were trained on. This is not the same kind of creativity that humans are capable of. There is nothing fundamentally original happening although unrelated ideas may be combined in novel ways to appear to be creative.
A Timeline
In common with most overnight successes, Artificial Intelligence has been around for some time without being noticed until recently. Here is a snapshot of some important milestones:
| Time Frame | Description |
|---|---|
| 1900s | The intellectual groundwork and thinking about AI starts. |
| 1910s | Early OCR emerges for converting text into telegraphy signals. |
| 1949 | Donald Hebb publishes research into neural structures in the brain. This illustrates combining nodes together as artificial neurons which is the theoretical foundation for Neural Networks. |
| 1959 | Arthur Samuel coins the term Machine Learning when computers were extremely primitive and machine learning capabilities would have been speculative. |
| 1950s | Alan Turing introduces the Turing Test to evaluate whether a system is intelligent. |
| 1950s | MICR recognition of account numbers on cheques developed at Stanford University. |
| 1959 | Stanford University implements the ADELINE neural network tool to cancel echoes in telephone lines. |
| 1960s | Raytheon develops a sonar signal analyzer called Cybertron which was able to recognize distinct sounds. |
| 1978 | Heuristic (learning) speech recognition system on a plug-in card is introduced for the Apple ][ personal computer. |
| 1970s | Alexey Ivakhnenko publishes the first 8-layer Neural Network as a Deep Learning algorithm. |
| 1990s | AXON develops the AX 100 guitar-to-MIDI note tracker using a Neural Network to discern the pitch from the first rising half cycle of the audio signal. |
| 1990s | Primitive LLMs developed. |
| 2015 | Latent Diffusion techniques emerge for synthesizing images. |
| 2017 | Transformers are introduced into LLMs to make them more capable. |
| 2022 | Stable Diffusion emerges as a development based on Latent Diffusion techniques. |
| 2024 | The Agentic AI concept emerges, although some earlier work is related. |
New Terminology To Assimilate
AI developers use a glossary of arcane terms to describe what they do as a form of condensed language. It sounds complex but as usual, there is nothing to fear:
| Term | Meaning |
|---|---|
| Transformer | A specialized neural network that converts raw text into one of a set of pre-defined tokens. |
| Deep Learning | Multiple layers of processing in a Neural Network. |
| Model Context Protocol | MCP is an open-source technique developed by Anthropic for sharing LLM data with other tools. |
| Latent Semantic Analysis | The process of grouping documents together in a virtual space where the axes are based on terminology contained within the document. See the Spire system designed by Pacific Northwest Laboratories. |
| Latent Diffusion | An early method of generating synthetic images. |
| Stable Diffusion | A refined text-to-image model that recursively filters white noise until an image recognizer is satisfied that it represents the desired output. |
| Network Bending | A technique for altering the resulting behavior of Generative AI when it makes an output image or sound. |
| Tensors | A collective term that describes multi-dimensional data objects. |
| Semantic Analysis | The process of discovering meaning in arbitrary text sequences. |
| CPU | Central Processing Units are the heart of a microprocessor architected computer. They are nowadays implemented in multiples to provide general purpose computing resources. |
| GPU | Graphics Processing Units offload processing from the CPU for rendering images onto a view canvas. Useful also as computational accelerators because they are massively parallel scalar compute engines. |
| TPU | A Tensor Processing Unit developed by Google for AI compute acceleration. Similar in many ways to a GPU core which operates on scalars, TPU cores operate on more complex multi-dimensional objects. |
| LLM | Large Language Models train massive amounts of content. |
| SLM | Small Language Models train on a specialized sub-set of subject-based knowledge. This is likely to be more useful and less risky. |
Applying AI Tools To Production
Notwithstanding perceived negative aspects of AI, there is a great deal of useful functionality to deploy within a broadcast infrastructure. Separate the marketing hype from the real capabilities (and limitations). Then develop a working understanding of how AI systems work.
Unless you are in the business of building them, it is not necessary to go very deeply down the rabbit hole and a quick peek under the hood equips us with useful knowledge to facilitate an effective deployment. Understanding the limitations of the technology shows where your infrastructure needs additional support and solutions to augment the AI facilities.
Used correctly and appropriately, AI tools can be of great benefit and provide significant time-saving leverage. The most obvious area that immediately benefits broadcasters is gathering of metadata to describe content in a media storage system; AI empowers search engines to use new and interesting techniques for discovering content.
AI is useful for generating ideas and starting points but if you don’t fully understand what it is doing then betting your reputation on what it thinks you want to do is a high risk. Here are some important criteria to consider:
- Know the provenance of the training data used for the AI model.
- Fully understand the output the AI system generates.
- Make sure the AI system is not creating content that exposes you to a copyright infringement liability.
- Constrain the LLM to be an SLM that has full knowledge of a small topic extent.
- Be aware that using public systems to analyze proprietary data can leak confidential and security sensitive information into the wild for anyone to obtain.
- Be mindful that the global landscape of AI and copyright law is still evolving, both in terms of the ownership of AI-generated output at one end, and the use of copyrighted materials to train AI models at the other. Expect more development of policies that attempt to balance AI content with the protection of intellectual property rights. Broadcasters and other content providers should keep abreast of changes in international and regional copyright law to avoid any legal and licensing penalties in the future.
Taxonomy Of AI Systems
Here is an example taxonomy that identifies different paradigms within the AI world based on their practical use and application. These are arranged somewhat into a sequence where they evolve in complexity and autonomy. This starts with the least sophisticated decision making capabilities up to experimental and somewhat hypothetical thinking machines.
There are other abstract ways to characterize AI but for practical applications this is the most appropriate:
| Paradigm | Characteristics | Relevance |
|---|---|---|
| Perceptive AI | Useful for recognizing features in images, speech and speaker recognition from audio streams and semantic analysis of text. Sometimes described as Pattern Recognition. | Content searching, analyzing media for visual and speech recognition. |
| Predictive AI | Given some historical data and context, trend analysis and anticipation based on existing pattern detection allows some degree of prediction. Weather forecasting can apply these techniques. | Production control, weather forecasting, network bandwidth saturation. |
| Assistive AI | Describes systems operating in collaboration with a human in a non-autonomous fashion. Useful for content creation with humans in full editorial control of the final output. | Visual effects, editing, project resource gathering. |
| Ambient AI | Observing the TV sound volume detects a high setting and assumes the viewer is hard of hearing. This might also imply the viewer is also a senior citizen. Combine this with other relevant sensory detectors to ratify that conclusion. Reliably detecting that scenario allows the environmental controls to be adjusted. | Automated viewer assistance. |
| Conversational AI | Chatbots trained to answer questions. | Help desks, content queries. |
| Generative AI | Used to create textual, imagery, video and audio content based on learned stimuli. | Visual effect, graphics production. |
| Agentic AI | Processes that run autonomously with minimal human input. Useful for repetitive and mundane tasks. Can deliver higher levels of Assistive AI. Verify that they are working as intended before letting them loose. | Content archiving, shot logging, assembling assets into projects for NLE editors. |
| Physical AI | An extension of the Assistive AI concepts applied to the care of physically compromised individuals. Fall detection, wired homes, and collision detection on motorized wheelchairs are all examples. This is related to the Internet of Things concept for connecting real-world-objects to IT systems. | Moving scenery on sets, lighting control, ambient environmental controls. |
| Autonomous AI | More advanced Agentic AI systems that can decide for themselves what to do, when to do it, and how. A Content Management System might operate in an autonomous mode to keep all the various media formats available for every content item without needing to be supervised. | Background archive maintenance, ingesting large collections of media. |
| Artificial Narrow Intelligence | Sophisticated AI constrained to operate within a well-defined set of tasks. | Generating metadata for individual programs. |
| Artificial General Intelligence | AGI is trained on a very large body of knowledge. It can understand context, history and a series of connected prompts. It would match human capabilities and is still at a theoretical stage. | Scheduling and call sheet preparation, booking resources. |
| Artificial Super Intelligence | Exceeds human capabilities in every area. A highly speculative concept. Technically possible but would require massive computational resources. This may become relevant when Quantum computing is more widely available. | The extent of how this could be used is still debatable. |
Ecological & Financial Impact
At some point it will be important to consider the ecological impact of using AI systems. There are unintended consequences of deploying AI on a large scale and they show no signs of easing soon. In fact, the situation is getting worse.
A single AI prompt dissipates much more energy than a search engine query ever did. There is a significant proportion of the world’s energy generating capacity and water resources now being consumed by data centers.
The financial impact is reflected in the much higher prices being charged for memory chips and hard drives. Graphics cards have been in short supply for years. That may ease as Tensor Processing Units and Nvidia AI chips become more widely available but it is likely to be some time before memory and disk storage prices return to normal.
Relevant Standards - Where To Find Out More
As yet, there are very few standards to describe AI systems. This is bound to change as we move from a competitive approach to something more collaborative where AI data needs to be distributed and shared between systems developed by different companies.
These are important initiatives and standards:
| Document | Description |
|---|---|
| ISO 6048 | JPEG AI learning-based image coding system. |
| ISO 6048-1 | The core coding system. |
| ISO 6048-2 | JPEG AI - Profiling. |
| ISO 6048-3 | JPEG AI - Reference software. |
| ISO 6048-4 | JPEG AI - Conformance. |
| ISO 6048-5 | JPEG AI - File format. |
| ISO 15938 | MPEG-7. |
| ISO 15938-17 | NNC - Compression of Neural Networks for Multimedia Content Description and analysis. |
| ISO 15938-18 | NNC - Conformance and reference software for compression of neural networks. |
| ISO 23053 | Framework for Artificial Intelligence (AI) Systems Using Machine Learning (ML). |
| ISO 23092 | MPEG-G - Genomic Information Representation (compressing DNA using media codec algorithms). |
| ISO 23888 | AI for Multimedia. |
| ISO 23888-1 | Vision and scenarios. |
| ISO 23888-2 | VCM - Video coding for machines. |
| ISO 23888-3 | Optimization of encoders and receiving systems for machine analysis of coded video content. |
| ISO 24102 | Audio coding for machines. |
| ISO 42001 | AI Management system. |
| MCP | The open-source Model Context Protocol published by Anthropic. |
| MPAI | Leonardo Chiaraglione founded the MPAI organization which is working on standards for AI assisted coding of media and metadata. Examine their archived publications for insights into the ongoing work. |
| SMPTE ER 1010 | Artificial Intelligence And Media (2023). |
| SMPTE ER 1011 | Artificial Intelligence And Media (2025). |
Conclusions
Big tech companies are developing the AI technology and competing to be first to develop highly capable artificial general intelligence. Clearly, they won’t stop there and will evolve onwards to super intelligent machines: the genie is out of the bottle and up to mischief.
It is altogether exciting and frightening in equal measure but somewhere in this complex mix are the tools that broadcasters can use creatively to make better media content.
These Appendix articles contain additional information you may find useful:
You might also like...
IP Security For Broadcasters - The Book 2026
Security is everyone’s problem. It is not just about having the right policies in place or knowing where the vulnerabilities in your network are; it’s about understanding how the network is accessed and by whom, and how to str…
Standards: Audio - MPEG Layer 3 Audio Coding (MP3)
Launched in 1995, MP3 remains one of the most ubiquitous audio formats in the world. This guide explains how psychoacoustic compression works, explains the differences between MPEG-1 and MPEG-2 implementations, and finds out where MP3 works – and where it doesn’t.
Network Traffic Engineering: Head-Of-Line Blocking - Why QUIC Changes The Rules
Head-of-line blocking turns minor packet loss into visible glitches by stalling entire TCP streams until missing data is retransmitted. Eliminating cross-stream blocking by multiplexing independent streams over UDP, QUIC might be the answer for OTT delivery, cloud workflows and the…
Standards: Audio - Standards For Audio Coding
Audio coding demands very different tools and workflows to video, but the same fundamental principles around quality apply to both. This guide surveys the standards, codecs and container formats you need to navigate modern audio workflows.
Broadcast Standards – The Science Of AI
Artificial Intelligence is already an integral part of our everyday lives and it is already making our lives more productive. But it is far from risk-free.