The Science Of AI: Appendix B - Taxonomy Of ML Training Methods vs Algorithms

These are training methods and the algorithms that are appropriate to deploy when using them. Conversely, choosing an algorithm determines the training method you should use.


This is an Appendix to our series of articles on Broadcast Standards – The Science Of AI.


Supervised Learning
  • Statistical regression.
  • Statistical classification.
  • Statistical clustering (Cluster analysis).
  • Dimensionality reduction.
Semi-Supervised Learning (SSL)
  • Self-training.
  • Co-training.
  • Generative Adversarial Networks (GANs) for SSL.
  • Graph-based SSL.
Reinforcement Learning
  • Q-Learning.
  • State-Action-Reward-State-Action (SARSA).
  • Deep Q-Networks (DQN).
  • Policy Gradient Methods.
  • Actor-Critic Methods.
  • Deep Deterministic Policy Gradient (DDPG).
  • Proximal Policy Optimization (PPO).
  • Trust Region Policy Optimization (TRPO).
Ensemble Learning
  • Bootstrap Aggregating (aka Bagging).
  • Random Forest of Decision Trees.
  • Boosting weak learning methods into strong learners.
  • Gradient Boosting.
  • Adaptive Boosting (AdaBoost).
  • Stacking.
  • Voting Classifier.
  • Blending.
Deep Learning
  • Convolutional Neural Networks (CNN).
  • Recurrent Neural Networks (RNN).
  • Long Short-Term Memory Networks (LSTM).
  • Gated Recurrent Unit (GRU).
  • Auto-encoders.
  • Generative Adversarial Networks (GANs).
  • Transformer Networks.
  • Bidirectional Encoder Representations from Transformers (BERT).
  • Generative Pre-trained Transformer (GPT).
Probabilistic Reasoned Learning
  • Bayesian Networks.
  • Hidden Markov Models (HMM).
  • Markov Chain Monte Carlo (MCMC).
  • Gaussian Processes.
Instance-Based Learning
  • K-Nearest Neighbors (KNN).
  • Locally Weighted Learning.
  • Case-Based Reasoning.
Evolutionary (Darwinian) Learning
  • Genetic Algorithms (GA).
  • Genetic Programming (GP).
  • Evolutionary Strategies (ES).
  • Differential Evolution (DE).
Hybrid Learning
  • Neural Evolution (Neural nets and GA).
  • Neuro-Fuzzy Systems (Neural nets and fuzzy logic).

You might also like...

Network Traffic Engineering: Why MPEG-TS Is Still The Standard

MPEG transport stream (MPEG TS) was designed in the 1990s to deliver continuous video and audio over unreliable, one-way networks, such as satellite, terrestrial RF, and cable, where packet loss and corruption are expected. But it is still prevalent in…

Standards: Video - High Efficiency Video Coding (HEVC)

Designed to halve the bitrate of AVC while supporting resolutions up to 16K, HEVC represents a significant leap in video coding efficiency. This guide explores its profiles, tiers and levels, and examines whether it can overcome the challenges of entrenched…

SMPTE Education Launches Summer 2026 Lineup Of IP And ST 2110 Courses

Boasting two standalone courses, an intensive boot camp, and a hands-on practical lab, SMPTE Education has launched its summer 2026 Lineup of IP and ST 2110 Courses.

Standards: Video - Advanced Video Coding (AVC)

AVC remains one of the most widely deployed video codecs in the world, but navigating its profiles, levels and signaling mechanisms is far from straightforward.

Network Traffic Engineering: RIST & SRT - The Success Of ARQ Based Protocols

IP networks are inherently unreliable. We kick off this series on IP Network Traffic Engineering with a look at how RIST and SRT give broadcast engineers user-configurable control over the latency-versus-reliability trade-off for real-time media streaming.