Skip to content

Back to the catalog

Understanding AI, Part I: The Machines That We Taught
galaxy.comarticle

Understanding AI, Part I: The Machines That We Taught

Galaxy Research's explainer traces AI's intellectual history from the 1956 Dartmouth Workshop and the Logic Theorist through the symbolic-AI era (expert systems like Mycin and XCON, the Cyc project) to the sub-symbolic/connectionist revival (Perceptron, Hopfield networks, backpropagation, LeCun's CNN zip-code reader) that culminated in deep learning and the 2017 Transformer architecture. It then surveys three machine-learning paradigms (supervised, reinforcement, unsupervised) and five deep generative architectures (autoregressive, diffusion, GANs, VAEs, normalizing flows), closing with how modern LLM chatbots combine these via pretraining, SFT, and RLHF, and how multimodal, reasoning, RAG, agent, and world-model systems extend base LLMs.

TL;DR A historical and technical primer tying symbolic vs. sub-symbolic AI lineage to the ML paradigms and generative architectures (autoregressive, diffusion, GAN, VAE, normalizing flow) behind today's LLMs.

Organisations named here

  • Galaxy Digital Inc.
  • NVIDIA
  • OpenAI
  • Defense Advanced Research Projects Agency
  • Dartmouth College
  • Google
  • World Labs
  • U.S. Postal Service
  • Alfred North Whitehead
  • Atlas
  • Baruch Spinoza
  • Bertrand Russell
  • DARPA
  • David Hume
  • David Rumelhart
  • Edward Feigenbaum
  • Frank Rosenblatt
  • George Berkeley
  • Gottfried Wilhelm Leibniz
  • John Hopfield
  • John Locke
  • Kimi
  • Marvin Minsky
  • Principia Mathematica
  • René Descartes
  • Seymour Papert

Technologies named here

  • ChatGPT
  • Claude
  • Gemini
  • Kimi
  • GPT-6 Astra
  • Logic Theorist
  • Mycin
  • XCON
  • Cyc
  • Perceptron
  • Atlas

Techniques named here

  • Symbolic AI
  • Sub-symbolic AI
  • Supervised learning
  • Reinforcement learning
  • Unsupervised learning
  • Deep learning
  • Backpropagation
  • Transformer architecture
  • Autoregressive models
  • Diffusion models
  • Generative Adversarial Networks
  • Variational Autoencoders
  • Normalizing flows
  • Three-stage LLM training
  • Multimodal models
  • Reasoning models
  • RAG
  • Agents
  • Embodied and world models

Also named here

  • Transformer
  • Jensen Huang
  • Greg Brockman
  • Alan Turing
  • Geoffrey Hinton
  • Yann LeCun
  • Fei-Fei Li
  • Galaxy Digital