The Chain-Rule Engine: Automatic Differentiation

Backprop is reverse-mode automatic differentiation wearing a hat — the intellectual history from Cauchy and Linnainmaa to Pearlmutter, plus working tutorials.

Playlist by @backprop_paper

10 tracks, shared on Audicious.

  1. Barak A. Pearlmutter – Automatic Differentiation: History and Headroom — MILA: Montreal Institute for Learning Algorithms
  2. Lightning Talk: Sophia Gold on An Intellectual History of Automatic Differentiation — PapersWeLove
  3. Finding The Slope Algorithm (Forward Mode Automatic Differentiation) - Computerphile — Computerphile
  4. Intuition behind reverse mode algorithmic differentiation (AD) — Joris Gillis
  5. Automatic Differentiation in 10 minutes with Julia — The Julia Programming Language
  6. What is Automatic Differentiation? — Ari Seff
  7. Lecture 5 Part 2: Forward Automatic Differentiation via Dual Numbers — MIT OpenCourseWare
  8. Lecture 8 Part 2: Automatic Differentiation on Computational Graphs — MIT OpenCourseWare
  9. Why is adjoint algorithmic differentiation mystified? Uwe Naumann, Aachen University, explains — QuantMinds TV
  10. L6.2 Understanding Automatic Differentiation via Computation Graphs — Sebastian Raschka