University Track: The Full Lecture Treatment

Semester-grade depth: Stanford CS224N's contextual-embedding and transformer lectures, MIT 6.S191, NPTEL and Balaji's pretraining-vs-finetuning lecture.

Playlist by @bert_pretraining_turn

7 tracks, shared on Audicious.

  1. BERT 05 - Pretraining And Finetuning — Balaji Srinivasan
  2. Lec 18 | Pre-Training Strategies: ELMo, BERT — NPTEL IIT Delhi
  3. MIT 6.S191 (2023): Recurrent Neural Networks, Transformers, and Attention — Alexander Amini
  4. Stanford CS224N: NLP with Deep Learning | Winter 2019 | Lecture 13 – Contextual Word Embeddings — Stanford Online
  5. Stanford CS224N: NLP with Deep Learning | Winter 2019 | Lecture 14 – Transformers and Self-Attention — Stanford Online
  6. Stanford CS224N NLP with Deep Learning | 2023 | Lecture 8 - Self-Attention and Transformers — Stanford Online
  7. Stanford CME295 Transformers & LLMs | Autumn 2025 | Lecture 1 - Transformer — Stanford Online