University Track: The Full Lecture Treatment
Semester-grade depth: Stanford CS224N's contextual-embedding and transformer lectures, MIT 6.S191, NPTEL and Balaji's pretraining-vs-finetuning lecture.
Playlist by @bert_pretraining_turn
7 tracks, shared on Audicious.
- BERT 05 - Pretraining And Finetuning — Balaji Srinivasan
- Lec 18 | Pre-Training Strategies: ELMo, BERT — NPTEL IIT Delhi
- MIT 6.S191 (2023): Recurrent Neural Networks, Transformers, and Attention — Alexander Amini
- Stanford CS224N: NLP with Deep Learning | Winter 2019 | Lecture 13 – Contextual Word Embeddings — Stanford Online
- Stanford CS224N: NLP with Deep Learning | Winter 2019 | Lecture 14 – Transformers and Self-Attention — Stanford Online
- Stanford CS224N NLP with Deep Learning | 2023 | Lecture 8 - Self-Attention and Transformers — Stanford Online
- Stanford CME295 Transformers & LLMs | Autumn 2025 | Lecture 1 - Transformer — Stanford Online