Read the Paper: BERT Walkthroughs That Go Deep

The 2018 paper line by line: what 'pre-training of deep bidirectional transformers' actually claims.

Playlist by @bert_pretraining_turn

5 tracks, shared on Audicious.

1. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding — Yannic Kilcher
2. BERT Explained! — Connor Shorten
3. BERT explained: Training, Inference, BERT vs GPT/LLamA, Fine tuning, [CLS] token — Umar Jamil
4. BERT for pretraining Transformers — Shusen Wang
5. Transformer and BERT Pre-training — Sebastian Hofstätter