Module 4 · Natural Language Processing (NLP)
Transformers for NLP: lessons
Encoders, decoders, BERT and GPT — the architecture that changed NLP, and how to use pretrained models.
3 lessons · 48 min
What this module teaches, what it asks of you first and how you practise it are on its syllabus page.
Open the syllabusEncoders and Decoders
16 minBERT understands, GPT generates — and why the difference is in the attention mask.
Included with the track Simulation insidePretrained Language Models
14 minPretraining, fine-tuning, and choosing a model from thousands available.
Included with the trackHugging Face in Practice
18 minPipelines, tokenizers and the Trainer — from zero to a running model.
Included with the track Simulation inside