Skip to content
Datamewby Intura
Start free
Natural Language Processing (NLP)

Transformers for NLP

Encoders, decoders, BERT and GPT — the architecture that changed NLP, and how to use pretrained models.

Level
Intermediate
Lessons
3
Total time
48 min
Simulations
2
Included in Natural Language Processing (NLP) · $9
Tools you'll use
  • Python
  • PyTorch
Skills
  • BERT
  • GPT
  • Transformers library
Try it now — free

This is the real simulation from the module. No account needed.

What you will be able to do

  • Choose an encoder or decoder model for a task
  • Load and run a model from the Hugging Face Hub

Before you start

A suggestion, never a lock — you can start here.

  • text-representation
Modules that help first

Syllabus

3 lessons · 48 min

Every lesson's title and summary is public. The lessons themselves open once you own the track.

Every lesson in Natural Language Processing (NLP)

  1. Encoders and Decoders

    16 min

    BERT understands, GPT generates — and why the difference is in the attention mask.

    Included with the track Simulation

  2. Pretrained Language Models

    14 min

    Pretraining, fine-tuning, and choosing a model from thousands available.

    Included with the track

  3. Hugging Face in Practice

    18 min

    Pipelines, tokenizers and the Trainer — from zero to a running model.

    Included with the track Simulation
Lifetime access
$9
Buy the track
More in Natural Language Processing (NLP)
Module · Beginner

Representing Text

From one-hot vectors to word embeddings to contextual embeddings — how machines represent the meaning of words.

  • 3 lessons
  • 50 min
  • 4 simulations
Included in Natural Language Processing (NLP)· $9
Module · Intermediate

Text Classification

Sentiment analysis, topic detection and ticket routing — from TF-IDF + logistic regression to fine-tuned transformers.

  • 4 lessons
  • 1h 8m
  • 3 simulations
Included in Natural Language Processing (NLP)· $9
Module · Intermediate

Information Extraction

Named entity recognition, relation extraction, and turning free documents into structured data.

  • 3 lessons
  • 48 min
  • 3 simulations
Included in Natural Language Processing (NLP)· $9
Module · Intermediate

Semantic Search and Sentence Embeddings

Sentence embeddings, vector databases and evaluating retrieval — the foundation of modern search and RAG.

  • 3 lessons
  • 46 min
  • 3 simulations
Included in Natural Language Processing (NLP)· $9