Representing Text
From one-hot vectors to word embeddings to contextual embeddings — how machines represent the meaning of words.
- 3 lessons
- 50 min
- 4 simulations
Sentiment analysis, topic detection and ticket routing — from TF-IDF + logistic regression to fine-tuned transformers.
A suggestion, never a lock — you can start here.
Every lesson's title and summary is public. The lessons themselves open once you own the track.
Every lesson in Natural Language Processing (NLP)Every preprocessing step destroys information. This lesson is about deciding deliberately what to merge, what to keep, and why the answer differs for TF-IDF and for transformers.
TF-IDF with logistic regression: trains in a second, its weights are readable, and it is often enough. This lesson builds one from 60 reviews all the way to a routing threshold.
Borrow a model that has already read millions of Indonesian sentences, attach a 2,307-parameter classification head, train briefly — then decide honestly whether the result is worth the cost.
One prompt can classify without a single training label. The question is no longer "can it", but when it is cheaper, when it costs more, and how you know it is right.
From one-hot vectors to word embeddings to contextual embeddings — how machines represent the meaning of words.
Named entity recognition, relation extraction, and turning free documents into structured data.
Encoders, decoders, BERT and GPT — the architecture that changed NLP, and how to use pretrained models.
Sentence embeddings, vector databases and evaluating retrieval — the foundation of modern search and RAG.