Module 5 · Computer Vision with Deep Learning
Vision Transformers and Multimodal Models: lessons
ViT, CLIP and vision-language models — when images and text share one embedding space.
3 lessons · 52 min
What this module teaches, what it asks of you first and how you practise it are on its syllabus page.
Open the syllabusVision Transformers (ViT)
18 minPatches as tokens, and when a ViT beats a CNN.
Included with the track Simulation insideCLIP and Image-Text Embeddings
18 minZero-shot classification and searching images with a sentence.
Included with the track Simulation insideVision-Language Models
16 minLLMs that read images: what they can do, what they cannot yet, and how to test them.
Included with the track