Skip to content

Module 5 · Computer Vision with Deep Learning

Vision Transformers and Multimodal Models: lessons

ViT, CLIP and vision-language models — when images and text share one embedding space.

3 lessons · 52 min

What this module teaches, what it asks of you first and how you practise it are on its syllabus page.

Open the syllabus
  1. Vision Transformers (ViT)

    18 min

    Patches as tokens, and when a ViT beats a CNN.

    Included with the track Simulation inside
  2. CLIP and Image-Text Embeddings

    18 min

    Zero-shot classification and searching images with a sentence.

    Included with the track Simulation inside
  3. Vision-Language Models

    16 min

    LLMs that read images: what they can do, what they cannot yet, and how to test them.

    Included with the track