Skip to content
CoursesTrack
1 free lesson21 simulations

Introduction to Deep Learning & Neural Networks

Neural networks, from a single neuron to the transformer.

Level
Intermediate
Modules
6
Lessons
21
Total time
6h 46m
Introduction to Deep Learning & Neural Networks
Tools you'll use
  • Python
  • PyTorch
  • NumPy

After this track you can

  • Understand backpropagation as the chain rule, not as magic
  • Train deep networks with the right optimizer and regularisation
  • Build and train a convolutional network for images in PyTorch
  • Explain attention and why transformers replaced RNNs

Deep learning on proper foundations: what a single neuron computes, why stacking them bends the decision boundary, backpropagation as the chain rule, training deep networks without them blowing up, PyTorch, convolutional networks and transformers. The first lesson is free — build your own network right inside it and watch it learn.

Read a free lesson: What a Neural Network Actually Computes

What you'll learn, module by module

6 modules · 21 lessons

Every module and lesson in this track. Lessons marked free are open to everyone; the rest open once you own the track.

Every lesson in this track, with summaries
  1. 01

    What a neural network actually computes, why the nonlinearity is the whole trick, and how the weights learn.

    1 free lesson4 lessons1h 20m7 simulations
    1. 1What a Neural Network Actually ComputesFree
    2. 2Activation Functions: ReLU, GELU and Friends
    3. 3Backpropagation Without the Fear
    4. 4Your First Training Loop in PyTorch
  2. 02

    Optimizers, learning-rate schedules, initialisation, normalisation and regularisation — what makes training actually converge.

    4 lessons1h 5m4 simulations
    1. 1Optimizers: SGD, Momentum, Adam
    2. 2Learning-Rate Schedules and Warmup
    3. 3Initialisation and Normalisation
    4. 4Regularisation: Dropout, Weight Decay, Early Stopping
  3. 03

    Tensors, autograd, nn.Module, DataLoader and GPU training — enough PyTorch to work on your own.

    4 lessons1h 14m2 simulations
    1. 1Tensors and Autograd
    2. 2Building Models with nn.Module
    3. 3Datasets and DataLoaders
    4. 4GPUs and Mixed Precision
  4. 04

    Convolution, pooling and CNN architectures — why weight sharing makes images learnable.

    3 lessons54 min4 simulations
    1. 1How Convolutions Work
    2. 2CNN Architectures: from LeNet to ResNet
    3. 3Transfer Learning
  5. 05

    From RNNs and LSTMs to self-attention — the architecture behind every modern LLM.

    3 lessons56 min3 simulations
    1. 1RNNs and LSTMs
    2. 2The Attention Mechanism
    3. 3The Transformer Architecture
  6. 06

    Debugging training, tracking experiments, and one capstone from raw data to an evaluated model.

    3 lessons1h 17m1 simulation
    1. 1Debugging Neural Networks
    2. 2Tracking Experiments
    3. 3Capstone: an Image Classifier

Try a simulation from this track

The real one, from a lesson — it runs in your browser. No account needed.

Save with a career-path bundle

This track is part of a larger path. Buy the whole path as a bundle and every track in it costs 40% less.

Career-path bundle40% off

Data Scientist Career Path

  1. 1Python for Data Science
  2. 2Data Analytics: Statistics & Data Visualization
  3. 3Introduction to Machine Learning
  4. 4Introduction to Deep Learning & Neural Networks
  5. 5MLOps: Deploying Machine Learning & Deep Learning Models
Career-path bundle40% off

AI Engineer Career Path

  1. 1Python for Data Science
  2. 2Introduction to Deep Learning & Neural Networks
  3. 3LLMs, Prompt Engineering & Context Engineering
  4. 4Building AI Agents: Harness Engineering
  5. 5MLOps: Deploying Machine Learning & Deep Learning Models
  6. 6Computer Vision with Deep Learning
  7. 7Natural Language Processing (NLP)
Lifetime access
$9
Buy