Skip to content

Neural Network Foundations

What a neural network actually computes, why the nonlinearity is the whole trick, and how the weights learn.

Level
Beginner
Lessons
4
Total time
1h 20m
Simulations
7
1 free lessonIncluded in Introduction to Deep Learning & Neural Networks · $9
Tools you'll use
  • Python
  • PyTorch
  • NumPy
Skills
  • Neurons & layers
  • Activation functions
  • Gradient descent
  • Backpropagation
  • PyTorch
Try it now — free

This is the real simulation from the module. No account needed.

What you will be able to do

  • Explain what one neuron and one layer compute
  • Show why stacked linear layers stay linear
  • Pick a sensible learning rate by reading the loss curve
  • Write a simple training loop in PyTorch

Before you start

A suggestion, never a lock — you can start here.

  • logistic-regression
Modules that help first

Syllabus

4 lessons · 1h 20m

Every lesson's title and summary is public. The lessons themselves open once you own the track. The lesson marked free can be read in full right now, no account needed.

Every lesson in Introduction to Deep Learning & Neural Networks
  1. A neuron is a weighted sum plus one bending function. Stack a few and a straight line becomes whatever boundary you need.

    FreeRead it free Simulation
  2. Activation Functions: ReLU, GELU and Friends

    15 min

    Why the sigmoid has all but vanished from hidden layers, and what replaced it.

    Included with the track Simulation
  3. Backpropagation Without the Fear

    20 min

    The chain rule, computation graphs, and why one backward pass is enough for millions of weights.

    Included with the track Simulation
  4. Your First Training Loop in PyTorch

    25 min

    From tensors to a trained model: forward, loss, backward, step — and how to read the curves.

    Included with the track Simulation
Lifetime access
$9
Buy the track
More in Introduction to Deep Learning & Neural Networks
Module · Intermediate

Training Deep Networks

Optimizers, learning-rate schedules, initialisation, normalisation and regularisation — what makes training actually converge.

  • 4 lessons
  • 1h 5m
  • 4 simulations
Included in Introduction to Deep Learning & Neural Networks· $9
Module · Intermediate

PyTorch for Deep Learning

Tensors, autograd, nn.Module, DataLoader and GPU training — enough PyTorch to work on your own.

  • 4 lessons
  • 1h 14m
  • 2 simulations
Included in Introduction to Deep Learning & Neural Networks· $9
Module · Intermediate

Convolutional Neural Networks

Convolution, pooling and CNN architectures — why weight sharing makes images learnable.

  • 3 lessons
  • 54 min
  • 4 simulations
Included in Introduction to Deep Learning & Neural Networks· $9
Module · Intermediate

Sequence Models and Transformers

From RNNs and LSTMs to self-attention — the architecture behind every modern LLM.

  • 3 lessons
  • 56 min
  • 3 simulations
Included in Introduction to Deep Learning & Neural Networks· $9