Module 4 · LLMs, Prompt Engineering & Context Engineering
Building with LLM APIs: lessons
Calling APIs, streaming, tool calling, caching, and keeping cost and latency under control in production.
4 lessons · 1h 6m
What this module teaches, what it asks of you first and how you practise it are on its syllabus page.
Open the syllabusYour First API Call
16 minOne endpoint, one request shape: messages, roles and parameters — then streaming so the user is not staring at a blank screen.
Included with the track Simulation insideTool Calling
20 minThe model runs nothing: it asks, your code executes, and the result goes back. Understanding that division of labour is the whole of tool-calling safety.
Included with the track Simulation insideCost, Latency and Caching
16 minAn LLM bill is dominated by input tokens sent over and over. Prompt caching, a trimmed context, batching, and a model that is good enough — in that order.
Included with the track Simulation insideRetries and Rate Limits
14 minThe API will slow down and occasionally fail. An app that survives knows which errors to retry, waits with backoff and jitter, limits concurrency, and has a fallback.
Included with the track Simulation inside