← Back to Home

Section 06 · A. Build the foundation

Deep Learning Foundations

From one neuron to a trained network: the forward pass, why non-linearity matters, backprop, optimisers and the tricks that stabilise training.

25topics233interview Q&A129practice problems25videos

Topics in this section

Each topic pairs a video with the theory, interview questions & answers, and practice problems whose solutions unlock as you complete them.

06.1
The Neuron, the Net & Forward Pass
Video7 Q&A5 practice22 min
06.2
Training — Backprop, Optimisers & Regularisation
Video7 Q&A5 practice24 min
06.3
CNNs (vision)
Video6 Q&A4 practice24 min
06.4
RNNs, LSTMs & Sequences
Video6 Q&A4 practice22 min
06.5
Attention & the Transformer
Video6 Q&A4 practice26 min
06.6
Transfer Learning & Practical Training
Video6 Q&A4 practice24 min
06.7
Generative Models (GANs, VAEs, Diffusion)
Video6 Q&A4 practice24 min
06.8
Computer Vision tasks
Video6 Q&A4 practice24 min
06.9
Deep Learning for NLP
Video6 Q&A4 practice24 min
06.10
Embeddings & Representation Learning
Video6 Q&A4 practice22 min
06.11
PyTorch in practice
Video6 Q&A4 practice24 min
06.12
Deep Learning interview deep-dives
Video6 Q&A4 practice24 min
06.13
Optimisation Deep Dive
Video12 Q&A6 practice24 min
06.14
Initialisation, Normalisation & Training Dynamics
Video12 Q&A6 practice24 min
06.15
Regularisation Deep Dive
Video12 Q&A6 practice22 min
06.16
Self-Supervised Learning Deep Dive
Video12 Q&A6 practice24 min
06.17
Efficient Attention & Long Context
Video12 Q&A6 practice26 min
06.18
Scaling Laws & Mixture-of-Experts
Video12 Q&A6 practice22 min
06.19
Model Compression (Quantisation, Pruning, Distillation)
Video12 Q&A6 practice22 min
06.20
Distributed Training
Video12 Q&A6 practice24 min
06.21
Deep Reinforcement Learning
Video12 Q&A6 practice22 min
06.22
Audio & Speech Deep Learning
Video12 Q&A6 practice22 min
06.23
Multimodal Deep Learning
Video12 Q&A6 practice22 min
06.24
Robustness, Adversarial Examples & OOD
Video12 Q&A6 practice24 min
06.25
Inference Optimisation & Deployment
Video15 Q&A7 practice24 min