← Back to Home

Section 07 · A. Build the foundation

LLMs & Generative AI

The highest-leverage 2026 interview topic: how an LLM actually works (tokens → embeddings → attention → next-token), and how to steer it with prompts and decoding.

25topics252interview Q&A156practice problems25videos

Topics in this section

Each topic pairs a video with the theory, interview questions & answers, and practice problems whose solutions unlock as you complete them.

07.1
Tokens, Embeddings & the Transformer
Video7 Q&A5 practice24 min
07.2
Prompting & Decoding
Video7 Q&A5 practice22 min
07.3
RAG End-to-End
Video10 Q&A7 practice26 min
07.4
Fine-tuning vs RAG vs Prompting
Video10 Q&A6 practice22 min
07.5
Evaluation & Hallucination Control
Video12 Q&A7 practice24 min
07.6
Training Stages & Alignment
Video10 Q&A6 practice22 min
07.7
Advanced Prompting & Reasoning
Video11 Q&A7 practice22 min
07.8
LLM Application Architecture
Video10 Q&A7 practice24 min
07.9
LLM Limitations, Safety & Cost
Video10 Q&A7 practice22 min
07.10
Multimodal & Frontier Models
Video10 Q&A6 practice22 min
07.11
LLM APIs & the Claude ecosystem
Video10 Q&A7 practice22 min
07.12
LLM interview deep-dives
Video11 Q&A7 practice22 min
07.13
Advanced RAG (rerankers, hybrid, query rewriting)
Video10 Q&A6 practice24 min
07.14
Vector Databases & Embedding Models
Video10 Q&A6 practice22 min
07.15
Function Calling & Tool Use Deep Dive
Video13 Q&A7 practice24 min
07.16
AI Agents (ReAct, planning, reflection)
Video10 Q&A6 practice24 min
07.17
Multi-Agent Systems & Orchestration
Video10 Q&A6 practice22 min
07.18
LLM Fine-tuning Recipes (SFT, instruction tuning)
Video10 Q&A6 practice22 min
07.19
PEFT — LoRA, QLoRA & Adapters
Video10 Q&A6 practice22 min
07.20
Preference Optimisation (RLHF, DPO, KTO)
Video10 Q&A6 practice22 min
07.21
LLM Inference Serving (vLLM, batching, KV-cache)
Video10 Q&A6 practice22 min
07.22
LLM Quantisation in practice (GPTQ, AWQ, GGUF)
Video10 Q&A6 practice22 min
07.23
LLM Observability, Tracing & Eval pipelines
Video11 Q&A6 practice22 min
07.24
Prompt Caching, Routing & Cost Optimisation
Video10 Q&A6 practice22 min
07.25
Open-Source LLM Landscape & Selection
Video10 Q&A6 practice22 min