Learn AI from zero — in the right order.
The terms are laid out in a reading order — each section builds on the previous. Start anywhere; reading time is shown next to each section.
Foundations
The big picture first: what is AI, how does ML fit, why were neural networks a breakthrough, and how does a model actually 'run'?
Machine Learning · In Depth
The three ML styles, classical algorithms, honest evaluation, and the basics of training neural networks — in order.
Core
- 1 Supervised Learning Learning from labeled examples · ~2 min
- 2 Unsupervised Learning Finding structure without labels · ~2 min
- 3 Reinforcement Learning RL · Learning by reward · ~2 min
- 4 Classification Assigning a label from a fixed set · ~2 min
- 5 Regression Predicting a continuous number · ~2 min
- 6 Clustering Grouping by similarity, no labels · ~2 min
Algorithms
- 7 Linear Regression Fitting a straight line · ~2 min
- 8 Logistic Regression Linear classifier with calibrated probabilities · ~2 min
- 9 Decision Tree Recursive yes/no splits · ~2 min
- 10 Random Forest An ensemble of decision trees · ~2 min
- 11 Gradient Boosting Sequentially correcting trees · ~2 min
- 12 Support Vector Machine SVM · Maximum-margin classifier · ~2 min
- 13 k-Nearest Neighbors k-NN · Predict by your neighbors · ~2 min
- 14 K-means Partition data into K clusters · ~2 min
- 15 Naive Bayes Probabilistic classifier with the independence trick · ~2 min
Evaluation
- 16 Overfitting Memorizing instead of learning · ~1 min
- 17 Bias-Variance Trade-off The decomposition of error · ~2 min
- 18 Cross-Validation Honest performance estimation · ~2 min
- 19 Loss Function What the model optimizes · ~2 min
- 20 Precision and Recall Two complementary metrics · ~2 min
- 21 Confusion Matrix Where the model gets it right and wrong · ~2 min
- 22 ROC and AUC Threshold-independent classifier ranking · ~2 min
Deep Learning
- 23 Backpropagation Backprop · Computing gradients across layers · ~2 min
- 24 Gradient Descent The optimizer underneath everything · ~2 min
- 25 Optimizer Adam, AdamW, SGD — what makes training work · ~2 min
- 26 Activation Function Where neurons get their nonlinearity · ~2 min
- 27 Dropout Random neuron deactivation · ~2 min
- 28 Batch Normalization Stabilizing layer activations · ~2 min
Language Models
The core of modern AI: LLMs, their architecture (Transformer), the atomic unit (token), and the context they can see.
Talking to LLMs
The craft of steering a model: prompts, system messages, sampling parameters, and learning by example.
- 1 Prompt The instruction you give an LLM · ~2 min
- 2 System Prompt The persistent instruction · ~2 min
- 3 Temperature The randomness dial · ~2 min
- 4 Top-p Nucleus Sampling · ~2 min
- 5 Top-k Top-k Sampling · ~2 min
- 6 max_tokens Output length cap · ~2 min
- 7 Few-shot Learning Teaching by example · ~2 min
- 8 Chain-of-Thought CoT — Step-by-Step Reasoning · ~2 min
- 9 Streaming Token-by-token output · ~2 min
Limits & Risks
Failure modes, security gaps, and the safety layers you must add in production.
Vectors & Meaning
The infrastructure of RAG: meaning as numbers, vector databases.
Custom Knowledge with RAG
Giving a model external knowledge without retraining — RAG's full stack and advanced variants.
- 1 RAG Retrieval-Augmented Generation · ~2 min
- 2 Chunking Splitting documents for retrieval · ~2 min
- 3 Hybrid Search Keyword + semantic, combined · ~1 min
- 4 BM25 Best Matching 25 — classic relevance score · ~2 min
- 5 Reranker The second-pass ranker · ~2 min
- 6 Knowledge Graph Structured knowledge as nodes + edges · ~2 min
- 7 RAG-Fusion Multi-query + fused ranking · ~2 min
Agents & Tools
Going from chat to action: tool use, agents, the MCP standard.
Training & Optimization
How models are trained, aligned, compressed, and evaluated.
- 1 Fine-tuning Specializing a pretrained model · ~2 min
- 2 RLHF Reinforcement Learning from Human Feedback · ~2 min
- 3 Alignment Tuning models to human values · ~2 min
- 4 LoRA Low-Rank Adaptation · ~2 min
- 5 Quantization Model compression · ~2 min
- 6 Knowledge Distillation Teacher → Student transfer · ~2 min
- 7 Benchmark Standardized evaluation · ~2 min
Running Models
Running models efficiently in production / locally — runtime parameters and memory management.
Advanced & Generative
Frontier topics: reasoning, MoE, and modern generative architectures (image, audio, video).
- 1 Reasoning Model Models that think first · ~2 min
- 2 Mixture of Experts MoE · ~2 min
- 3 Diffusion Model Generation by gradual denoising · ~2 min
- 4 GAN Generative Adversarial Network · ~2 min
- 5 Image Generation Text-to-image · ~2 min
- 6 TTS Text-to-Speech · ~2 min
- 7 ASR Automatic Speech Recognition · ~2 min
- 8 World Model An internal simulator inside the model · ~2 min
- 9 AGI Artificial General Intelligence · ~2 min
Applied AI
The AI/ML applications most products actually ship: forecasting, anomaly detection, recommendations, sentiment.