๐ Basics
Short track on AI: terms and language models โ LLM overview โ prompt engineering, RAG, and LLM agents as separate articles.
- AI basics โ introduction
- ๐ฌ Video ยท reading 5 min / video 4 min
- ๐ท๏ธ Terms: language model, dataset, parameters, AI/ML/NN, foundation models
- ๐ Difficulty: basic
- ๐ Prerequisites: none
- AI basics โ overview
- ๐ฌ Video ยท reading ~14 min / video 9 min
- ๐ LLM overview: use cases, internals (tokens, transformers), prompting, RAG, fine-tuning, chain-of-thought, model families, key terms, risks, trends
- ๐ท๏ธ LLM, transformer, token, temperature, prompt engineering, RAG, fine-tuning, RLHF, chain-of-thought, context window, hallucinations, multimodality, agents
- ๐ Difficulty: basic
- ๐ Prerequisites: none (intro to the series is enough)
- AI basics โ prompt engineering
- โฑ๏ธ ~7 min read ยท no video
- ๐ Zero-shot, few-shot, chain-of-thought, roles, step-back, where prompts come from; mind-map layout; accordions
- ๐ท๏ธ prompt engineering, zero-shot, few-shot, CoT, role prompting, step-back, in-context learning
- ๐ Difficulty: basic
- ๐ Prerequisites: LLM overview recommended
- AI basics โ RAG systems
- โฑ๏ธ ~6 min read ยท no video
- ๐ Why RAG, pipeline stages, chunking, naive vs advanced RAG; accordions
- ๐ท๏ธ RAG, retrieval, embeddings, vector index, chunking, context-conditioned generation
- ๐ Difficulty: basic
- ๐ Prerequisites: LLM overview recommended
- AI basics โ LLM agents
- โฑ๏ธ ~7 min read ยท no video
- ๐ Agent vs chat, planning / memory / tools, mindset, ReAct, multi-agent, who uses them; accordions
- ๐ท๏ธ AI agents, LLM, ReAct, tools, planning, memory, multi-agent systems
- ๐ Difficulty: basic
- ๐ Prerequisites: LLM overview recommended; RAG helps
๐ฅ On Their Shoulders
Short digests from interviews, podcasts, and conferences on AI
- The Future of AI: Why Scaling Alone is No Longer Enough
- ๐ฌ Video ยท reading 12 min / video 8 min (original 52 min)
- ๐ฅ Participants: Nicholas Thompson, Eric Xing, Yoshua Bengio, Yuval Noah Harari, Yejin Choi
- ๐ท๏ธ Terms: scaling, reward hacking, world model, guardrail, AGI, anthropomorphism
- ๐ Difficulty: intermediate
- ๐ Prerequisites: AI basics
๐ Essential Mathematics
Machine learning relies on mathematics that grows out of the school curriculum; to understand how ML works, you need a solid grasp of school-level math.
- Essential Mathematics โ Overview
- ๐ Overview: which math areas are needed for AI/ML and why
- ๐ท๏ธ Linear algebra, calculus, probability and statistics
- ๐ Difficulty: basic
- Math Analysis โ Example of Analysis (Finding ฯrยฒ)
- ๐ Slicing the circle into rings, unrolling into strips 2ฯr ร ฮr โ yields a triangle of area ฯRยฒ
- ๐ท๏ธ Integral, limits, area of circle
- ๐ Difficulty: basic
- Math Analysis โ Derivatives
- ๐ Without this you can’t understand how neural networks learn. Derivative, gradient, chain rule.
- ๐ท๏ธ Gradient descent, backpropagation
- ๐ Difficulty: basic