Schedule 2026

Problem Sets and Exams

Clone the notebooks repository to get the Jupyter notebooks, and submit on Canvas.

1. Due Midnight PST on January 13, 2026 - Problem Set 1 and ipynb
2. Due Midnight PST on January 25, 2026 - Problem Set 2 and ipynb

Schedule

1. January 5 - Course Overview

2. January 7 - Representation learning in Course Overview and Python Frameworks

3. January 12 - Rethinking Least Squares and Iterative Methods (only conditioning, and preconditioning)

   • Self-study in Iterative Methods: Stationary Iterative Methods, Structured Linear Operators, Krylov Subspace Methods, and eigenvalue problems
   • Self-study in Factorizations and Direct Methods, especially Computational Complexity, Matrix Structure, and Matrix Factorizations

4. January 14 - High-Dimensional Optimization for ML and and Differentiable Everything!

5. January 19 - Stochastic Optimization and ML Engineering

6. January 21 - Deep Learning and Representation Learning

7. January 26 - Overparameterization and Inductive Bias and High Dimensional Probability

8. January 28 - Solving Dynamic Equilibrium Problems with ML

9. February 2 - Kernel Methods and Gaussian Processes

10. February 4 - Embeddings, NLPs, and LLMS

11. February 9 - Transformers and Attention

12. February 11 - Bayesian Methods if time permits.

13. February 16 - SPRING BREAK (NO CLASS)

14. February 18 - SPRING BREAK (NO CLASS)

15. February 23 - Switch to second half of course