A tentative lecture/assignment schedule for CS378 "Systems for ML".
| Lecture # | Date | Topic | Assignments |
| 1 | 08-26 (Mon) | Introductions and Course Overview | |
| 2 | 08-28 (Wed) | ML 101 | Setup Tutorail released |
| 08-30 (Fri) | Assignment 1 released | ||
| 09-02 (Mon) | |
||
| 3 | 09-04 (Wed) | Hardware support for ML | |
| 4 | 09-09 (Mon) | More hardware support and Distributed ML | |
| 5 | 09-11 (Wed) | Training parallelism | |
| 6 | 09-16 (Mon) | Collectives | |
| 7 | 09-18 (Wed) | Collectives and programming | Assignment 1 Due |
| 09-20 (Fri) | Assignment 2 released | ||
| 8 | 09-23 (Mon) | ML Compilation | |
| 9 | 09-25 (Wed) | Autograd | |
| 09-30 (Mon) | Quiz 1 | ||
| 10 | 10-02 (Wed) | Transformers | |
| 10-04 (Fri) | Assignment 2 due | ||
| 11 | 10-07 (Mon) | Memory optimizations | Assignment 3 released |
| 12 | 10-09 (Wed) | Guest Lecture 1 – Industry speaker | |
| 13 | 10-14 (Mon) | LLM fine-tuning optimizations | |
| 14 | 10-16 (Wed) | Mixture-of-experts | |
| 10-20 (Sun) | Assignment 3 Due | ||
| 15 | 10-21 (Mon) | Attention optimizations | |
| 16 | 10-23 (Wed) | LLM serving optimizations | Assignment 4 released |
| 17 | 10-28 (Mon) | E2E training example: Meta LLAMA 3.0 | |
| 10-30 (Wed) | Quiz 2 | ||
| 18 | 11-04 (Mon) | Alternative architectures | |
| 19 | 11-06 (Wed) | E2E systems | Assignment 4 due |
| 11-08 (Fri) | Assignment 5 released | ||
| 20 | 11-11 (Mon) | Compound AI systems | |
| 21 | 11-13 (Wed) | LLMOps and AIOps | |
| 22 | 11-18 (Mon) | Guest lecture 2 – Industry speaker | |
| 23 | 11-20 (Wed) | Multitenancy and cluster scheduling | |
| 11-22 (Fri) | Assignment 5 due | ||
| 11-25 (Mon) | |
||
| 11-27 (Wed) | |
||
| 24 | 12-02 (Mon) | Emerging topics discussion 1 – ML for Systems | |
| 25 | 12-04 (Wed) | Emerging topics discussion 2 – Challenges in Sys for ML | |
| 12-09 (Mon) | Quiz 3 | ||