A tentative lecture/assignment schedule for CS378 "Systems for ML".
Lecture # | Date | Topic | Assignments |
1 | 08-26 (Mon) | Introductions and Course Overview | |
2 | 08-28 (Wed) | ML 101 | Setup Tutorail released |
08-30 (Fri) | Assignment 1 released | ||
09-02 (Mon) | |
||
3 | 09-04 (Wed) | Hardware support for ML | |
4 | 09-09 (Mon) | More hardware support and Distributed ML | |
5 | 09-11 (Wed) | Training parallelism | |
6 | 09-16 (Mon) | Collectives | |
7 | 09-18 (Wed) | Collectives and programming | Assignment 1 Due |
09-20 (Fri) | Assignment 2 released | ||
8 | 09-23 (Mon) | ML Compilation | |
9 | 09-25 (Wed) | Autograd | |
09-30 (Mon) | Quiz 1 | ||
10 | 10-02 (Wed) | Transformers | |
10-04 (Fri) | Assignment 2 due | ||
11 | 10-07 (Mon) | Memory optimizations | Assignment 3 released |
12 | 10-09 (Wed) | Guest Lecture 1 – Industry speaker | |
13 | 10-14 (Mon) | LLM fine-tuning optimizations | |
14 | 10-16 (Wed) | Mixture-of-experts | |
10-20 (Sun) | Assignment 3 Due | ||
15 | 10-21 (Mon) | Attention optimizations | |
16 | 10-23 (Wed) | LLM serving optimizations | Assignment 4 released |
17 | 10-28 (Mon) | E2E training example: Meta LLAMA 3.0 | |
10-30 (Wed) | Quiz 2 | ||
18 | 11-04 (Mon) | Alternative architectures | |
19 | 11-06 (Wed) | E2E systems | Assignment 4 due |
11-08 (Fri) | Assignment 5 released | ||
20 | 11-11 (Mon) | Compound AI systems | |
21 | 11-13 (Wed) | LLMOps and AIOps | |
22 | 11-18 (Mon) | Guest lecture 2 – Industry speaker | |
23 | 11-20 (Wed) | Multitenancy and cluster scheduling | |
11-22 (Fri) | Assignment 5 due | ||
11-25 (Mon) | |
||
11-27 (Wed) | |
||
24 | 12-02 (Mon) | Emerging topics discussion 1 – ML for Systems | |
25 | 12-04 (Wed) | Emerging topics discussion 2 – Challenges in Sys for ML | |
12-09 (Mon) | Quiz 3 |