This course will have five largely simple programming 5 assignments:

• Assignment 1: Training and DDP
• Assignment 2: Collective communication puzzles
• Assignment 3: Peeking into ML Compilation
• Assignment 4: Fine-tuning LLMs
• Assignment 5: Quantization and pruning