Introduction to Algorithms and Complexity

Spring 2021

Week 6: May 7, 2021

• Lecture Notes: Here
• Session Recording: Here

Topics Covered

1. Loss Functions
2. Log Loss and Cross-Entropy
3. Coordinate Descent
4. Gradient Descent
5. Learning Rates, Convergence, Epochs
6. Batched vs. Stochastic Approaches