This is the website for the ML Theory reading group organized by Jacob Abernethy and Vidya Muthukumar in the School of Computer Science at the Georgia Institute of Technology. We meet every Friday at 12:30AM in the CODA building. Email Tyler LaBonte at tlabonte@gatech.edu if you wish to attend.
If you’re looking for the CS7545: Machine Learning Theory course website, click here.
Meetings Schedule and presenters
Fall 2023: Special Session on Implicit Bias
Date | Paper | Presenter |
---|---|---|
06 Oct 2023 | Implicit bias introduction | Vidya Muthukumar |
13 Oct 2023 | Characterizing Implicit Bias in Terms of Optimization Geometry | Kuo-Wei Lai |
20 Oct 2023 | Nati Srebro’s tutorial about implicit bias at Simons Institute | Watch video |
27 Oct 2023 | Implicit Bias of Gradient Descent on Linear Convolutional Networks | Yun-Feng Lo |
03 Nov 2023 | Implicit Bias of Gradient Descent for Wide Two-layer Neural Networks Trained with the Logistic Loss | Matthew Lau |
10 Nov 2023 | Gradient Descent Maximizes the Margin of Homogeneous Neural Networks | Guanghui Wang |
17 Nov 2023 | No meeting due to DeepMath | |
24 Nov 2023 | No meeting due to Thanksgiving | |
01 Dec 2023 | No meeting | |
08 Dec 2023 | Directional convergence and alignment in deep learning | Guanghui Wang |
Implicit Regularization in Matrix Factorization | ||
Implicit Regularization in ReLU Networks with the Square Loss | ||
Neural Tangent Kernel: Convergence and Generalization in Neural Networks |
Previous semesters: Summer 2023, Spring 2023, Fall 2022, Spring 2022, Fall 2018, Spring 2018, Fall 2017