Optimization

Adaptive Training

Title	Year	Author	Link	Memo
Learning-Rate-Free Learning by D-Adaptation	2023 ICML	Aaron Defazio et al	pdf	automatically set up learning rate which achieves optimal convergence rate under some conditions

Todo

• Training Deep Networks without Learning Rates Through Coin Betting