Generalization

Learning Theory

Title	Year	Author	Link	Memo
Generalization on the Unseen, Logic Reasoning and Degree Curriculum	2023	Emmanuel Abbe et al.	pdf	learning of logical functions with focus on the generalization on the unseen

Robustness

Title	Year	Author	Link	Memo
Shortcut Learning in Deep Neural Networks	2021	Robert Geirhos et al.	pdf	shortcut learning problems: where shortcuts are decision rules that perform well on test set but fail on out-of-distribution datasets

Empirical Analysis

Title	Year	Author	Link	Memo
UNDERSTANDING DEEP LEARNING REQUIRES RETHINKING GENERALIZATION	2017 ICLR best paper	Chiyuan Zhang et al	pdf	DNN can fit to random label
Reconciling modern machine learning practice and the bias-variance trade-of	2019	Mikhail Belkina et al	pdf	double descent