Computational complexity of deep learning: fundamental limitations and empirical phenomena
This manuscript is the lecture notes of B. Barak’s course in the Les Houches ‘Statistical Physics and Machine Learning’ summer school in 2022. It surveys various proxies for computational hardness in random planted problems, from the low-degree likelihood ratio to statistical query complexity and the Franz–Parisi criterion, as well as the various relationships between those criteria. We also present a few aspects of the study of deep learning, from both a theoretical and empirical point of view.
Cite this item
Barak, B., Carrell, A., Favero, A., Li, W., Stephan, L., & Zlokapa, A. (2024). Computational complexity of deep learning: fundamental limitations and empirical phenomena. Journal of Statistical Mechanics: Theory and Experiment, 2024(10), Article 104008. https://doi.org/10.1088/1742-5468/ad3a5b
Click Copy to copy the citation, or select the text manually.
10.1088_1742-5468_ad3a5b.pdf
Main Document
openaccess
CC BY
1.47 MB
Adobe PDF
0b4715b16d4dd8e8414de079089b2ae3