research article
Computational complexity of deep learning: fundamental limitations and empirical phenomena
October 31, 2024
This manuscript is the lecture notes of B. Barak’s course in the Les Houches ‘Statistical Physics and Machine Learning’ summer school in 2022. It surveys various proxies for computational hardness in random planted problems, from the low-degree likelihood ratio to statistical query complexity and the Franz–Parisi criterion, as well as the various relationships between those criteria. We also present a few aspects of the study of deep learning, from both a theoretical and empirical point of view.
Loading...
Name
10.1088_1742-5468_ad3a5b.pdf
Type
Main Document
Version
Published version
Access type
openaccess
License Condition
CC BY
Size
1.47 MB
Format
Adobe PDF
Checksum (MD5)
0b4715b16d4dd8e8414de079089b2ae3