Learning and Adaptive Data Analysis via Maximal Leakage
There has been growing interest in studying connections between generalization error of learning algorithms and information measures. In this work, we generalize a result that employs the maximal leakage, a measure of leakage of information, and explore how this bound can be applied in different scenarios. The main application can be found in bounding the generalization error. Rather than analyzing the expected error, we provide a concentration inequality. In this work, we do not require the assumption of sigma-sub gaussianity and show how our results can be used to retrieve a generalization of the classical bounds in adaptive scenarios (e.g., McDiarmid's inequality for c-sensitive functions, false discovery error control via significance level, etc.).
Cite this item
Esposito, A. R., Gastpar, M., & Issa, I. (2019). Learning and Adaptive Data Analysis via Maximal Leakage. 2019 Ieee Information Theory Workshop (Itw), Information Theory Workshop, 324–328. https://doi.org/10.1109/ITW44776.2019.8989057
Click Copy to copy the citation, or select the text manually.
WOS:000540384500066
2019-01-01
New York
978-1-5386-6900-6
Information Theory Workshop
324
328
REVIEWED
EPFL
| Event name | Event place | Event date |
Visby, SWEDEN | Aug 25-28, 2019 | |