Loading...
conference paper
Finite Littlestone Dimension Implies Finite Information Complexity
2022
2022 IEEE International Symposium on Information Theory (ISIT)
We prove that every online learnable class of functions of Littlestone dimension d admits a learning algorithm with finite information complexity. Towards this end, we use the notion of a globally stable algorithm. Generally, the information complexity of such a globally stable algorithm is large yet finite, roughly exponential in d. We also show there is room for improvement; for a canonical online learnable class, indicator functions of affine subspaces of dimension d, the information complexity can be upper bounded logarithmically in d.
Type
conference paper
Authors
Publication date
2022
Published in
2022 IEEE International Symposium on Information Theory (ISIT)
Start page
3055
End page
3060
Peer reviewed
REVIEWED
EPFL units
Event name | Event place | Event date |
Espoo, Finland | June 26-July 1, 2022 | |
Available on Infoscience
December 9, 2022
Use this identifier to reference this record