Finite Littlestone Dimension Implies Finite Information Complexity
We prove that every online learnable class of functions of Littlestone dimension d admits a learning algorithm with finite information complexity. Towards this end, we use the notion of a globally stable algorithm. Generally, the information complexity of such a globally stable algorithm is large yet finite, roughly exponential in d. We also show there is room for improvement; for a canonical online learnable class, indicator functions of affine subspaces of dimension d, the information complexity can be upper bounded logarithmically in d.
Cite this item
Pradeep, A., Nachum, I., & Gastpar, M. C. (2022). Finite Littlestone Dimension Implies Finite Information Complexity. 2022 IEEE International Symposium on Information Theory (ISIT), 3055–3060. https://doi.org/10.1109/ISIT50566.2022.9834457
Click Copy to copy the citation, or select the text manually.
2022
3055
3060
REVIEWED
EPFL
| Event name | Event place | Event date |
Espoo, Finland | June 26-July 1, 2022 | |