Adaptive Social Learning for Tracking Rare Transition Markov Chains
Adaptive Social Learning (ASL) enables consistent truth learning in nonstationary environments. In this framework, agents linked by a graph, exchange their local beliefs with neighbors to track some underlying state of interest. This state can drift over time. Previous works have examined the adaptation and learning properties of ASL without relating them to the speed of the drifts. This study assesses the performance of ASL by modeling the true state as a Markov chain. We determine an asymptotic characterization of the ASL tracking performance, revealing the fundamental scaling laws that rule the rare transition regime. We demonstrate that ASL achieves a vanishing probability of error when the average drift time of the Markov chain is smaller than the adaptation time of the ASL algorithm. Simulations illustrate our theoretical findings, providing insights into the ASL performance in dynamic settings.
2-s2.0-85208427020
École Polytechnique Fédérale de Lausanne
École Polytechnique Fédérale de Lausanne
Università degli Studi di Salerno
École Polytechnique Fédérale de Lausanne
2024
9789464593617
1032
1036
REVIEWED
EPFL
| Event name | Event acronym | Event place | Event date |
Lyon, France | 2024-08-26 - 2024-08-30 | ||