Optimal performance of Graph Convolutional Networks on the Contextual Stochastic Block Model
For Graph Neural Networks, oversmoothing denotes the homogenization of vertex embeddings as the number of layers increases. To better understand this phenomenon, we study community detection with a linearized Graph Convolutional Network on the Contextual Stochastic Block Model. We express the distribution of the embeddings in each community as a Gaussian mixture over a low-dimensional latent space, with explicit formulas in the case of a single layer. This yields tractable estimators for classification accuracy at finite depth. Numerical experiments suggest that modeling with a single Gaussian is insufficient and that the impact of depth may be more complex than previously anticipated.
Cite this item
Dalle, G., & Thiran, P. (2024, November 16). Optimal performance of Graph Convolutional Networks on the Contextual Stochastic Block Model [Conference Poster]. The Third Learning On Graphs Conference, Online, December 2, 2024. https://infoscience.epfl.ch/handle/20.500.14299/243027
Click Copy to copy the citation, or select the text manually.
88_Optimal_performance_of_Grap.pdf
Main Document
Accepted version
openaccess
CC BY
2.48 MB
Adobe PDF
dcd77fc51a051797cad24474f9b78a4f