CrOC: Cross-View Online Clustering for Dense Visual Representation Learning
Learning dense visual representations without labels is an arduous task and more so from scene-centric data. We propose to tackle this challenging problem by proposing a Cross-view consistency objective with an Online Clustering mechanism (CrOC) to discover and segment the semantics of the views. In the absence of hand-crafted priors, the resulting method is more generalizable and does not require a cumbersome pre-processing step. More importantly, the clustering algorithm conjointly operates on the features of both views, thereby elegantly bypassing the issue of content not represented in both views and the ambiguous matching of objects from one crop to the other. We demonstrate excellent performance on linear and unsupervised segmentation transfer tasks on various datasets and similarly for video object segmentation. Our code and pre-trained models are publicly available at https://github.com/stegmuel/CrOC.
WOS:001058542607034
2023-01-01
979-8-3503-0129-8
Ieee Computer Soc
7000
7009
REVIEWED
Event name | Event place | Event date |
Vancouver, Canada | JUN 17-24, 2023 | |
Funder | Grant Number |
Personalized Health and Related Technologies (PHRT) | 2021/344 |
European Research Council (ERC) under the European Union | 101021347 |
EuroCC Belgium | |