Modeling Scenes with Local Descriptors and Latent Aspects

We present a new approach to model visual scenes in image collections, based on local invariant features and probabilistic latent space models. Our formulation provides answers to three open questions:(1) whether the invariant local features are suitable for scene (rather than object) classification; (2) whether unsupervised latent space models can be used for feature extraction in the classification task; and (3) whether the latent space formulation can discover visual co-occurrence patterns, motivating novel approaches for image organization and segmentation. Using a 9500-image dataset, our approach is validated on each of these issues. First, we show with extensive experiments on binary and multi-class scene classification tasks, that a bag-of-visterm representation, derived from local invariant descriptors, consistently outperforms state-of-the-art approaches. Second, we show that Probabilistic Latent Semantic Analysis (PLSA) generates a compact scene representation, discriminative for accurate classification, and significantly more robust when less training data are available. Third, we have exploited the ability of PLSA to automatically extract visually meaningful aspects, to propose new algorithms for aspect-based image ranking and context-sensitive image segmentation.

Published in:
IEEE Int. Conf. on Computer Vision
Presented at:
IEEE Int. Conf. on Computer Vision
IDIAP-RR 04-79

 Record created 2006-03-10, last modified 2018-01-27

External links:
Download fulltextURL
Download fulltextRelated documents
Download fulltextn/a
Rate this document:

Rate this document:
(Not yet reviewed)