Multi-Modal Audio-Visual Event Recognition for Football Analysis

The recognition of events within multi-modal data is a challenging problem. In this paper we focus on the recognition of events by using both audio and video data. We investigate the use of data fusion techniques in order to recognise these sequences within the framework of Hidden Markov Models (HMM) used to model audio and video data sequences. Specifically we look at the recognition of play and break sequences in football and the segmentation of football games based on these two events. Recognising relatively simple semantic events such as this is an important step towards full automatic indexing of such video material. These experiments were done using approximately 3 hours of data from two games of the Euro96 competition. We propose that modelling the audio and video streams separately for each sequence and fusing the decisions from each stream should yield an accurate and robust method of segmenting multi-modal data.

Publié dans:
Proc. IEEE Workshop on Neural Networks for Signal Processing (NNSP)
Présenté à:
Proc. IEEE Workshop on Neural Networks for Signal Processing (NNSP)
Toulouse, France
IDIAP-RR 03-12

 Notice créée le 2006-03-10, modifiée le 2019-12-05

Télécharger le documentPDF
Liens externes:
Télécharger le documentURL
Télécharger le documentRelated documents
Évaluer ce document:

Rate this document:
(Pas encore évalué)