Accessing a Large Multimodal Corpus using an Automatic Content Linking Device

As multimodal data becomes easier to record and store, the question arises as to what practical use can be made of archived corpora, and in particular what tools allowing efficient access to it can be built. We use the AMI Meeting Corpus as a case study to build an automatic content linking device, i.e. a system for real-time data retrieval. The corpus provides not only the data repository, but is used also to simulate ongoing meetings for development and testing of the device. The main features of the corpus are briefly described, followed by an outline of data preparation steps prior to indexing, and of the methods for building queries from ongoing meeting discussions, retrieving elements from the corpus and accessing the results. A series of user studies based on prototypes of the content linking device have confirmed the relevance of the concept, and methods for task-based evaluation are under development.

Kipp, Michael
Martin, Jean-Claude
Paggio, Patrizia
Heylen, Dirk
Published in:
Multimodal Corpora: From Models of Natural Interaction to Systems and Applications, 189-206
Berlin/Heidelberg, Springer-Verlag

 Record created 2010-02-11, last modified 2018-03-17

Rate this document:

Rate this document:
(Not yet reviewed)