Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Journal articles
  4. Modeling Individual and Group Actions in Meetings With Layered HMMs
 
research article

Modeling Individual and Group Actions in Meetings With Layered HMMs

Zhang, Dong
•
Gatica-Perez, Daniel  
•
Bengio, Samy  
Show more
2004
IEEE Transactions on Multimedia

We address the problem of recognizing sequences of human interaction patterns in meetings, with the goal of structuring them in semantic terms. The investigated patterns are inherently group-based (defined by the individual activities of meeting participants, and their interplay), and multimodal (as captured by cameras and microphones). By defining a proper set of individual actions, group actions can be modeled as a two-layer process, one that models basic individual activities from low-level audio-visual features, and another one that models the interactions. We propose a two-layer Hidden Markov Model (HMM) framework that implements such concept in a principled manner, and that has advantages over previous works. First, by decomposing the problem hierarchically, learning is performed on low-dimensional observation spaces, which results in simpler models. Second, our framework is easier to interpret, as both individual and group actions have a clear meaning, and thus easier to improve. Third, different HMM models can be used in each layer, to better reflect the nature of each subproblem. Our framework is general and extensible, and we illustrate it with a set of eight group actions, using a public five-hour meeting corpus. Experiments and comparison with a single-layer HMM baseline system show its validity.

  • Files
  • Details
  • Metrics
Type
research article
DOI
10.1109/TMM.2006.870735
Author(s)
Zhang, Dong
Gatica-Perez, Daniel  
Bengio, Samy  
McCowan, Iain A.
Lathoud, Guillaume  
Date Issued

2004

Published in
IEEE Transactions on Multimedia
Volume

8

Issue

3

Start page

509

End page

520

Note

IDIAP-RR 04-33

URL

URL

http://publications.idiap.ch/downloads/reports/2006/zhang-transaction-mm.pdf

Related documents

http://publications.idiap.ch/index.php/publications/showcite/zhang-rr-04-33
Written at

EPFL

EPFL units
LIDIAP  
Available on Infoscience
February 11, 2010
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/47212
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés