Let Your Body Speak: Communicative Cue Extraction on Natural Interaction Using RGBD Data

Employment interviews are relevant scenarios for the study of social interaction. In this setting, social skills play an important role, even though the interactions between potential employers and candidates are often limited. One fundamental aspect of social interaction is the use of nonverbal communication, which affects how we are socially perceived. We present a method to automatically extract body communicative cues from one-on-one conversations recorded with Kinect devices. First, we find the three-dimensional position of hands and head of the subject, and, aided by training data, we infer the upper body pose. Then, we use the inferred poses to perform action recognition and build person-specific activity descriptors. We evaluate our system with both domain-specific and public, generic datasets, and show competitive performance.


Published in:
Ieee Transactions On Multimedia, 17, 10, 1721-1732
Year:
2015
Publisher:
Piscataway, Ieee-Inst Electrical Electronics Engineers Inc
ISSN:
1520-9210
Keywords:
Laboratories:




 Record created 2015-12-02, last modified 2018-01-28


Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)