A multimodal approach to extract optimized audio features for speaker detection
We present a method that exploits an information theoretic framework to extract optimal audio features with respect to the video features. A simple measure of mutual information between the resulting audio features and the video ones allows to detect the active speaker among different candidates. The results show that our method is able to exploit the shared speech information contained in audio and video signals to recover their common source.
Keywords: LTS1 ; LTS5 ; multimodal; speaker detection; mutual information;
Record created on 2006-06-14, modified on 2016-08-08