Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Audio-visual synchronization recovery in multimedia content
 
conference paper

Audio-visual synchronization recovery in multimedia content

Lee, Jong-Seok  
•
Ebrahimi, Touradj  
2011
Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP)
International Conference on Acoustics, Speech and Signal Processing (ICASSP)

This paper proposes a method recovering audio-visual synchronization of multimedia content. It exploits the correlation between the acoustic and the visual signals in order to estimate the audio-visual drift existing in the content. By shifting the audio signal relative to the visual signal, the estimation of the drift is obtained by searching for the shift producing the maximal audio-visual correlation. We consider two correlation measures, namely, mutual information and canonical correlation, and compare their performance. Experimental results demonstrate that the method using the canonical correlation is effective in recovering the audio-visual synchronization for both speech and non-speech sequences.

  • Files
  • Details
  • Metrics
Type
conference paper
DOI
10.1109/ICASSP.2011.5946937
Web of Science ID

WOS:000296062402150

Author(s)
Lee, Jong-Seok  
Ebrahimi, Touradj  
Date Issued

2011

Publisher

Ieee Service Center, 445 Hoes Lane, Po Box 1331, Piscataway, Nj 08855-1331 Usa

Published in
Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP)
Start page

2280

End page

2283

Subjects

Audio-visual synchronization

•

mutual information

•

canonical correlation

•

multimedia

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
GR-EB  
Event nameEvent placeEvent date
International Conference on Acoustics, Speech and Signal Processing (ICASSP)

Prague, Czech Republic

May 22-27, 2011

Available on Infoscience
January 18, 2011
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/63060
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés