Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Blind Audiovisual Source Separation Using Sparse Representations
 
Loading...
Thumbnail Image
conference paper

Blind Audiovisual Source Separation Using Sparse Representations

Llagostera Casanovas, Anna  
•
Monaci, Gianluca  
•
Vandergheynst, Pierre  
2007
2007 IEEE International Conference on Image Processing
IEEE International Conference on Image Processing

In this work we present a method to jointly separate active audio and visual structures on a given mixture. Blind Audiovisual Source Separation is achieved exploiting the coherence between a video signal and a one-microphone audio track. The efficient representation of audio and video sequences allows to build relationships between correlated structures on both modalities. Video structures exhibiting strong correlations with the audio signal and that are spatially close are grouped using a robust clustering algorithm that can count and localize audiovisual sources. Using such information and exploiting audio-video correlation, audio sources are also localized and separated. To the best of our knowledge this is the first blind audiovisual source separation algorithm conceived to deal with a video sequence and the corresponding mono audio signal.

  • Files
  • Details
  • Metrics
Type
conference paper
DOI
10.1109/ICIP.2007.4379306
Web of Science ID

WOS:000253487201117

Author(s)
Llagostera Casanovas, Anna  
•
Monaci, Gianluca  
•
Vandergheynst, Pierre  
Date Issued

2007

Published in
2007 IEEE International Conference on Image Processing
Volume

3

Start page

301

End page

304

Subjects

lts2

•

LTS2

•

Audiovisual processing

•

Blind source separation

•

Sparse signal

•

representation

Note

ITS

Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
LTS2  
Event nameEvent placeEvent date
IEEE International Conference on Image Processing

San Antonio, Texas, USA

September, 16-19, 2007

Available on Infoscience
January 24, 2007
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/239983
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés