Video coding based on audio-visual attention

This paper proposes an efficient video coding method based on audio-visual attention, which is motivated by the fact that cross-modal interaction significantly affects humans’ perception of multimedia experiences. First, we propose an audio-visual source localization method to locate the sound source in a video sequence. Then, its result is used for applying spatial blurring to the images in order to reduce redundant high-frequency information and achieve coding efficiency. We demonstrate the effectiveness of the proposed method for H.264/AVC coding along with the results of a subjective test.


Published in:
Proceedings of the IEEE International Conference on Multimedia and Expo (ICME'09)
Presented at:
IEEE International Conference on Multimedia and Expo (ICME'09), New York, USA
Year:
2009
Keywords:
Laboratories:




 Record created 2009-03-12, last modified 2018-01-28

External link:
Download fulltext
n/a
Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)