SYSTEM FUSION AND SPEAKER LINKING FOR LONGITUDINAL DIARIZATION OF TV SHOWS

Performing speaker diarization while uniquely identifying the speakers in a collection of audio recordings is a challenging task. Based on our previous work on speaker diarization and linking, we developed a system for diarizing longitudinal TV show data sets based on the fusion of speaker diarization system outputs and speaker linking. Agreement between multiple diarization outputs is found prior to speaker linking, largely reducing the diarization error rate at the expense of keeping some speech data unlabelled. To deal with noisy clusters, a linear prediction based technique was used to label speakers after linking. Considerable gains for both fusion and labelling are reported. Despite the challenges of the longitudinal diarization task, this system obtained similar performance for linked and non-linked tasks under moderate session variability, highlighting the viability of a linking approach to longitudinal diarization of speech in the presence of noise, music and special audio effects.


Published in:
2016 Ieee International Conference On Acoustics, Speech And Signal Processing Proceedings, 5495-5499
Presented at:
Proceedings of 2016 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2016), Shanghai
Year:
2016
Publisher:
New York, IEEE
ISSN:
1520-6149
ISBN:
978-1-4799-9988-0
Keywords:
Laboratories:




 Record created 2016-05-19, last modified 2018-01-28


Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)