Stream fusion for multi-stream automatic speech recognition

Multi-stream automatic speech recognition (MS-ASR) has been confirmed to boost the recognition performance in noisy conditions. In this system, the generation and the fusion of the streams are the essential parts and need to be designed in such a way to reduce the effect of noise on the final decision. This paper shows how to improve the performance of the MS-ASR by targeting two questions; (1) How many streams are to be combined, and (2) how to combine them. First, we propose a novel approach based on stream reliability to select the number of streams to be fused. Second, a fusion method based on Parallel Hidden Markov Models is introduced. Applying the method on two datasets (TIMIT and RATS) with different noises, we show an improvement of MS-ASR.


Published in:
International Journal Of Speech Technology, 19, 4, 669-675
Year:
2016
Publisher:
New York, Springer Verlag
ISSN:
1381-2416
Keywords:
Laboratories:




 Record created 2017-01-24, last modified 2018-12-03


Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)