Speaker adaptation and the evaluation of speaker similarity in the EMIME speech-to-speech translation project

This paper provides an overview of speaker adaptation research carried out in the EMIME speech-to-speech translation (S2ST) project. We focus on how speaker adaptation transforms can be learned from speech in one language and applied to the acous- tic models of another language. The adaptation is transferred across languages and/or from recognition models to synthesis models. The various approaches investigated can all be viewed as a process in which a mapping is defined in terms of either acoustic model states or linguistic units. The mapping is used to transfer either speech data or adaptation transforms between the two models. Because the success of speaker adaptation in text-to-speech synthesis is measured by judging speaker simi- larity, we also discuss issues concerning evaluation of speaker similarity in an S2ST scenario.

Presented at:
Proceedings of the 7th ISCA Speech Synthesis Workshop, Kyoto, Japan

 Record created 2010-08-26, last modified 2018-09-13

Download fulltextPDF
External link:
Download fulltextURL
Rate this document:

Rate this document:
(Not yet reviewed)