Lower and upper bounds for approximation of the Kullback-Leibler divergence between Gaussian Mixture Models
Many speech technology systems rely on Gaussian Mixture Models (GMMs). The need for a comparison between two GMMs arises in applications such as speaker verification, model selection or parameter estimation. For this purpose, the Kullback-Leibler (KL) divergence is often used. However, since there is no closed form expression to compute it, it can only be approximated. We propose lower and upper bounds for the KL divergence, which lead to a new approximation and interesting insights into previously proposed approximations. An application to the comparison of speaker models also shows how such approximations can be used to validate assumptions on the models.
durrieuThiranKelly_kldiv_icassp2012_R1.pdf
Preprint
openaccess
604.21 KB
Adobe PDF
f2f9ee128a323d8ef84713e9841e1a99