Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Far-field ASR Using Low-rank and Sparse Soft Targets from Parallel Data
 
conference paper

Far-field ASR Using Low-rank and Sparse Soft Targets from Parallel Data

Dighe, Pranay
•
Bourlard, Hervé
•
Asaei, Afsaneh
2018
2018 Ieee Workshop On Spoken Language Technology (Slt 2018)
IEEE Workshop on Spoken Language Technology

Far-field automatic speech recognition (ASR) of conversational speech is often considered to be a very challenging task due to the poor quality of alignments available for training the DNN acoustic models. A common way to alleviate this problem is to use clean alignments obtained from parallelly recorded close-talk speech data. In this work, we advance the parallel data approach by obtaining enhanced low-rank and sparse soft targets from a close-talk ASR system and using them for training more accurate far-field acoustic models. Specifically, we (i) exploit eigenposteriors and Compressive Sensing dictionaries to learn low-dimensional senone subspaces in DNN posterior space, and (ii) enhance close-talk DNN posteriors to achieve high quality soft targets for training far-field DNN acoustic models. We show that the enhanced soft targets encode the structural and temporal interrelationships among senone classes which are easily accessible in the DNN posterior space of close-talk speech but not in its noisy far-field counterpart. We exploit enhanced soft targets to improve the mapping of far-field acoustics to closetalk senone classes. The experiments are performed on AMI meeting corpus where our approach improves DNN based acoustic modeling by 4.4% absolute (similar to 8% rel.) reduction in WER as compared to a system which doesn't use parallel data. Finally, the approach is also validated on state-of-the-art recurrent and time delay neural network architectures.

  • Details
  • Metrics
Type
conference paper
DOI
10.1109/SLT.2018.8639579
Web of Science ID

WOS:000463141800081

Author(s)
Dighe, Pranay
Bourlard, Hervé
Asaei, Afsaneh
Date Issued

2018

Publisher

IEEE

Publisher place

New York

Published in
2018 Ieee Workshop On Spoken Language Technology (Slt 2018)
ISBN of the book

978-1-5386-4334-1

Series title/Series vol.

IEEE Workshop on Spoken Language Technology

Start page

581

End page

587

Subjects

far-field asr

•

soft targets

•

low-rank sparsity

•

deep neural networks

•

models

URL

Related documents

http://publications.idiap.ch/downloads/papers/2018/Dighe_IEEESLT2018_2018.pdf
Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
LIDIAP  
Event nameEvent placeEvent date
IEEE Workshop on Spoken Language Technology

Athens, GREECE

Dec 18-21, 2018

Available on Infoscience
February 6, 2019
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/154379
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés