Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Bilinear Multimodal Discriminator for Adversarial Domain Adaptation with Privileged Information
 
conference paper

Bilinear Multimodal Discriminator for Adversarial Domain Adaptation with Privileged Information

Mordan, Taylor  
•
Saporta, Antoine
•
Alahi, Alexandre  
Show more
2020
Proceedings of the 9th Symposium of the European Association for Research in Transportation
9th Symposium of the European Association for Research in Transportation (HEART 2020)

Over the past few years, deep Convolutional Neural Networks have shown outstanding performance on semantic segmentation, which is an essential tool needed by self-driving cars to understand their environments. However, their training relies on large datasets with pixel-level ground truth annotations, which are costly and tedious to produce on real data, making application to new situations difficult. In this context, Unsupervised Domain Adaptation (UDA) from synthetic data is an approach of great interest since it leverages cost-free labeled synthetic datasets to help generalizing to unlabeled real ones. In this paper, we propose a new adversarial training strategy for UDA that uses additional privileged information on the synthetic domain during training to improve transfer to the real one. Our method introduces a multimodal discriminator for adversarial training, featuring a bilinear fusion between representations of segmentation and privileged information to exploit at best alignment between modalities. We evaluate our approach on real-world Cityscapes dataset, using synthetic labeled data with depth as privileged information from SYNTHIA dataset and show competitive results.

  • Files
  • Details
  • Metrics
Type
conference paper
Author(s)
Mordan, Taylor  
Saporta, Antoine
Alahi, Alexandre  
Cord, Matthieu
Pérez, Patrick
Date Issued

2020

Published in
Proceedings of the 9th Symposium of the European Association for Research in Transportation
Total of pages

7

URL

PDF file

https://transp-or.epfl.ch/heart/2020/abstracts/HEART_2020_paper_40.pdf
Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
VITA  
Event nameEvent placeEvent date
9th Symposium of the European Association for Research in Transportation (HEART 2020)

Lyon, France

February 3-4, 2020

Available on Infoscience
August 3, 2020
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/170548
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés