Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Class Specific Feature Disentanglement and Text Embeddings for Multi-label Generalized Zero Shot CXR Classification
 
conference paper

Class Specific Feature Disentanglement and Text Embeddings for Multi-label Generalized Zero Shot CXR Classification

Mahapatra, Dwarikanath
•
Yepes, Antonio Jose Jimeno
•
Kuanar, Shiba
Show more
Greenspan, H
•
Madabhushi, A
Show more
January 1, 2023
Medical Image Computing And Computer Assisted Intervention, Miccai 2023, Pt Ii
26th International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI)

Robustness of medical image classification models is limited by its exposure to the candidate disease classes. Generalized zero shot learning (GZSL) aims at correctly predicting seen and unseen classes and most current GZSL approaches have focused on the single label case. It is common for chest x-rays to be labelled with multiple disease classes. We propose a novel multi-label GZSL approach using: 1) class specific feature disentanglement and 2) semantic relationship between disease labels distilled from BERT models pre-trained on biomedical literature. We learn a dictionary from distilled text embeddings, and leverage them to synthesize feature vectors that are representative of multi-label samples. Compared to existing methods, our approach does not require class attribute vectors, which are an essential part of GZSL methods for natural images but are not available for medical images. Our approach outperforms state of the art GZSL methods for chest xray images.

  • Details
  • Metrics
Type
conference paper
DOI
10.1007/978-3-031-43895-0_26
Web of Science ID

WOS:001109624900026

Author(s)
Mahapatra, Dwarikanath
Yepes, Antonio Jose Jimeno
Kuanar, Shiba
Roy, Sudipta
Bozorgtabar, Behzad  
Reyes, Mauricio
Ge, Zongyuan
Editors
Greenspan, H
•
Madabhushi, A
•
Mousavi, P
•
Salcudean, S
•
Duncan, J
•
Syeda-Mahmood, T
•
Taylor, R
Date Issued

2023-01-01

Publisher

Springer International Publishing Ag

Publisher place

Cham

Published in
Medical Image Computing And Computer Assisted Intervention, Miccai 2023, Pt Ii
ISBN of the book

978-3-031-43894-3

978-3-031-43895-0

Volume

14221

Start page

276

End page

286

Subjects

Technology

•

Life Sciences & Biomedicine

•

Multi-Label

•

Gzsl

•

Text Embeddings

•

Chest X-Rays

•

Feature Synthesis

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
LTS5  
Event nameEvent placeEvent date
26th International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI)

Vancouver, CANADA

OCT 08-12, 2023

Available on Infoscience
February 20, 2024
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/204688
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés