Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Journal articles
  4. Multispectral Deep Embeddings As a Countermeasure To Custom Silicone Mask Presentation Attacks
 
Loading...
Thumbnail Image
research article

Multispectral Deep Embeddings As a Countermeasure To Custom Silicone Mask Presentation Attacks

Kotwal, Ketan
•
Bhattacharjee, Sushil
•
Marcel, Sébastien
2019
IEEE Transactions on Biometrics, Behavior, and Identity Science

This work focuses on detecting presentation attacks (PA) mounted using custom silicone masks. Face recognition (FR) systems have been shown to be highly vulnerable to PAs based on such masks [1, 2]. Here we explore the use of multispectral data (color imagery, near infrared (NIR) imagery and thermal imagery) for face presentation attack detection (PAD), specifically against the custom silicone mask attacks. Using a new dataset (XCSMAD) representing 21 custom made masks, we establish the baseline performance of several commonly used face-PAD methods, on the different imaging channels. Considering thermal imagery in particular, our experiments show that low-cost thermal imaging devices are as effective in face-PAD as more expensive thermal cameras, for mask-based attacks. This result reinforces the case for the use of thermal data in face-PAD. We also demonstrate that fusing information from multiple channels leads to significant improvement in face-PAD performance. Finally, we propose a new approach to face-PAD of custom silicone masks using a convolutional neural network (CNN). On individual spectral channels, the proposed approach achieves state-of-the-art results. Using multispectral-fusion, the proposed CNN-based method significantly outperforms the baseline methods. The new dataset and source-code for our experiments is freely available for research purposes.

  • Details
  • Metrics
Type
research article
DOI
10.1109/TBIOM.2019.2939421
Author(s)
Kotwal, Ketan
•
Bhattacharjee, Sushil
•
Marcel, Sébastien
Date Issued

2019

Published in
IEEE Transactions on Biometrics, Behavior, and Identity Science
Volume

1

Issue

4

Start page

238

End page

251

URL

Related documents

http://publications.idiap.ch/downloads/papers/2019/Kotwal_TBIOM_2019.pdf
Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
LIDIAP  
Available on Infoscience
September 5, 2019
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/160884
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés