Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Journal articles
  4. Detection of Age-Induced Makeup Attacks on Face Recognition Systems Using Multi-Layer Deep Features
 
research article

Detection of Age-Induced Makeup Attacks on Face Recognition Systems Using Multi-Layer Deep Features

Kotwal, Ketan
•
Mostaani, Zohreh
•
Marcel, Sébastien
2020
IEEE Transactions on Biometrics, Behavior, and Identity Science

Makeup is a simple and easy instrument that can alter the appearance of a person’s face, and hence, create a presentation attack on face recognition (FR) systems. These attacks, especially the ones mimicking ageing, are difficult to detect due to their close resemblance with genuine (non-makeup) appearances. Makeups can also degrade the performance of recognition systems and of various algorithms that use human face as an input. The detection of facial makeups is an effective prohibitory measure to minimize these problems. This work proposes a deep learning-based presentation attack detection (PAD) method to identify facial makeups. We propose the use of a convolutional neural network (CNN) to extract features that can distinguish between presentations with age-induced facial makeups (attacks), and those without makeup (bona-fide). These feature descriptors, based on shape and texture cues, are constructed from multiple intermediate layers of a CNN. We introduce a new dataset AIM (Age Induced Makeups) consisting of 200+ video presentations of old-age makeups and bona-fide, each. Our experiments indicate makeups in AIM result in 14% decrease in the median matching scores of a recent CNN-based FR system. We demonstrate accuracy of the proposed PAD method where 93% presentations in the AIM dataset are correctly classified. In additional testing, it also outperforms existing methods of detection of generic makeups. A simple score-level fusion, performed on the classification scores of shape- and texture-based features, can further improve the accuracy of the proposed makeup detector.

  • Details
  • Metrics
Type
research article
DOI
10.1109/TBIOM.2019.2946175
Author(s)
Kotwal, Ketan
Mostaani, Zohreh
Marcel, Sébastien
Date Issued

2020

Published in
IEEE Transactions on Biometrics, Behavior, and Identity Science
Volume

2

Issue

1

Start page

15

End page

25

Subjects

AIM

•

deep learning

•

Face Presentation Attack Detection

•

Makeup Attack Detection

•

Makeup Attacks

•

Old-Age Makeups

•

score fusion

•

Shape descriptor

•

Texture Descriptor

URL
http://publications.idiap.ch/downloads/papers/2019/Kotwal_IEEETRANS.BIOM-2_2019.pdf
Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
LIDIAP  
Available on Infoscience
November 7, 2019
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/162765
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés