Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Towards more Practical Threat Models in Artificial Intelligence Security
 
conference paper

Towards more Practical Threat Models in Artificial Intelligence Security

Grosse, Kathrin  
•
Bieringer, Lukas
•
Besold, Tarek Richard
Show more
August 12, 2024
SEC '24: Proceedings of the 33rd USENIX Conference on Security Symposium
33rd USENIX Conference on Security Symposium

Recent works have identified a gap between research and practice in artificial intelligence security: threats studied in academia do not always reflect the practical use and security risks of AI. For example, while models are often studied in isolation, they form part of larger ML pipelines in practice. Recent works also brought forward that adversarial manipulations introduced by academic attacks are impractical. We take a first step towards describing the full extent of this disparity. To this end, we revisit the threat models of the six most studied attacks in AI security research and match them to AI usage in practice via a survey with \textbf{271} industrial practitioners. On the one hand, we find that all existing threat models are indeed applicable. On the other hand, there are significant mismatches: research is often too generous with the attacker, assuming access to information not frequently available in real-world settings. Our paper is thus a call for action to study more practical threat models in artificial intelligence security. 18 pages, 4 figures, 7 tables, under submission

  • Files
  • Details
  • Versions
  • Metrics
Type
conference paper
DOI
10.5555/3698900.3699174
Author(s)
Grosse, Kathrin  
Bieringer, Lukas
Besold, Tarek Richard
Alahi, Alexandre  

EPFL

Date Issued

2024-08-12

Publisher

Usenix Association

Published in
SEC '24: Proceedings of the 33rd USENIX Conference on Security Symposium
ISBN of the book

978-1-939133-44-1

Start page

4891

End page

4908

URL

ArXiv

https://doi.org/10.48550/arXiv.2311.09994
Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
VITA  
Event nameEvent acronymEvent placeEvent date
33rd USENIX Conference on Security Symposium

SEC '24

Philadelphia, PA, USA

2024-08-14 - 2024-08-14

Available on Infoscience
July 9, 2025
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/203200.2
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés