Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Student works
  4. Predicting emotional response to visual stimuli, a machine learning approach
 
master thesis

Predicting emotional response to visual stimuli, a machine learning approach

Szymczak, Robin
2022

We created an emotion predicting model capable of predicting emotions in images using OpenAI CLIP as a backbone. Using the ArtEmis dataset which contains 80K paintings annotated on the base of perceived emotions (amusement, fear, etc..). We show that this method of predicting emotion is effective, outperforming previous methods in predicting dominant emotion (70% vs 60%) or positive/negative images (80% vs 77.7%). We leverage our method on text emotion prediction which allows to quickly identify the reason why an image has a certain affect. With this method we unveil CLIP’s political preferences, and discovered a lean towards the democrats. We also created an affect based query tool that allows the users to search a set of pictures with a prompt as well as an emotion.

  • Files
  • Details
  • Metrics
Loading...
Thumbnail Image
Name

MS_thesis_robin_szymczak-compressed.pdf

Type

N/a

Access type

openaccess

License Condition

CC BY

Size

4.31 MB

Format

Adobe PDF

Checksum (MD5)

779a5856ab1c6fd21c5965c89ec345ce

Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés