Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Journal articles
  4. Upgrading the Newsroom: An Automated Image Selection System for News Articles
 
research article

Upgrading the Newsroom: An Automated Image Selection System for News Articles

Liu, Fangyu
•
Lebret, Remi  
•
Orel, Didier
Show more
September 1, 2020
Acm Transactions On Multimedia Computing Communications And Applications

We propose an automated image selection system to assist photo editors in selecting suitable images for news articles. The system fuses multiple textual sources extracted from news articles and accepts multilingual inputs. It is equipped with char-level word embeddings to help both modeling morphologically rich languages, e.g., German, and transferring knowledge across nearby languages. The text encoder adopts a hierarchical self-attentionmechanism to attend more to both keywordswithin a piece of text and informative components of a news article. We extensively experiment our system on a large-scale text-image database containing multimodal multilingual news articles collected from Swiss local news media websites. The system is compared with multiple baselines with ablation studies and is shown to beat existing text-image retrieval methods in a weakly supervised learning setting. Besides, we also offer insights on the advantage of using multiple textual sources and multilingual data.

  • Details
  • Metrics
Type
research article
DOI
10.1145/3396520
Web of Science ID

WOS:000569375200007

Author(s)
Liu, Fangyu
Lebret, Remi  
Orel, Didier
Sordet, Philippe
Aberer, Karl  
Date Issued

2020-09-01

Publisher

ASSOC COMPUTING MACHINERY

Published in
Acm Transactions On Multimedia Computing Communications And Applications
Volume

16

Issue

3

Start page

81

Subjects

Computer Science, Information Systems

•

Computer Science, Software Engineering

•

Computer Science, Theory & Methods

•

Computer Science

•

multimodal retrieval

•

multimodal machine learning

•

neural networks

•

deep learning

•

natural language processing

•

news image article analysis

•

news media

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
LSIR  
Available on Infoscience
October 1, 2020
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/172049
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés