Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Latent Wander: an Alternative Interface for Interactive and Serendipitous Discovery of Large AV Archives
 
conference paper

Latent Wander: an Alternative Interface for Interactive and Serendipitous Discovery of Large AV Archives

Yang, Yuchen  
•
Zhang, Linyida
January 1, 2023
Proceedings Of The 5Th Workshop On The Analysis, Understanding And Promotion Of Heritage Contents, Sumac 2023
5th ACM Workshop on the Analysis, Understanding and Promotion of Heritage Contents (SUMAC)

Audiovisual (AV) archives are invaluable for holistically preserving the past. Unlike other forms, AV archives can be difficult to explore. This is not only because of its complex modality and sheer volume but also the lack of appropriate interfaces beyond keyword search. The recent rise in text-to-video retrieval tasks in computer science opens the gate to accessing AV content more naturally and semantically, able to map natural language descriptive sentences to matching videos. However, applications of this model are rarely seen. The contribution of this work is threefold. First, working with RTS (Television Suisse Romande), we identified the key blockers in a real archive for implementing such models. We built a functioning pipeline for encoding raw archive videos to the text-to-video feature vectors. Second, we designed and verified a method to encode and retrieve videos using emotionally abundant descriptions not supported in the original model. Third, we proposed an initial prototype for immersive and interactive exploration of AV archives in a latent space based on the previously mentioned encoding of videos.

  • Details
  • Metrics
Type
conference paper
DOI
10.1145/3607542.3617355
Web of Science ID

WOS:001150351900003

Author(s)
Yang, Yuchen  
Zhang, Linyida
Corporate authors
ACM
Date Issued

2023-01-01

Publisher

Assoc Computing Machinery

Publisher place

New York

Published in
Proceedings Of The 5Th Workshop On The Analysis, Understanding And Promotion Of Heritage Contents, Sumac 2023
ISBN of the book

979-8-4007-0279-2

Start page

5

End page

12

Subjects

Technology

•

Audiovisual Archive

•

Computational Archival Science

•

Experimental Museology

•

Text-To-Video Retrieval

•

Latent Space

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
EMPLUS  
Event nameEvent placeEvent date
5th ACM Workshop on the Analysis, Understanding and Promotion of Heritage Contents (SUMAC)

Ottawa, CANADA

NOV 02, 2023

Available on Infoscience
February 23, 2024
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/205386
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés