Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. AI-based telepresence for broadcast applications
 
conference paper

AI-based telepresence for broadcast applications

Piñeiro Monteagudo, Henrique  
•
Daod Nathoo, Rayan  
•
Deillon, Laurent  
Show more
August 22, 2022
Proceedings of the Applications of Digital Image Processing XLV
SPIE Applications of Digital Image Processing XLV

In this paper, we introduce a new solution and underlying architecture that allows remote participants to interact with hosts in a broadcast scenario. To achieve this, background extraction is first applied to video received from remote participants to extract their faces and bodies. Considering that the video from remote participants are usually of lower resolutions when compared to content produced by professional cameras in production, we propose to scale the extracted video with a super-resolution module. Finally, the processed video from remote participants are merged with studio video and streamed to audiences. Given the real-time and high-quality requirements, both background extraction and super-resolution modules are learning-based solutions and run on GPUs. The proposed solution has been deployed in the Advance Mixed Reality (AdMiRe) project. The objective and subjective assessment results show that the proposed solution works well in real world applications.

  • Files
  • Details
  • Metrics
Type
conference paper
DOI
10.1117/12.2638229
Author(s)
Piñeiro Monteagudo, Henrique  
Daod Nathoo, Rayan  
Deillon, Laurent  
Changsheng, Gao  
Ebrahimi, Touradj  
Date Issued

2022-08-22

Publisher

SPIE

Published in
Proceedings of the Applications of Digital Image Processing XLV
URL
https://spie.org/optics-photonics/presentation/AI-based-telepresence-for-broadcast-applications/12226-34
https://spie.org/optics-photonics/presentation/AI-based-telepresence-for-broadcast-applications/12226-34
Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
GR-EB  
Event nameEvent placeEvent date
SPIE Applications of Digital Image Processing XLV

San Diego, USA

22-24 August 2022

Available on Infoscience
August 26, 2022
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/190259
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés