Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. AI-based telepresence for broadcast applications
 
Loading...
Thumbnail Image
conference paper

AI-based telepresence for broadcast applications

Piñeiro Monteagudo, Henrique  
•
Daod Nathoo, Rayan  
•
Deillon, Laurent  
Show more
August 22, 2022
Proceedings of the Applications of Digital Image Processing XLV
SPIE Applications of Digital Image Processing XLV

In this paper, we introduce a new solution and underlying architecture that allows remote participants to interact with hosts in a broadcast scenario. To achieve this, background extraction is first applied to video received from remote participants to extract their faces and bodies. Considering that the video from remote participants are usually of lower resolutions when compared to content produced by professional cameras in production, we propose to scale the extracted video with a super-resolution module. Finally, the processed video from remote participants are merged with studio video and streamed to audiences. Given the real-time and high-quality requirements, both background extraction and super-resolution modules are learning-based solutions and run on GPUs. The proposed solution has been deployed in the Advance Mixed Reality (AdMiRe) project. The objective and subjective assessment results show that the proposed solution works well in real world applications.

  • Files
  • Details
  • Metrics
Loading...
Thumbnail Image
Name

SPIE_AI_based_telepresence_for_broadcast_applications (1).pdf

Type

Postprint

Access type

openaccess

License Condition

copyright

Size

14.32 MB

Format

Adobe PDF

Checksum (MD5)

fcf3fd0d197c235af4068788431acd9d

Loading...
Thumbnail Image
Name

SPIE_AdMiRe-9.pdf

Type

Postprint

Access type

openaccess

License Condition

copyright

Size

14.32 MB

Format

Adobe PDF

Checksum (MD5)

5ad085b3be2abb7c4edfa648489abbcd

Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés