Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Journal articles
  4. In-Network View Synthesis for Interactive Multiview Video Systems
 
research article

In-Network View Synthesis for Interactive Multiview Video Systems

Toni, Laura  
•
Cheung, Gene
•
Frossard, Pascal  
2016
IEEE Transactions on Multimedia

In multiview applications, camera views can be used as reference views to synthesize additional virtual viewpoints, allowing users to freely navigate within a 3D scene. However, bandwidth constraints may restrict the number of reference views sent to clients, limiting the quality of the synthesized viewpoints. In this work, we study the problem of in-network reference view synthesis aimed at improving the navigation quality at the clients. We consider a distributed cloud network architecture, where data stored in a main cloud is delivered to end users with the help of cloudlets, i.e., resource-rich proxies close to the users. We argue that, in case of limited bandwidth from the cloudlet to the users, re-sampling at the couldlet the viewpoints of the 3D scene (i.e., synthesizing novel virtual views in the cloudlets to be used as new references to the decoder) is beneficial compared to mere subsampling of the original set of camera views. We therefore cast a new reference view selection problem that seeks the subset of views minimizing the distortion over a view navigation window defined by the user under bandwidth constraints. We prove that the problem is NP-hard, and we propose an effective polynomial time algorithm using dynamic programming to solve the optimization problem under general assumptions that cover most of the multiview scenarios in practice. Simulation results confirm the performance gain offered by virtual view synthesis in the network.

  • Details
  • Metrics
Type
research article
DOI
10.1109/Tmm.2016.2537207
Web of Science ID

WOS:000374996200006

Author(s)
Toni, Laura  
Cheung, Gene
Frossard, Pascal  
Date Issued

2016

Publisher

Ieee-Inst Electrical Electronics Engineers Inc

Published in
IEEE Transactions on Multimedia
Volume

18

Issue

5

Start page

852

End page

864

Subjects

Cloud-assisted applications

•

depth-image-based rendering (DIBR)

•

interactive systems

•

network processing

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
LTS4  
Available on Infoscience
January 11, 2016
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/122106
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés