Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Journal articles
  4. Neural BTF Compression and Interpolation
 
research article

Neural BTF Compression and Interpolation

Rainer, Gilles
•
Jakob, Wenzel  
•
Ghosh, Abhijeet
Show more
May 1, 2019
Computer Graphics Forum

The Bidirectional Texture Function (BTF) is a data-driven solution to render materials with complex appearance. A typical capture contains tens of thousands of images of a material sample under varying viewing and lighting conditions. While capable of faithfully recording complex light interactions in the material, the main drawback is the massive memory requirement, both for storing and rendering, making effective compression of BTF data a critical component in practical applications. Common compression schemes used in practice are based on matrix factorization techniques, which preserve the discrete format of the original dataset. While this approach generalizes well to different materials, rendering with the compressed dataset still relies on interpolating between the closest samples. Depending on the material and the angular resolution of the BTF, this can lead to blurring and ghosting artefacts. An alternative approach uses analytic model fitting to approximate the BTF data, using continuous functions that naturally interpolate well, but whose expressive range is often not wide enough to faithfully recreate materials with complex non-local lighting effects (subsurface scattering, inter-reflections, shadowing and masking...). In light of these observations, we propose a neural network-based BTF representation inspired by autoencoders: our encoder compresses each texel to a small set of latent coefficients, while our decoder additionally takes in a light and view direction and outputs a single RGB vector at a time. This allows us to continuously query reflectance values in the light and view hemispheres, eliminating the need for linear interpolation between discrete samples. We train our architecture on fabric BTFs with a challenging appearance and compare to standard PCA as a baseline. We achieve competitive compression ratios and high-quality interpolation/extrapolation without blurring or ghosting artifacts.

  • Details
  • Metrics
Type
research article
DOI
10.1111/cgf.13633
Web of Science ID

WOS:000471634300020

Author(s)
Rainer, Gilles
Jakob, Wenzel  
Ghosh, Abhijeet
Weyrich, Tim
Date Issued

2019-05-01

Publisher

WILEY

Published in
Computer Graphics Forum
Volume

38

Issue

2

Start page

235

End page

244

Subjects

Computer Science, Software Engineering

•

Computer Science

•

texture

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
RGL  
Available on Infoscience
July 4, 2019
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/158808
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés