Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Student works
  4. Investigation into 2D Gaussian Splatting for Image Representation
 
semester or other student projects

Investigation into 2D Gaussian Splatting for Image Representation

Hua, Jiacheng
2024

This work explores the use of Gaussian splatting as a method for representing images as a collection of 2D Gaussians, with a particular focus on balancing image quality and compression. Gaussian splatting, originally developed for representing 3D scenes as collections of 3D Gaussians by minimizing reconstruction loss across multiple photographic viewpoints, can be similarly applied in 2D. By optimizing the positions, colors, and shapes of 2D Gaussians, we aim to minimize reconstruction loss with respect to the target image. This 2D Gaussian splatting approach shares similarities with vectorization techniques like DiffVG and LIVE, which instead optimize the positions and colors of polygons or closed Bezier shapes. However, 2D Gaussians offer the advantage of easier differentiation of pixel values with respect to their positions and colors, resulting in faster optimization. Additionally, 2D Gaussians naturally create smoother color gradients within objects compared to uniformly-colored shapes. We observe a trade-off between compression (fewer Gaussians) and reconstructed image quality. A key finding from our preliminary investigation is that the current implementation uses significantly more 2D Gaussians than necessary. To address this, we introduce an optimization strategy that begins with a small number of Gaussians to capture broad image features, progressively adding more Gaussians to refine finer details. This approach improves the compression-quality trade-off, achieving better reconstruction quality with fewer Gaussians. Furthermore, we address a cropping artifact present in the current implementation and experiment with various reconstruction loss functions.

  • Files
  • Details
  • Metrics
Loading...
Thumbnail Image
Name

Investigation_into_2D_Gaussian_Splatting_for_Image_Representation.pdf

Type

Main Document

cris-layout.advanced-attachment.oaire.version

http://purl.org/coar/version/c_be7fb7dd8ff6fe43

Access type

openaccess

License Condition

N/A

Size

3.73 MB

Format

Adobe PDF

Checksum (MD5)

a797d64cabada6109b972624392896f9

Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés