Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Properties of the Strong Data Processing Constant for Rényi Divergence
 
conference paper

Properties of the Strong Data Processing Constant for Rényi Divergence

Jin, Lifu
•
Esposito, Amedeo Roberto
•
Gastpar, Michael  
2024
IEEE International Symposium on Information Theory - Proceedings
IEEE International Symposium on Information Theory

Strong data processing inequalities (SDPI) are an important object of study in Information Theory and have been well studied for f-divergences. Universal upper and lower bounds have been provided along with several applications, connecting them to impossibility (converse) results, concentration of measure, hypercontractivity, and so on. In this paper, we study Rényi divergence and the corresponding SDPI constant whose behavior seems to deviate from that of ordinary <1>-divergences. In particular, one can find examples showing that the universal upper bound relating its SDPI constant to the one of Total Variation does not hold in general. In this work, we prove, however, that the universal lower bound involving the SDPI constant of the Chi-square divergence does indeed hold. Furthermore, we also provide a characterization of the distribution that achieves the supremum when is equal to 2 and consequently compute the SDPI constant for Rényi divergence of the general binary channel.

  • Details
  • Metrics
Type
conference paper
DOI
10.1109/ISIT57864.2024.10619367
Scopus ID

2-s2.0-85202899276

Author(s)
Jin, Lifu

École Polytechnique Fédérale de Lausanne

Esposito, Amedeo Roberto

Institute of Science and Technology Austria (ISTA)

Gastpar, Michael  

École Polytechnique Fédérale de Lausanne

Date Issued

2024

Publisher

Institute of Electrical and Electronics Engineers Inc.

Published in
IEEE International Symposium on Information Theory - Proceedings
ISBN of the book

9798350382846

Start page

3178

End page

3183

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
LINX  
Event nameEvent acronymEvent placeEvent date
IEEE International Symposium on Information Theory

Athens, Greece

2024-07-07 - 2024-07-12

FunderFunding(s)Grant NumberGrant URL

Swiss National Science Foundation

200364

Available on Infoscience
January 26, 2025
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/245174
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés