Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Information Spectrum Converse for Minimum Entropy Couplings and Functional Representations
 
conference paper not in proceedings

Information Spectrum Converse for Minimum Entropy Couplings and Functional Representations

Yadav, Anuj Kumar  
•
Shkel, Yanina  
August 22, 2023
2023 IEEE International Symposium on Information Theory (ISIT)

Given two jointly distributed random variables (X,Y), a functional representation of X is a random variable Z independent of Y, and a deterministic function g(⋅,⋅) such that X=g(Y,Z). The problem of finding a minimum entropy functional representation is known to be equivalent to the problem of finding a minimum entropy coupling where, given a collection of probability distributions P1,…,Pm, the goal is to find a coupling X1,…,Xm(Xi∼Pi) with the smallest entropy Hα(X1,…,Xm). This paper presents a new information spectrum converse, and applies it to obtain direct lower bounds on minimum entropy in both problems. The new results improve on all known lower bounds, including previous lower bounds based on the concept of majorization. In particular, the presented proofs leverage both - the information spectrum and the majorization - perspectives on minimum entropy couplings and functional representations.

  • Details
  • Metrics
Type
conference paper not in proceedings
DOI
10.1109/ISIT54713.2023.10206466
Author(s)
Yadav, Anuj Kumar  
Shkel, Yanina  
Date Issued

2023-08-22

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
MIL  
Event nameEvent placeEvent date
2023 IEEE International Symposium on Information Theory (ISIT)

Taipei, Taiwan

June 25-30, 2023

Available on Infoscience
November 11, 2023
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/202095
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés