Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Journal articles
  4. Locally Differentially-Private Randomized Response for Discrete Distribution Learning
 
research article

Locally Differentially-Private Randomized Response for Discrete Distribution Learning

Pastore, Adriano  
•
Gastpar, Michael C.  
2021
Journal of Machine Learning Research

We consider a setup in which confidential i.i.d. samples X1, . . . , Xn from an unknown finite-support distribution p are passed through n copies of a discrete privatization chan- nel (a.k.a. mechanism) producing outputs Y1, . . . , Yn. The channel law guarantees a local differential privacy of ε. Subject to a prescribed privacy level ε, the optimal channel should be designed such that an estimate of the source distribution based on the channel out- puts Y1, . . . , Yn converges as fast as possible to the exact value p. For this purpose we study the convergence to zero of three distribution distance metrics: f-divergence, mean- squared error and total variation. We derive the respective normalized first-order terms of convergence (as n → ∞), which for a given target privacy ε represent a rule-of-thumb factor by which the sample size must be augmented so as to achieve the same estimation accuracy as that of a non-randomizing channel. We formulate the privacy–fidelity trade-off problem as being that of minimizing said first-order term under a privacy constraint ε. We further identify a scalar quantity that captures the essence of this trade-off, and prove bounds and data-processing inequalities on this quantity. For some specific instances of the privacy–fidelity trade-off problem, we derive inner and outer bounds on the optimal trade-off curve.

  • Files
  • Details
  • Metrics
Type
research article
Web of Science ID

WOS:000687207000001

Author(s)
Pastore, Adriano  
Gastpar, Michael C.  
Date Issued

2021

Published in
Journal of Machine Learning Research
Volume

22

Issue

132

Article Number

1−56

Subjects

differential privacy

•

randomized response

•

distribution estimation

•

privacy– utility trade-off

URL

Link to the article

https://jmlr.org/papers/v22/18-726.html
Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
LINX  
Available on Infoscience
August 13, 2021
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/180535
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés