Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Model-Augmented Conditional Mutual Information Estimation for Feature Selection
 
conference paper

Model-Augmented Conditional Mutual Information Estimation for Feature Selection

Yang, Alan
•
Ghassami, AmirEmad
•
Raginsky, Maxim
Show more
June 19, 2020
Conference on Uncertainty in Artificial Intelligence (UAI)
36th Conference on Uncertainty in Artificial Intelligence (UAI)

Markov blanket feature selection, while theoretically optimal, is generally challenging to implement. This is due to the shortcomings of existing approaches to conditional independence (CI) testing, which tend to struggle either with the curse of dimensionality or computational complexity. We propose a novel two-step approach which facilitates Markov blanket feature selection in high dimensions. First, neural networks are used to map features to low-dimensional representations. In the second step, CI testing is performed by applying the k-NN conditional mutual information estimator to the learned feature maps. The mappings are designed to ensure that mapped samples both preserve information and share similar information about the target variable if and only if they are close in Euclidean distance. We show that these properties boost the performance of the k-NN estimator in the second step. The performance of the proposed method is evaluated on both synthetic and real data.

  • Files
  • Details
  • Metrics
Loading...
Thumbnail Image
Name

1911.04628.pdf

Type

Publisher's Version

Version

Published version

Access type

openaccess

License Condition

n/a

Size

735.03 KB

Format

Adobe PDF

Checksum (MD5)

f514719d00a0a9f14f3d43c1d0ecb219

Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés