Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Scaled False Discovery Proportion and Related Error Metrics
 
Loading...
Thumbnail Image
conference presentation

Scaled False Discovery Proportion and Related Error Metrics

Meskaldji, Djalel Eddine  
•
Thiran, Jean-Philippe  
•
Morgenthaler, Stephan  
2013
8th International Conference on Multiple Comparison Procedures

In multiple testing, a variety of control metrics of false positives have been introduced such as the Per Family Error Rate (PFER), Family-Wise Error Rate (FWER), the False Discovery Rate (FDR), the False Exceedence Rate (FER). In this talk, we present a comprehensive family of error rates together with a corresponding family of multiple testing procedures (MTP). Based on the needs of the problem at hand, the user can choose a particular member among these MTPs. The new error rate limits the number of false positives FP relative to an arbitrary non-decreasing function s of the number of rejections R. The quantity is called, the scaled false discovery proportion SFDP=FP/s(R). We present different procedures to control either the P(SFDP>q) or the E(SFDP) for any choice of the scaling function. An obvious choice is s(R)=min(R;k). As does FDR, this particular error rate FP/s(R) accepts a fixed percentage of false rejections among all rejections, but only up to R =k, then a stricter control takes over and for R > k, the number of false positives is limited to a percentage of the fixed value k, similar to PFER. The corresponding family of multiple testing procedures bridges the gap between the PFER (k =1) and the FDR (k = number of tests). A similar such bridge is obtained when s(R)=Rg with 0<=g<=1, which for g=0.5 controls the percentage of false discoveries relative to the square root of R. In the talk, we discuss the choice of the parameters k and g based on the minimization of the expected loss t E(FP) - E(TP) = t E(FP) - E(R - FP) which is based on the idea that a false positive costs a penalty of 1<t units, while a true positive corresponds to a gain of 1 unit.

  • Details
  • Metrics
Type
conference presentation
Author(s)
Meskaldji, Djalel Eddine  
•
Thiran, Jean-Philippe  
•
Morgenthaler, Stephan  
Date Issued

2013

Subjects

Multiple testing

•

LTS5

Written at

EPFL

EPFL units
LTS5  
STAP  
Event nameEvent placeEvent date
8th International Conference on Multiple Comparison Procedures

University of Southampton, UK

July 8 - 11, 2013.

Available on Infoscience
March 18, 2013
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/90454
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés