Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. A new analysis method for paired comparison and its application to 3D quality assessment
 
conference paper

A new analysis method for paired comparison and its application to 3D quality assessment

Lee, Jong-Seok  
•
Goldmann, Lutz  
•
Ebrahimi, Touradj  
2011
MM '11: Proceedings of the 19th ACM international conference on Multimedia
ACM Multimedia

Among various subjective quality evaluation methodologies, paired comparison has the advantage of improved simplicity of the subjects’ evaluation task due to simplified rating scales and direct comparison of two stimuli. Thus, it may lead to more reliable results when individual quality levels are difficult to define, quality differences between stimuli are small or multiple quality factors are involved. This paper proposes a new method to analyze results of paired comparison-based subjective tests. By assuming that ties convey information about significant differences between two stimuli being compared, the confidence intervals for the quality scores are estimated using a maximum likelihood criterion, which enables us to intuitively examine the significance of quality score differences. We describe the complete test methodology including the test procedure, outlier detection and score analysis applied to quality assessment of 3D images acquired using varying camera distances. Experimental results demonstrate the usefulness of the proposed analysis method, as well as the enhanced quality discriminability of the paired comparison methodology in comparison to the conventional single stimulus methodology.

  • Files
  • Details
  • Metrics
Loading...
Thumbnail Image
Name

p1281.pdf

Access type

openaccess

Size

387.93 KB

Format

Adobe PDF

Checksum (MD5)

7d50a3e58cf823460e65d2ced5bc5649

Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés