Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Task-based evaluation of meeting browsers: from BET task elicitation to user behavior analysis
 
conference paper not in proceedings

Task-based evaluation of meeting browsers: from BET task elicitation to user behavior analysis

Popescu-Belis, Andrei
•
Flynn, Mike
•
Wellner, Pierre
Show more
2008
6th International Conference on Language Resources and Evaluation

This paper presents recent results of the application of the task-based Browser Evaluation Test (BET) to meeting browsers, that is, interfaces to multimodal databases of meeting recordings. The tasks were defined by browser-neutral BET observers. Two groups of human subjects used the Transcript-based Query and Browsing interface (TQB), and attempted to solve as many BET tasks – pairs of true/false statements to disambiguate – as possible in a fixed amount of time. Their performance was measured in terms of precision and speed. Results indicate that the browser’s annotation-based search functionality is frequently used, in particular the keyword search. A more detailed analysis of each test question for each participant confirms that despite considerable variation across strategies, the use of queries is correlated to successful performance.

  • Files
  • Details
  • Metrics
Loading...
Thumbnail Image
Name

Popescu-Belis_LREC-2_2008.pdf

Access type

openaccess

Size

898.59 KB

Format

Adobe PDF

Checksum (MD5)

4681e92292fca9cdabde82a430e9081c

Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés