Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Enhancing Peer Review with AI-Powered Suggestion Generation Assistance: Investigating the Design Dynamics
 
conference paper

Enhancing Peer Review with AI-Powered Suggestion Generation Assistance: Investigating the Design Dynamics

Neshaei, Seyed Parsa  
•
Rietsche, Roman
•
Su, Xiaotian  
Show more
March 18, 2024
ACM International Conference Proceeding Series
29 Conference on Intelligent User Interfaces

While writing peer reviews resembles an important task in science, education, and large organizations, providing fruitful suggestions to peers is not a straightforward task, as different user interaction designs of text suggestion interfaces can have diverse effects on user behaviors when writing the review text. Generative language models might be able to support humans in formulating reviews with textual suggestions. Previous systems use two designs for providing text suggestions, but do not empirically evaluate them: inline and list of suggestions. To investigate the effects of embedding NLP text generation models in the two designs, we collected user requirements to implement Hamta as an example of assistants providing reviewers with text suggestions. Our experiment on comparing the two designs on 31 participants indicates that people using the inline interface provided longer reviews on average, while participants using the list of suggestions experienced more ease of use in using our tool. The results shed light on important design findings for embedding text generation models in user-centered assistants.

  • Details
  • Metrics
Type
conference paper
DOI
10.1145/3640543.3645169
Scopus ID

2-s2.0-85190979952

Author(s)
Neshaei, Seyed Parsa  

École Polytechnique Fédérale de Lausanne

Rietsche, Roman

Berner Fachhochschule

Su, Xiaotian  

École Polytechnique Fédérale de Lausanne

Wambsganss, Thiemo

Berner Fachhochschule

Date Issued

2024-03-18

Publisher

Association for Computing Machinery

Published in
ACM International Conference Proceeding Series
ISBN of the book

9798400705083

Start page

88

End page

102

Subjects

generative models

•

intelligent writing assistants

•

machine learning

•

natural language processing

•

peer reviews

•

text generation

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
ML4ED  
Event nameEvent acronymEvent placeEvent date
29 Conference on Intelligent User Interfaces

Greenville, United States

2024-03-18 - 2024-03-21

Available on Infoscience
January 26, 2025
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/244977
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés