Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. SCRIBE: Structured Chain Reasoning for Interactive Behaviour Explanations using Tool Calling
 
conference proceedings

SCRIBE: Structured Chain Reasoning for Interactive Behaviour Explanations using Tool Calling

Fawzi, Fares  
•
Swamy, Vinitra  
•
Glandorf, Dominik
Show more
2025
Conference on Empirical Methods in Natural Language Processing (EMNLP)

Language models can be used to provide interactive, personalized student feedback in educational settings. However, real-world deployment faces three key challenges: privacy concerns, limited computational resources, and the need for pedagogically valid responses. These constraints require small, open-source models that can run locally and reliably ground their outputs in correct information. We introduce SCRIBE, a framework for multi-hop, tool-augmented reasoning designed to generate valid responses to student questions about feedback reports. SCRIBE combines domain-specific tools with a self-reflective inference pipeline that supports iterative reasoning, tool use, and error recovery. We distil these capabilities into 3B and 8B models via two-stage LoRA fine-tuning on synthetic GPT-4o-generated data. Evaluation with a human-aligned GPT-Judge and a user study with 108 students shows that 8B-SCRIBE models achieve comparable or superior quality to much larger models in key dimensions such as relevance and actionability, while being perceived on par with GPT-4o and Llama-3.3 70B by students. These findings demonstrate the viability of SCRIBE for low-resource, privacy-sensitive educational applications.

  • Files
  • Details
  • Metrics
Loading...
Thumbnail Image
Name

2025.emnlp-main.1490.pdf

Type

Main Document

Version

Published version

Access type

openaccess

License Condition

N/A

Size

2.46 MB

Format

Adobe PDF

Checksum (MD5)

98e8646a67ead29da3eb4e3fb9fed093

Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés