Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Template Induction over Unstructured Email Corpora
 
conference paper

Template Induction over Unstructured Email Corpora

Proskurnia, Julia  
•
Cartright, Marc-Allen
•
Garcia-Pueyo, Lluis
Show more
2017
Proceedings of the 26th International Conference on World Wide Web
26th International Conference on World Wide Web (WWW'17)

Unsupervised template induction over email data is a central component in applications such as information extraction, document classification, and auto-reply. The benefits of automatically generating such templates are known for structured data, e.g. machine generated HTML emails. However much less work has been done in performing the same task over unstructured email data. We propose a technique for inducing high quality templates from plain text emails at scale based on the suffix array data structure. We evaluate this method against an industry-standard approach for finding similar content based on shingling, running both algorithms over two corpora: a synthetically created email corpus for a high level of experimental control, as well as user-generated emails from the well-known Enron email corpus. Our experimental results show that the proposed method is more robust to variations in cluster quality than the baseline and templates contain more text from the emails, which would benefit extraction tasks by identifying transient parts of the emails. Our study indicates templates induced using suffix arrays contain approximately half as much noise (measured as entropy) as templates induced using shingling. Furthermore, the suffix array approach is substantially more scalable, proving to be an order of magnitude faster than shingling even for modestly-sized training clusters. Public corpus analysis shows that email clusters contain on average 4 segments of common phrases, where each of the segments contains on average 9 words, thus showing that templatization could help users reduce the email writing effort by an average of 35 words per email in an assistance or auto-reply related task.

  • Files
  • Details
  • Metrics
Type
conference paper
DOI
10.1145/3038912.3052631
Author(s)
Proskurnia, Julia  
Cartright, Marc-Allen
Garcia-Pueyo, Lluis
Krka, Ivo
Wendt, James B.
Kaufmann, Tobias
Miklos, Balint
Date Issued

2017

Publisher

International World Wide Web Conferences Steering Committee Republic and Canton of Geneva, Switzerland ©2017

Published in
Proceedings of the 26th International Conference on World Wide Web
ISBN of the book

978-1-4503-4913-0

Start page

1521

End page

1530

Subjects

Human-generated email

•

structural template

•

fixed phrase extraction

•

templatization

•

suffix array generalization

•

ENRON corpus.

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
LSIR  
Event nameEvent placeEvent date
26th International Conference on World Wide Web (WWW'17)

Perth, Australia

April 03 - 07, 2017

Available on Infoscience
August 17, 2017
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/139677
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés