Agile text mining with Sherlok

The successful development of an intelligent text mining application requires the collaboration of two main stakeholders: subject matter experts and text miners. In this paper, we describe a new methodology, agile text mining to improve that collaboration. Agile text mining is characterized by short development cycles, frequent tasks redefinition and continuous performance monitoring through integration tests. We introduce Sherlok, a system supporting the development of agile text mining applications and present an application to extract mention of neurons from a very large corpus of scientific articles. The resulting code and models are publicly available.


Published in:
2015 IEEE International Conference on Big Data (Big Data), 1479-1484
Presented at:
2015 IEEE International Conference on Big Data (Big Data), Santa Clara, CA, USA, 29 October - 1 November 2015
Year:
2015
Publisher:
IEEE
Keywords:
Laboratories:




 Record created 2016-10-28, last modified 2018-03-18


Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)