Inferring Document Similarity from Hyperlinks
Assessing semantic similarity between text documents is a crucial aspect in Information Retrieval systems. In this work, we propose to use hyperlink information to derive a similarity measure that can then be applied to compare any text documents, with or without hyperlinks. As linked documents are generally semantically closer than unlinked documents, we use a training corpus with hyperlinks to infer a function $a,b \to sim(a,b)$ that assigns a higher value to linked documents than to unlinked ones. Two sets of experiments on different corpora show that this function compares favorably with {\em OKAPI} matching on document retrieval tasks.
grangier-2005-cikm.pdf
openaccess
66.2 KB
Adobe PDF
4d290ed7bc3c9c4a342be69ef3eccdf6