The centrality of user modeling to high recall with high precision search

Brassil, D., Hogan, C. and Attfield, Simon ORCID: https://orcid.org/0000-0001-9374-2481 (2009) The centrality of user modeling to high recall with high precision search. In: IEEE International Conference on Systems, Man and Cybernetics, 2009. IEEE, pp. 91-96. ISBN 9781424427932. [Book Section] (doi:10.1109/ICSMC.2009.5346738)

Abstract

The objective of search is to find documents relevant to a particular user's notion of relevance. However, relevance is often a moving target: imperfectly defined and subject to change as more documents are seen. In this paper, we report on systematic user modeling (UM) and the use of a system-internal agent (proxy) to produce a hybrid human-computer system that achieves extraordinarily high performance on mediated search tasks. We present details of our UM-approach and its four main components: (i) use case (ii) scope (iii) nuance and (iv) linguistic variability. We illustrate how these components provide a framework with which a user and a proxy co-construct a shared representation of information needs and mutual knowledge. This representation serves as the common ground through which external knowledge is shared, mediated, negotiated, synthesized and made accessible to the system. We evaluated the performance of our system on the Legacy Tobacco Documents Library, a corpus of advertising, manufacturing, marketing, sales and scientific research activities of major US tobacco companies. Independently adjudicated results from NIST's 2008 TREC legal track demonstrate that our approach to UM yields high performance on search tasks.

Item Type: Book Section
Additional Information: Date of Conference: 11-14 Oct. 2009
Conference Location: San Antonio, TX.
Keywords (uncontrolled): Accuracy; complex litigation; human-computer interaction; information retrieval Sensemaking
Research Areas: A. > School of Science and Technology > Computer Science
Item ID: 11794
Useful Links:
Depositing User: Shrikant Chavan
Date Deposited: 27 Aug 2013 08:24
Last Modified: 13 Oct 2016 14:28
URI: https://eprints.mdx.ac.uk/id/eprint/11794

Actions (login required)

View Item View Item

Statistics

Downloads
Activity Overview
0Downloads
400Hits

Additional statistics are available via IRStats2.