Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3020165.3020172acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
research-article

An Interface for Supporting Asynchronous Multi-Level Collaborative Information Retrieval

Published: 07 March 2017 Publication History

Abstract

A great deal of research into Collaborative Information Retrieval (CIR) has assumed that search team members have the same level of unrestricted access to information. However, case studies and observations from different domains including government, healthcare and legal, have suggested that CIR sometimes involves people with unequal access to information. This type of scenario has been referred to as Multi-Level CIR (MLCIR). In addition to supporting collaboration, MLCIR systems must ensure that there is no unintended disclosure of sensitive information, this is an under investigated area of research. In this paper we present results of an evaluation of an interface we have designed for MLCIR scenarios. Pairs of participants used the interface under 3 different information access scenarios for a variety of search tasks. These scenarios included 1 CIR and 2 MLCIR scenarios, namely: full access (FA), document removal (DR) and term blacklisting (TR). Design interviews were conducted post evaluation to obtain qualitative feedback from participants. Evaluation results showed that our interface performed well for both DR and FA scenarios but for TR, team members with less access had a negative influence on their partner's search performance, demonstrating insights into how different MLCIR scenarios should be supported. Design interview results showed that our interface helped the participants to reformulate their queries, understand their partner's performance, reduce duplicated work and review their team's search history without disclosing sensitive information.

References

[1]
Amershi, S. and Morris, M. R.: CoSearch: a system for co-located collaborative web search. ACM SIGCHI 2008, 1647--1656.
[2]
Attfield, S., Blandford, A., Makri, S.: Social and interactional practices for disseminating current awareness information in an organisational setting. IPM, 46(6), 2010, 632--645.
[3]
Bjurling, B., Hansen, P.: Contracts for Information Sharing in Collaborative Networks. ISCRAM 2010, 1--5.
[4]
Borlund, P.: The IIR evaluation model: a framework for evaluation of interactive information retrieval systems. Information research, 8(3), 2003, Key: citeulike:1188067.
[5]
Brooke, J.: SUS: a retrospective. Journal of usability studies, 8(2), 2013, 29--40.
[6]
Brooke, J.: SUS-A quick and dirty usability scale. Usability evaluation in industry, 189(194), 1996, 4--7.
[7]
Foster, J.: Collaborative information seeking and retrieval. Annual review of information science and technology, 40(1), 2006, 329--356.
[8]
Freyne, J., Farzan, R., Brusilovsky, P., Smyth, B. and Coyle, M.: Collecting community wisdom: integrating social search & social navigation. ACM IUI 2007, 52--6
[9]
Glaser, B. G., Strauss, A. L. and Strutzel, E.: The Discovery of Grounded Theory; Strategies for Qualitative Research. Nursing Research, 17(4), 1968, 364
[10]
Golovchinsky, G., Pickens, J. and Back, M.: A taxonomy of collaboration in online information seeking. arXiv preprint, arXiv:0908.0704, 2009.
[11]
González-Ibáñez, R. and Shah, C.: Coagmento: A system for supporting collaborative information seeking. ASIS&T, 48(1), 2011, 1--4.
[12]
Halvey, M., Vallet, D., Hannah, D., Feng, Y., Jose, J. M.: An asynchronous collaborative search system for online video search. IPM, 46(6), 2010, 733--748.
[13]
Handel, M. J., Wang, E. Y.: I can't tell you what i found: problems in multi-level collaborative information retrieval. ACM CIR 2011, 1--6.
[14]
Hart, S. G. and Staveland, L. E.: Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. Advances in psychology, 52, 1988, 139--183.
[15]
Htun, N. N., Halvey, M. and Baillie, L.: How Can We Better Support Users with Non-Uniform Information Access in Collaborative Information Retrieval? ACM CHIIR 2017.
[16]
Htun, N. N., Halvey, M. and Baillie, L.: Towards Quantifying the Impact of Non-Uniform Information Access in Collaborative Information Retrieval. ACM SIGIR 2015, 843--846.
[17]
Joho, H., Hannah, D., Jose, J. M.: Comparing collaborative and independent search in a recall-oriented task. ACM IIiX 2008, 89--96.
[18]
Karunakaran, A., Reddy, M.: The Role of Narratives in Collaborative Information Seeking. ACM GROUP 2012, 273--276.
[19]
Kelly, R. and Payne, S.: Division of labour in collaborative information seeking: Current approaches and future directions. Workshop on Collaborative Information Seeking, held at ACM CSCW 2013.
[20]
Mitsui, M. and Shah, C.: Coagmento 2.0: A System for Capturing Individual and Group Information Seeking Behavior. ACM JCDL 2016, 233--234.
[21]
Morris, M. R.: Collaborative search revisited. ACM CSCW 2013, 1181--1192.
[22]
Morris, M. R.: A survey of collaborative web search practices. ACM CHI 2008, 1657--1660.
[23]
Morris, M. R., Horvitz, E.: SearchTogether: an interface for collaborative web search. ACM UIST 2007, 3--12.
[24]
Pickens, J., Golovchinsky, G., Shah, C., Qvarfordt, P., Back, M.: Algorithmic mediation for collaborative exploratory search. ACM SIGIR 2008, 315--322.
[25]
Shah, C.: Collaborative Information Seeking: From 'What?' and 'Why?' to 'How?' and 'So What?'. Collaborative Information Seeking, 2015, 3--16.
[26]
Shah, C.: Collaborative information seeking: The art and science of making the whole greater than the sum of all (Vol. 34). Springer Science & Business Media, 2012.
[27]
Shah, C.: Collaborative information seeking: A literature review. Advances in librarianship, 32(2010), 2010, 3--33.
[28]
Shah, C., González-Ibáñez, R.: Evaluating the synergic effect of collaboration in information seeking. ACM SIGIR 2011, 913--922.
[29]
Shah, C. and Marchionini, G.: Awareness in collaborative information seeking. ASIS&T 61(10), 2010, 1970--1986.
[30]
Shah, C., Marchionini, G. and Kelly, D.: Learning design principles for a collaborative information seeking system. ACM CHI EA 2009, 3419--3424.
[31]
Shah, C., Pickens, J. and Golovchinsky, G.: Role-based results redistribution for collaborative information retrieval. IPM, 46(6), 2010, 773--781.
[32]
Smeaton, A. F., Lee, H., Foley, C. and McGivney, S.: Collaborative video searching on a tabletop. Multimedia Systems, 12(4), 2007, 375--391.
[33]
Soulier, L., Shah, C. and Tamine, L.: User-driven system-mediated collaborative information retrieval. ACM SIGIR 2014, 485--494.
[34]
Soulier, L., Tamine, L. and Shah, C.: MineRank: Leveraging users' latent roles for unsupervised collaborative information retrieval. IPM, 52(6), 2016, 1122--1141.
[35]
Tamine, L. and Soulier, L.: Collaborative Information Retrieval: Concepts, Models and Evaluation. ECIR 2016, 885--888.
[36]
Tamine, L. and Soulier, L.: Understanding the Impact of the Role Factor in Collaborative Information Retrieval. ACM CIKM 2015, 43--52.

Cited By

View all
  • (2022)Reflection on future directions: a systematic review of reported limitations and solutions in interactive information retrieval user studiesAslib Journal of Information Management10.1108/AJIM-05-2022-0253Online publication date: 19-Dec-2022
  • (2018)Report on the Second International Workshop on the Evaluation on Collaborative Information Seeking and Retrieval (ECol?2017 @ CHIIR)ACM SIGIR Forum10.1145/3190580.319059951:3(122-127)Online publication date: 22-Feb-2018

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
CHIIR '17: Proceedings of the 2017 Conference on Conference Human Information Interaction and Retrieval
March 2017
454 pages
ISBN:9781450346771
DOI:10.1145/3020165
  • Conference Chairs:
  • Ragnar Nordlie,
  • Nils Pharo,
  • Program Chairs:
  • Luanne Freund,
  • Birger Larsen,
  • Dan Russel
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 March 2017

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. asynchronous collaboration
  2. information access
  3. information retrieval
  4. interface design
  5. non-uniform access

Qualifiers

  • Research-article

Conference

CHIIR '17
Sponsor:

Acceptance Rates

CHIIR '17 Paper Acceptance Rate 10 of 48 submissions, 21%;
Overall Acceptance Rate 55 of 163 submissions, 34%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)7
  • Downloads (Last 6 weeks)0
Reflects downloads up to 27 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2022)Reflection on future directions: a systematic review of reported limitations and solutions in interactive information retrieval user studiesAslib Journal of Information Management10.1108/AJIM-05-2022-0253Online publication date: 19-Dec-2022
  • (2018)Report on the Second International Workshop on the Evaluation on Collaborative Information Seeking and Retrieval (ECol?2017 @ CHIIR)ACM SIGIR Forum10.1145/3190580.319059951:3(122-127)Online publication date: 22-Feb-2018

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media