Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3343413.3377992acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
short-paper
Public Access

A Qualitative Analysis of the Effects of Task Complexity on the Functional Role of Information

Published: 14 March 2020 Publication History

Abstract

An important question in interactive information retrieval (IIR) is: How do task characteristics influence users' needs? In this paper, we investigate the effects of cognitive task complexity on the types of information considered useful for a task. We characterize information types from two perspectives. From one perspective, we classify task-related information items based on inherent characteristics (referred to as info-types): factual statements, concepts/definitions, opinionated statements, and insights---tips/advice related to the task domain. From a second perspective, we used Byströ m and J\"a rvelin's framework~\citebystrom1995 to define information types based on how the information might be used to complete the task (referred to as functional roles): (1) to help the task doer understand the task requirements (problem information); (2) to help the task doer strategize on how to approach the task (problem-solving information); and (3) to help the task doer learn about the task domain (domain information). Our results suggest that: (1) cognitive task complexity influences the functional roles of information items deemed useful for the task (RQ1); (2) certain info-types are more (or less) likely to play certain functional roles (RQ2); and task complexity influences the variety of functional roles played by info-types (RQ3).

References

[1]
Lorin W. Anderson and David R. Krathwohl. 2001. A taxonomy for learning, teaching, and assessing: A revision of Bloom's taxonomy of educational objectives .
[2]
David J Bell and Ian Ruthven. 2004. Searcher's assessments of task complexity for web searching. In ECIR. Springer, 57--71.
[3]
Katriina Byström. 1999. Task complexity, information types and information sources: examination of relationships .Tampere University Press.
[4]
Katriina BystrÖm. 2002. Information and information sources in tasks of varying complexity. JASIST, Vol. 53, 7 (2002), 581--591.
[5]
Katriina Byström and Kalervo J"arvelin. 1995. Task complexity affects information seeking and use. IP&M, Vol. 31, 2 (1995), 191--213.
[6]
Donald J Campbell. 1988. Task complexity: A review and analysis. Academy of management review, Vol. 13, 1 (1988), 40--52.
[7]
Robert Capra, Jaime Arguello, Anita Crescenzi, and Emily Vardell. 2015. Differences in the use of search assistance for tasks of varying complexity. In SIGIR . ACM, 23--32.
[8]
Jorge Carrillo-de Albornoz, Ahmet Aker, Emina Kurtic, and Laura Plaza. 2019. Beyond opinion classification: Extracting facts, opinions and experiences from health forums. PLOS ONE, Vol. 14 (2019).
[9]
Bogeum Choi, Austin Ward, Yuan Li, Jaime Arguello, and Robert Capra. 2019. The Effects of Task Complexity on the Use of Different Types of Information in a Search Assistance Tool. TOIS, Vol. 38, 1 (2019).
[10]
Anita Crescenzi, Yuan Li, Yinglong Zhang, and Rob Capra. 2019. Towards Better Support for Exploratory Search Through an Investigation of Notes-to-self and Notes-to-share. In SIGIR. ACM, 1093--1096.
[11]
Bernard J Jansen, Danielle Booth, and Brian Smith. 2009. Using the taxonomy of cognitive learning to model online searching. IP&M, Vol. 45, 6 (2009), 643--663.
[12]
Diane Kelly, Jaime Arguello, Ashlee Edwards, and Wan-ching Wu. 2015. Development and evaluation of search tasks for IIR experiments using a cognitive complexity framework. In ICTIR. ACM, 101--110.
[13]
J. R. Landis and G. G. Koch. 1977. The Measurement of Observer Agreement for Categorical Data. Biometrics, Vol. 33, 1 (1977), 159--174.
[14]
Miamaria Saastamoinen, Sanna Kumpulainen, Pertti Vakkari, and Kalervo J"arvelin. 2013. Task complexity affects information use: a questionnaire study in city administration. Information Research, Vol. 19, 4 (2013).
[15]
Robert S Taylor. 1991. Information use environments. Progress in communication sciences, Vol. 10, 217 (1991), 55.
[16]
Janyce Wiebe, Theresa Wilson, Rebecca Bruce, Matthew Bell, and Melanie Martin. 2004. Learning Subjective Language. Computational Linguistics., Vol. 30, 3 (2004).
[17]
Wan-Ching Wu, Diane Kelly, Ashlee Edwards, and Jaime Arguello. 2012. Grannies, tanning beds, tattoos and NASCAR: Evaluation of search tasks with varying levels of cognitive complexity. In IIiX'12. ACM, 254--257.

Cited By

View all
  • (2024)Enforcing STEM-Driven CS Education Through Collaborative LearningEvolution of STEM-Driven Computer Science Education10.1007/978-3-031-48235-9_5(135-163)Online publication date: 1-Jan-2024
  • (2023)Better Understanding Procedural Search Tasks: Perceptions, Behaviors, and ChallengesACM Transactions on Information Systems10.1145/363000442:3(1-32)Online publication date: 29-Dec-2023
  • (2023)Contextualizing Session Resuming Reasons with Tasks Involving Expected Cross-session SearchesInformation for a Better World: Normality, Virtuality, Physicality, Inclusivity10.1007/978-3-031-28032-0_32(406-422)Online publication date: 13-Mar-2023

Index Terms

  1. A Qualitative Analysis of the Effects of Task Complexity on the Functional Role of Information

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHIIR '20: Proceedings of the 2020 Conference on Human Information Interaction and Retrieval
    March 2020
    596 pages
    ISBN:9781450368926
    DOI:10.1145/3343413
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 14 March 2020

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. cognitive task complexity
    2. functional role of information
    3. information types
    4. search behavior

    Qualifiers

    • Short-paper

    Funding Sources

    Conference

    CHIIR '20
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 55 of 163 submissions, 34%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)60
    • Downloads (Last 6 weeks)3
    Reflects downloads up to 01 Dec 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Enforcing STEM-Driven CS Education Through Collaborative LearningEvolution of STEM-Driven Computer Science Education10.1007/978-3-031-48235-9_5(135-163)Online publication date: 1-Jan-2024
    • (2023)Better Understanding Procedural Search Tasks: Perceptions, Behaviors, and ChallengesACM Transactions on Information Systems10.1145/363000442:3(1-32)Online publication date: 29-Dec-2023
    • (2023)Contextualizing Session Resuming Reasons with Tasks Involving Expected Cross-session SearchesInformation for a Better World: Normality, Virtuality, Physicality, Inclusivity10.1007/978-3-031-28032-0_32(406-422)Online publication date: 13-Mar-2023

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media